Data Engineer - ETL, Azure, ADF, Data Lake

Job Details

  • ID#43718676
  • Address 78201 , San antonio,

    Texas

    San antonio USA
  • Job type

    Contract

  • Salary USD $60 - $70 60 - 70
  • Hiring Company

    Convene Inc.

  • Showed30th June 2022
  • Date29th June 20222022-06-29T00:00:00-0700
  • Deadline28th August 2022
  • Category

    Et cetera

Data Engineer - ETL, Azure, ADF, Data Lake

  • Category: Et cetera
  • Deadline: 28th August 20222022-08-28T00:00:00-0700
  • Texas

Vacancy expired!

Purpose of the Position:The ETL Developer builds data integrations and data warehouse platforms, loads and stores data and supervises loading processes and software. Job assignments will include analysis, ETL development, extracting data from operational systems directly, data files, staging, common data models, analytics areas, and data marts within the platform and send data to other systems directly and via Power Platform. Includes ETL mapping via SQL queries and data factory activities. The ETL Developer will also assist in the development, implementation and support of the Azure based platform and will provide ETL expertise to other areas of the organization.Key Accountabilities:• Creates and enhances prototypes, develops modern metadata-driven data warehouse solutions using Microsoft Azure Stack (e.g., Service Bus, Data Factory & it’s templates, Data Lake Storage Gen2, Synapse, Azure OCR, Search, Databricks, Monitor, Logging, Auditing, Key Vault, Cosmos DB, Talend Studio, Purview, DevOps, and MS Power Platform Dataverse, Common Data Service, Power Apps, Power BI).• Creates tools to generate Azure and other scripts to configure the Azure Platform.• Translates data access, transformation, and movement requirements into functional requirements and mapping designs using different data warehousing concepts.• Inventories source systems: collects, parses, manages, and analyzes many sets of data.• Designs, develops, tests, and documents ETLs into data stores, marts, analytics layer and ensure the system runs smoothly and ensures data quality.• Builds logical data models and implements physical data model (e.g. tables, simple and materialized views, stored procedures needed to support reporting and integrations).• Develops operations support manual(s) and provides system support. Competencies and Skills:• Expertise in Azure Data Environment as a Data Engineer and ETL developer (e.g. SQL queries, Data Factory activities and Common Data Service)• Hands-on experience in Azure stack (e.g., Azure Data Lake, Azure Data Factory, Azure Databricks, Cosmos DB and Power Platform (incl. Power BI)) • Expertise to Implementing Data Warehousing Solutions• Proficient in Azure fine-grained access control, backup/clone procedures and support• Proficient with MS SQL and database structures on Windows Server platform• Proficient in web development (Desired, but not required: HTML, React, .NET, MS Visual Studio, ASP .NET, CSS, Angular Mean Stack, JavaScript, C# development)• Communication skills - able to communicate in a clear, articulate, and professional manner on a daily basis via written and oral.• Interpersonal and Customer Relations skills – able to maintain a professional and courteous attitude with coworkers and third-party individuals always to resolve conflicts and address any issues within the contractual structure and regulations.• Planning/Organizational skills - able to prioritize work activities, use time efficiently and work through projects in a self-motivated manner balancing effort between project-work and daily tasks.• Adaptability – able to adapt to rapid changes in the work environment, manage competing demands and able to deal with frequent change, delays, or unexpected events.• Problem-solving skills – able to identify and resolve problems in a timely manner; gather and analyze information skillfully; and able to apply independent judgment on a regular basis in making decisions.• Time Management skills – able to use time effectively in a semi-supervised fashion, pursuing other activities when regular duties have reduced in volume; able to complete projects in a timely manner.Work Experience Requirements:• 8+ years’ in Information Technology• 5+ years’ hands-on experience in DW/BI design, development, and implementation• 5+ years’ experience programming (Design/Develop) in SQL, integrations• Experience with a major ETL tool, preferably Azure Data Factory• Experience maintaining source code in Git and managing a CI/CD pipeline, preferably with Azure DevOps• 5+ years’ experience troubleshooting, diagnosing, and debugging software programs• Demonstrated ability to positively interact with various employees and vendors• Visa sponsorship not available• Must reside in Texas (near Austin or San Antonio) Education Requirements:• Bachelor’s degree in Computer Science, MIS, Computer Engineering or other technology focused discipline or equivalent experience or equivalent work experienceOther Qualifications:• Microsoft Azure infrastructure and networking

Vacancy expired!