Azure Data Engineer - Charlotte, NC / Detroit, MI
- Category: Et cetera
- Deadline: 02nd May 20232023-05-02T01:00:00-0700
- North Carolina
DTS is looking for Azure Data Engineer for a long term contract with our direct client Position in Charlotte, NC / Detroit, MI. Candidate Interested in either of these locations should apply Top Skills: Familiarity with Azure platform and especially with data services like Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure function, Service Bus, etc. Experience with python & SQL The Work:
Apply This Job
- Design and build to enhance an ever-expanding data platform supporting business process needs for internal and external integration via APIs, data models, self-serve reporting solutions, and interactive querying
- Define, build, test, document and audit data platform artifacts including data models, data flow processes, integrations, etc.
- Develop standard methodologies and frameworks for unit, functional and integration tests around data pipelines, and drive the team towards increased overall test coverage
- Design Continuous integration and deployment processes and best practices for the production data pipelines.
- Create data platform artifacts for data flow processes and integrations
- Work with the latest and greatest technologies in the Microsoft cloud stack including Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure function, Service Bus, etc.
- Collaborate and influence Users, Engineers and Products partners to ensure our data infrastructure meets constantly evolving requirements
- Finds opportunities to adopt innovative technologies that fuels company vision
- Bachelor's degree in Computer Science, Information Systems, similar technical field of study or equivalent practical experience
- 5+ years of relevant work experience
- Experience working with cloud platforms such as Azure or AWS
- Solid understanding of real-time data processing, data pipelines, transformation and modeling using traditional and distributed systems
- Experience with development of test automation solutions
- Detailed knowledge of Relational, Multi-Dimensional databases and No-SQL solutions
- The successful candidate will have strong programming skills, especially in SQL, data modeling and related data processing concepts
- Experience with developing and architecting data ingestion models, ETL jobs, and alerting to maintain high availability and data integrity
- Experience working in Python, PySpark. Databricks experience is preferred
- Experience working with real-time data processing framework using Kafka / Azure event hubs
- Experience in building modern data lake architectures like Lakehouse/Lambda
Similar jobs
Hexaware Technologies, Inc - Azure Data Engineer - Multiple roles - Mt Laurel, NJ / Raleigh, NC / Charlotte, NC / Fort Lauderdale, FL
Digital Technology Solutions - Data Masking Engineer - Charlotte, NC/Detroit, MI
Digital Technology Solutions - Data Masking Engineer - Charlotte, NC/Detroit, MI
Blue.Cloud - Azure Data Engineer Local to Charlotte, NC only