Azure Data Engineer
Vacancy expired!
Responsibilities:
- Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions
- Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks) and traditional data warehouse tools.
- Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CI/CD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support
- Be a part of a DevOps team that completely owns and supports their product
- Provide technical leadership and collaborate within a team environment as well as work independently
- 5+ years of software solutions development using Agile, DevOps that includes designing, developing, and implementing large-scale applications or data engineering solutions
- 2 years of cloud development and data lake experience including Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure DevOps, and Power BI
- Experience with Azure cloud, interaction with Azure CLI and APIs
- Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation and creating consumption layers
- Good understanding of ETL (data transformations)
- Experience with Terraform, Terratest and Go programming is preferred
- Azure networking skills and certification in AZ104 – Azure Administrator is preferred
- Bachelor's degree in Computer Science/Engineering or related field