Sr Data Engineer
Vacancy expired!
Sr Data Engineer - 90% WFHPosition Summary:This role is responsible for providing technical expertise and leadership to design and deliver end-to-end data engineering solutions to support advanced analytics capabilities and drive innovation and decision-making across our enterprise.Responsibilities:
- Build and maintain real-time and batch data pipelines across the advanced analytics platform.
- Design, develop and orchestrate highly robust and scalable ETL pipelines.
- Design and implement Dimensional and NoSQL data modeling as per the business requirements.
- Develop highly optimal codebase and perform Spark optimizations for Big Data use cases.
- Design, develop and deploy optimal monitoring and testing strategy for the data products.
- Collaborate with stakeholders and advanced analytics business partners to understand business needs and translate requirements into scalable data engineering solutions.
- Collaborate with data scientists to prepare data for model development and production.
- Collaborate with data visualization and reporting application developers to ensure the sustainability of production applications and reports.
- Collaborate with data architects on the enhancement of our enterprise data architecture and platforms.
- Provide leadership to third-party contractors.
- Comply with health and safety guidelines and rules.
- Maintain professional and technical knowledge by attending educational workshops, professional publications, establishing personal networks, and participating in professional societies.
- 4+ years of experience in Data Engineering
- 2+ years of experience with Advanced Analytics or Data Science
- Proficient in Spark
- Experience with Azure
- Experience with IoT Data Architecture.
- Machine Learning Operationalization (MLOps) proficiency.
- Proficiency with streaming design patterns