Data Engineer or Python Developer
Vacancy expired!
Job Title:
Data Engineer or Python Developer Location: Austin, TX (Onsite) (max 3 weeks of initial remote allowed)Duration: 12+ Months Experience: 10+ years Job Description:- Design, development, and testing of data ingestion pipelines, perform end to end automation of ETL process and migration of various datasets that are being ingested
- Participate in discussion for technical architecture, Migration activities, collaborate with Product Managers and Architects to establish the Physical application framework
- Develop transformation logic, interfaces and reports as need to meet project requirements.
- 10+ years of experience building and managing complex products / solutions
- 5+ years of experience supporting data heavy applications and databases leveraging Python and Pyspark
- Strong data handling and text log analysis skills
- Expert level experience in Python, Pyspark and SQL
- Good to have Scala, distributed computing, Kafka and REST based API skills