Senior Developer - Data Engineer

Job Title: Senior Data EngineerLocation: Hybrid/Multiple locations available (Boston, Houston, KCMO, Denver)Duration: Contract to HireOur client, a global Architecture and Design Firm, is looking to add a Senior Data Engineer to their Core IT Division out of their Global Headquarters in Kansas City, MO.The Data Engineer will help build and maintain the cloud Delta Lake platform leveraging Databricks. Candidates will be expected to contribute to all stages of the data lifecycle including data ingestion, data modeling, data profiling, data quality, data transformation, data movement, and data curation.Job Responsibilities may include:Design, implement (deploy), and support on-premise and cloud-based data infrastructure (systems, flow) that are resilient to disruptions and failuresEnhance and support corporate SQL/NoSQL database, DWH assets, and streaming data solutionsEnsure high uptime for all data services and consider enhanced solutions through scheduled or event-driven designBring multi-cloud/cross-platform agnostic technologies and practices into the system to enhance reliability and support rapid scaling of the business's data needsScale up our data infrastructure to meet cross-functional, multi-industry business needsDevelop, leverage and maintain end-to-end data pipelines in productionProvide subject matter expertise and hands-on delivery of data acquisition, curation, and consumption pipelines on Azure, Databricks, AWS, ConfluentResponsible for maintaining current and emerging state-of-the-art computing and cloud-based solutions and technologies.Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.Hands-on experience implementing analytics solutions leveraging Python, Spark SQL, Databricks Lakehouse Architecture, orchestration tools Kubernetes, Docker Requirements:Bachelor's degree in Computer Science, Information Technology, Management Information Systems (MIS), Data Science, or related field. Applicable years of experience may be substituted for the degree requirement.Minimum 8 years of experience in software engineeringExperience with leading large and complex data projects, preferredExperience with large-scale data warehousing architecture and data modeling, preferredWorked with Cloud-based architecture such as Azure, AWS or Google Cloud, preferredExperience working with big data technologies e.g. Snowflake, Redshift, Synapse, Postgres, Airflow, Kafka, Spark, DBT, preferredExperience implementing pub/sub and streaming use cases, preferredExperience leading design reviews, preferredExperience influencing a team's technical and business strategy by making insightful contributions to team priorities and approaches, preferredWorking knowledge of relational databases, preferredExpert in SQL, Python, Java and high-level languages such as Scala, C#, or C preferredDemonstrate the ability to analyze large data sets to identify gaps and inconsistencies in ETL pipeline and provide solutions for pipeline reliability and data quality, preferredExperience in designing and implementing infrastructure as code / CICD development environment, preferredESPO Corporation View all open jobs at Leaders in Technical Recruiting & Staffing since 1965We are an Equal Opportunity Employer and value the benefits of diversity in our workforce . All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity and expression, national origin, disability, protected Veteran status, or any other attribute or protected characteristic by law. If you need assistance applying please contact us directly.