Hadoop PySpark Data Pipeline Build Engineer

Job Details

  • ID#49398187
  • Address 19130 , Philadelphia,


    Philadelphia USA
  • Job type


  • Salary USD $165,000 - $190,000 hourly 165000 - 190000 hourly
  • Hiring Company

    Kforce Technology Staffing

  • Showed04th March 2023
  • Date03rd March 20232023-03-03T00:00:00-0800
  • Deadline02nd May 2023
  • Category

    Et cetera

Hadoop PySpark Data Pipeline Build Engineer

Vacancy expired!

RESPONSIBILITIES:Kforce's client, one of the world's largest financial institutions, seeks a Hadoop PySpark Data Pipeline Build Engineer for a minimum 1-year contract with long-term opportunities in Philadelphia, PA, Charlotte, NC, Dallas, TX and Palo Alto, CA.Responsibilities: The Hadoop PySpark Data Pipeline Build Engineer will be optimizing physical models based on use case needs and data access patterns, considering performance, volumes, and complexity of queries Facilitating data discovery sessions involving business subject matter experts Translating/mapping relational data models into Data Schemas Create and maintain conceptual/business, logical and physical data models Translate a logical model into a physical model, adding appropriate physical objects needed to create the database e.g. indexes Maintaining a model repository, along with enforcing logical model versioning, tied to physical schema evolution The Hadoop PySpark Data Pipeline Build Engineer will synchronize models to ensure that database structures match modelsREQUIREMENTS: 10+ years of information architecture and data modeling experience 10+ years of BI/DW and data modeling experience Knowledge of Data Warehousing, ETL and BI architectures, concepts and frameworks Deep knowledge of Kimball, Inmon, Data Vault approaches for data warehouse modeling and the core differences Experience in data warehouse/data mart/NoSQL modeling principles/methods including conceptual, logical & physical Data Models Deep experience with time-series, dimensional, column-oriented, event sourced, and semantic data modeling patterns Cyber Security domain knowledge Experience with modeling tools (such as ERWin and ER/Studio) Familiar with metadata ingestion and translation Excellent presentation, communication, and organizational skills Strong interpersonal skills and ability to work as part of a team Familiar with Data Governance Process Management Strong communicator and leader Experience with data modeling in the Google Cloud Platform/Azure cloud environments are a bonusHands-on experience with: Data Pipeline Product development - designing and building Domain Driven Design based Data Product and Data Mesh Architecture concepts Google Cloud Big Data Specialty Hadoop Services Development PySpark Programming - expert level Airflow Custom Operator Development Debezium Open Source CDC - a plus Kafka development CI/CD, DevOps, QA AutomationThe pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.This job is not eligible for bonuses, incentives or commissions.Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Vacancy expired!