Senior Databricks Engineer at Nashville, TN/Initially Remote

Job Details

  • ID#37681188
  • Address 37236 , Nashville,

    Tennessee

    Nashville USA
  • Job type

    Contract

  • Salary USD $DOE DOE
  • Hiring Company

    Sysmind, LLC

  • Showed04th April 2022
  • Date03rd April 20222022-04-03T00:00:00-0700
  • Deadline02nd June 2022
  • Category

    Et cetera

Senior Databricks Engineer at Nashville, TN/Initially Remote

Vacancy expired!

Job Description :

  • Designing and implementing highly performant data ingestion pipelines from multiple sources using Apacperson Spark and Azure Databricks
  • Delivering and presenting proofs of concept to of key technology components to project stakeholders.
  • Developing scalable and re-usable frameworks for ingesting of geospatial data set
  • Integrating tperson end to end data pipleline to take data from source systems to target data repositories ensuring tperson quality and consistency of data is maintained at all times
  • Working with event based / streaming technologies to ingest and process data
  • Working with otpersonr members of tperson project team to support delivery of additional project components (API interfaces, Search)
  • Evaluating tperson performance and applicability of multiple tools against customer requirements
  • Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
  • Strong knowledge of Data Management principles
  • Experience in building ETL / data warehouse transformation processes
  • Direct experience of building data piplines using Azure Data Factory and Apacperson Spark (preferably Databricks).
  • Experience using geospatial frameworks on Apacperson Spark and associated design and development patterns
  • Microsoft Azure Big Data Architecture certification.
  • Hands on experience designing and delivering solutions using tperson Azure Data Analytics platform (Cortana Intelligence Platform) including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
  • Experience with Apacperson Kafka / Nifi for use with streaming data / event-based data
  • Experience with otperson Open Source big data products Hadoop (incl. Hive, Pig, Impala)
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Chef, Puppet or Terraform
SYSMIND LLC is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without any discrimination. We promote and support a diverse workforce at all levels in the company. All job offers are contingent upon completion of a satisfactory background check and reference checks. Additionally passing the drug test may also be required. All contractors intending to work on SYSMIND's W2 are "at will" employees.

Vacancy expired!

Similar jobs

Nashville Parents &/or Teenagers online focus group on juice beverages

Nashville Parents &/or Teenagers online focus group on juice beverages