Senior Data Engineer

Title: Data Engineer (HiveQL/Spark Core)Location's: Summit NJ, Chandler AZ and New York NY.Candidate can work from any one of the ablove locations or Hybrid.Location: MultipleDescription:Required:3-5+ years of experience in Software Development Life cycle, data ingestion, storage, querying, processing, and analysis.Expertise in Creating Hive Internal/External Tables/Views using shared Meta store, writing scripts in HiveQL. Experience working in Spark Core and Spark SQL.Expertise in Data load management, importing & exporting data using SQOOP.Developed ETL (Ex: Ab Initio, SSIS) solutions for ingesting data from federated sources.Oracle & SQL DB expertiseExperience working in Spark Core and Spark SQL.Experience developing, installing, and configuring Hadoop ecosystem components.Good knowledge on ETL procedures to transform the data in the intermediate tables according to the business rules and functionality requirements.Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs/Data frames, Scala.Looking Forward.