Spark developer with AWSRemote

Job Details

  • ID#37680107
  • Address 19160 , Philadelphia,

    New Jersey

    Philadelphia USA
  • Job type


  • Salary USD $As Per Experience As Per Experience
  • Hiring Company

    Sysmind, LLC

  • Showed04th April 2022
  • Date03rd April 20222022-04-03T03:00:00-0400
  • Deadline02nd June 2022
  • Category

    Et cetera

Spark developer with AWSRemote

Vacancy expired!

Hi, Hope you are doing Great We have an urgent requirement below is the job description if comfortable please send your most updated resume and best time when we can talk. NOTE- IMMEDIATE INTERVIEW (Same Day) Position : Spark Developer with AWS Location: Philadelphia PA (Remote ) Duration: 12+ Months Job Description and Responsibilities:

  • Must have knowledge on Spark/Spark SQL - Spark Core, Spark SQL, Data Frames, Spark Streaming, Driver Node, Worker Node, Stages, Executors and Tasks in Data bricks for ETL.
  • Data Bricks CLI, API, Streaming, Notebook Preparation, Job submission, Data Bricks DevOps Automation.
  • Knowledge in Python/Scala.
  • Knowledge on HDFS, Hive. Pig, Scoop, Spark, Kafka
  • Real Time and Batch Processing
  • AWS-Knowledge of Architecture and Offerings besides general Cloud concepts
  • Must have solid CLI and console hands on with IAM, S3, EC2, Lambda
  • ETL Data Pipeline.
  • 1. Develop enterprise applications using agile methodology.
  • 2. Create Real time streaming data ingestion using Spark, Scala, Python
  • 3.To meet specific business requirements in Scala and Pyspark.
  • Extract Transform and Load data from Various Sources Systems to AWS S3 using Spark SQL and Data Bricks Cluster.
  • 4. Develop Spark applications in Data Bricks Notebook, deploy in cluster and scheduling, monitoring and troubleshooting of job failures.
  • 5. Identify functional test scenarios in line with business objectives.
  • 6. Support testing efforts and Support documentation efforts
  • 7. Understand and consume application requirements and use cases
  • 8. Design and document technical solution strategies and architectures fulfilling complex business requirements
  • 9. AWS-Knowledge of Architecture and Offerings besides general Cloud concepts
  • 10. Must have solid CLI and console hands on with VPC, S3,EC2,Lambda
  • 11. Preferably should have experience with Athena, SNS, SQS, Redshift, DynamoDB, Cloudwatch, IAM etc.
  • SYSMIND LLC is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without any discrimination. We promote and support a diverse workforce at all levels in the company. All job offers are contingent upon completion of a satisfactory background check and reference checks. Additionally passing the drug test may also be required. All contractors intending to work on SYSMIND's W2 are "at will" employees.

    Vacancy expired!