Hi, Hope you are doing Great We have an urgent requirement below is the job description if comfortable please send your most updated resume and best time when we can talk. NOTE- IMMEDIATE INTERVIEW (Same Day) Position : Spark Developer with AWS Location: Philadelphia PA (Remote ) Duration: 12+ Months Job Description and Responsibilities:
Must have knowledge on Spark/Spark SQL - Spark Core, Spark SQL, Data Frames, Spark Streaming, Driver Node, Worker Node, Stages, Executors and Tasks in Data bricks for ETL. Data Bricks CLI, API, Streaming, Notebook Preparation, Job submission, Data Bricks DevOps Automation. Knowledge in Python/Scala. Knowledge on HDFS, Hive. Pig, Scoop, Spark, Kafka Real Time and Batch Processing AWS-Knowledge of Architecture and Offerings besides general Cloud concepts Must have solid CLI and console hands on with IAM, S3, EC2, Lambda ETL Data Pipeline. 1. Develop enterprise applications using agile methodology. 2. Create Real time streaming data ingestion using Spark, Scala, Python 3.To meet specific business requirements in Scala and Pyspark. Extract Transform and Load data from Various Sources Systems to AWS S3 using Spark SQL and Data Bricks Cluster. 4. Develop Spark applications in Data Bricks Notebook, deploy in cluster and scheduling, monitoring and troubleshooting of job failures. 5. Identify functional test scenarios in line with business objectives. 6. Support testing efforts and Support documentation efforts 7. Understand and consume application requirements and use cases 8. Design and document technical solution strategies and architectures fulfilling complex business requirements 9. AWS-Knowledge of Architecture and Offerings besides general Cloud concepts 10. Must have solid CLI and console hands on with VPC, S3,EC2,Lambda 11. Preferably should have experience with Athena, SNS, SQS, Redshift, DynamoDB, Cloudwatch, IAM etc. SYSMIND LLC is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without any discrimination. We promote and support a diverse workforce at all levels in the company. All job offers are contingent upon completion of a satisfactory background check and reference checks. Additionally passing the drug test may also be required. All contractors intending to work on SYSMIND's W2 are "at will" employees.
