Big Data/ Hadoop Lead

Greetings from Sligo Software Solutions, Inc. This is Vilasini from SLIGO. We have a urgent requirement for Big Data/Hadoop Lead position with our client. Title : Big Data/Hadoop Lead Location : Albany, New York Duration : 12 Months Client : Sligo Software Solutions - Sligo Software Solutions Inc Client ID: ANM-001 Respond by: 12/31/22 4:00 PM Greetings from Sligo Software Solutions, Inc. SLIGO is a Software Development & IT Consulting company. We have around 100+ IT associates working with our esteemed clients across several domains such as IT, Banking, Healthcare, and Government. We have a urgent requirement for Data Technical Lead position with our client. Role: Big Data/ Hadoop Lead with Scala and Spark Location: Albany, New York Duration: 12 Months Client Job ID#: ANM-001 Duties

• Lead data engineer and analyst to deliver data sets and analysis results as per business requirements
• Assemble large, complex data sets that meets functional/Non-Functional business requirements. Automating manual processes, optimizing data delivery, recommending platform greater scalability/improvements Collaborate with initiative leads to optimize and enhance new capabilities
• Mentor team in migrating Hadoop on-prem to cloud/AWS
• Create and maintain optimal data pipeline architecture.
• Presenting analysis results/recommendations using Powerpoint

• Experience (10+ Years)

• This is an 100% Onsite
• 10+ yrs IT experience and good expertise in SDLC/Agile
• 3+ yrs Healthcare IT projects
• 5+ yrs in programing language any (Python, Java, Scala, Spark)
• Hands on experience in writing advanced SQL queries, familiarity with variety of database
• Experience in building and optimizing 'Big-Data' pipelines, architecture, and data sets
• Tools: - Big-Data, Spark, Python, Scala
• Cloud platform: - AWS S3, Snowflake
• Experience in Hadoop file formats like ORC, Avro, Parquet, CSV
• Hands on experience in migrating Hadoop on-prem to cloud/AWS
• Experience in analyzing data using 'Big-Data' platform, AWS and Snowflake
• Strong Analytical skills in relating multiple data sets and identify patterns
• Experience in NoSQL databases like MongoDB and Cassandra
• Visualize data sets using Power BI or Tableau

• Kafka streaming and Shell scripting
• Scheduling tools like Control-M, Oozie
• NoSQL databases like MongoDB
• Implement Python flex APIs to share data insights to digital systems