Platform Engineer, Hadoop

Fully Remote - Platform Engineer, Hadoop - Pre IPOThis Jobot Job is hosted by: Nicole EricksonAre you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume.Salary: $150,000 - $170,000 per year

A bit about us:We're a privately held, well funded, fast growing, Pre-IPO internet / search / news company that's currently disrupting the industry. No one else is working on a product like ours which is helping millions of consumers around the world!

Why join us?

• Fully remote, work from anywhere
• Work with cutting edge technologies such as NLP (natural language processing), ML (machine learning), AI (artificial intelligence) and Search technology
• Soon closing on our Series B
• Highly competitive salary
• Full benefits
• Bonus
• Equity
• 401k with company match
• Medical, Dental, Vision, Life Insurance, Disability
• 14 paid holidays
• Unlimited PTO (encouraged, take it when you need it)
• and more!

Job DetailsWho you are:We're looking to bridge the gap between Infrastructure and DevOps. You have the skillset of an infrastructure engineer with a DevOps mindset. You have strong on-prem experience, you're knowledgeable with bare metal, and you have experience with systems engineering in your past. You have at minimum 3 years of proven experience planning, deploying, validating, and operating Hadoop clusters of various sizes. You have experience deploying and operating stream processing systems such as Samza, Spark or Flink, including deploying and scaling them within Kubernetes. You have proven experience with Linux system administration including systems provisioning, management, and configuration tools such as Puppet, Terraform or Ansible. The role:As a member of the Platforms Team, you will be focused on the installation, expansion, and performance of Hadoop systems used by our advanced Machine Learning and Software Engineering teams. You will be building and operating Hadoop clusters on bare metal to power our stream processing and storage systems. You will be supported by the infrastructure team to assist with bare metal deployment and physical network configuration. For deployed systems you will ensure system performance, scalability, reliability, security, and monitoring. You will work closely with the Software Engineering and Machine Learning teams to ensure ease of deployment of stream processing jobs operating on top of the Hadoop data. We do not work in a silo! There is plenty of exposure and growth opportunity with other related stack technologies including Aerospike, Kafka and Graph databases.Must Haves:

• Minimum 3 years working with Hadoop
• Experience planning, deploying, validating, and operating Hadoop clusters of various sizes.
• Proven experience with bare-metal deployments
• Experience deploying and operating stream processing systems such as Samza, Spark or Flink, including deploying and scaling them within Kubernetes
• Proven experience with Linux system administration including systems provisioning, management, and configuration tools such as Puppet, Terraform or Ansible
• Solid foundation of basic network configuration

Nice to Haves:

• Experience with Aerospike, NoSQL systems, Elasticsearch, Kafka
• Programming languages such as Java or Scala

Interested in hearing more? Easy Apply now by clicking the "Apply Now" button.