Software Engineer, Big Data Platform

We're looking for a seasoned Big Data engineer to help us build and scale the next generation of big data platform and infrastructure at Pinterest. You'll be working on some of the most exciting big data open source technologies (Hadoop, Hive, Spark, Presto, etc.) in the world on hundreds of petabytes data to help hundreds of millions of people discover and do what they love.

What you'll do:

  • Build and scale batch, micro-batch, and stream processing platforms using the latest open-source technologies to process petabytes-scale datasets
  • Build and scale systems that orchestrate and execute complex workflows in big-data pipelines
  • Provide reliable, performant SQL-like big data query engines as services to enable ETL, analytics and insights
  • Contribute to the team's technical vision and long-term roadmap
  • Provide thought leadership to the entire Data org on how data should be stored and processed more efficiently, reliably, and quickly at scale

What we're looking for:

  • 5+ years of experience on open-source Big Data technologies
  • Experience of building scalable infrastructure to support batch, micro-batch or stream data processing to process petabytes of data
  • Experience with Hadoop, Spark, Hive, Presto, SQL, Kafka, Parquet, and HDFS
  • Proficiency in multiple systems languages (Java, Scala, Python)
  • AWS experience a plus

#LI-VW1


Back to top