Software Engineer, Big Data Platform

We're looking for a seasoned Big Data engineer to help us build and scale the next generation of big data platform and infrastructure at Pinterest. You'll be working on some of the most exciting big data open source technologies (Hadoop, Hive, Spark, Presto, etc.) in the world on hundreds of petabytes data to help hundreds of millions of people discover and do what they love.

What you'll do:

  • Build and scale batch, micro-batch, and stream processing platforms using the latest open-source technologies to process petabytes-scale datasets
  • Build and scale systems that orchestrate and execute complex workflows in big-data pipelines
  • Provide reliable, performant SQL-like big data query engines as services to enable ETL, analytics and insights
  • Contribute to the team's technical vision and long-term roadmap
  • Provide thought leadership to the entire Data org on how data should be stored and processed more efficiently, reliably, and quickly at scale

What we're looking for:

  • 5+ years of experience on open-source Big Data technologies
  • Experience of building scalable infrastructure to support batch, micro-batch or stream data processing to process petabytes of data
  • Experience with Hadoop, Spark, Hive, Presto, SQL, Kafka, Parquet, and HDFS
  • Proficiency in multiple systems languages (Java, Scala, Python)
  • AWS experience a plus

#LI-VW1


See Inside the Office of Pinterest

Pinterest’s mission is to help people discover and do what they love. Using Pinterest makes people feel more inspired, optimistic, and creative—that’s why it’s one of the world’s most beloved brands, with over 200 million monthly active Pinners. Pinterest is a place where people are encouraged to be themselves, and employees who work there are able to spark their creativity, try new things, and build their confidence as a leader, thinker, and doer.


Back to top