Software Engineer, Big Data Platform

We're looking for a seasoned Big Data engineer to help us build and scale the next generation of big data platform and infrastructure at Pinterest. You'll be working on some of the most exciting big data open source technologies (Hadoop, Hive, Spark, Presto, etc.) in the world on hundreds of petabytes data to help hundreds of millions of people discover and do what they love.

What you'll do:

  • Build and scale batch, micro-batch, and stream processing platforms using the latest open-source technologies to process petabytes-scale datasets
  • Build and scale systems that orchestrate and execute complex workflows in big-data pipelines
  • Provide reliable, performant SQL-like big data query engines as services to enable ETL, analytics and insights
  • Contribute to the team's technical vision and long-term roadmap
  • Provide thought leadership to the entire Data org on how data should be stored and processed more efficiently, reliably, and quickly at scale

What we're looking for:

  • 5+ years of experience on open-source Big Data technologies
  • Experience of building scalable infrastructure to support batch, micro-batch or stream data processing to process petabytes of data
  • Experience with Hadoop, Spark, Hive, Presto, SQL, Kafka, Parquet, and HDFS
  • Proficiency in multiple systems languages (Java, Scala, Python)
  • AWS experience a plus

#LI-VW1


Meet Some of Pinterest's Employees

Tracy C.

Back-End Engineer

As a company that relies on a huge collection of images and an elegant user-interface, Pinterest needs engineers like Tracy to write the code that supports it.

Zach H.

Product Designer

As a Pinterest product designer, Zach works to build a coherent interface that doesn't interfere with Pinterest's true “designers”—its users.


Back to top