Big Data Platform Engineer

At Pandora, we're a unique collection of engineers, musicians, designers, marketers, and world-class sellers with a common goal: to enrich lives by delivering effortless personalized music enjoyment and discovery. People—the listeners, the artists, and our employees—are at the center of our mission and everything we do. Actually, employees at Pandora are a lot like the service itself: bright, eclectic, and innovative. Collaboration is the foundation of our workforce, and we’re looking for smart individuals who are self-motivated and passionate to join us. Be a part of the engine that creates the soundtrack to life. Discover your future at Pandora!

We've built a complex analytics system around Hadoop, Hive, Spark, & Presto for scalability and high availability. It's imperative that you approach administration with an emphasis on repeatability, testability and consistency. The demands on this system are increasing rapidly as we grow the user base and add more functionality. We're looking for someone who has a deep understanding of hardware and understands how to tune systems appropriately based on a particular architecture.

The ideal candidate will have significant experience in Software Development as well as operations. You will be expected to come up to speed quickly on difficult problems, become a significant contributor to a hard-working team, and to take pride in your work. We are looking to hire a team player with a positive attitude and excellent communication and interpersonal skills. 

Role Overview:

  • Proactive health monitoring, troubleshooting and problem resolution of Pandora's Hadoop Clusters
  • Day-to-day operational support with a 24x7 on-call rotation
  • Assist end users and application developers with issues or addressing inefficiencies using the Hadoop Cluster
  • DevOps platform deployment automation with an emphasis on site reliability
  • Configuration of Hadoop, Hive, and Spark as Pandora does not use a cluster management tool such as Ambari
  • Configure backups/replication to support Business Continuity
  • Upgrades of massive Hadoop Clusters with minimal down time
  • Support in-house tools related to the use of Big Data Platforms
  • Assist with Proof of Concept projects to validate Big Data/Messaging technology new to Pandora
  • Stay current with advancements in the Big Data space 


Requirements:

  • 3-5 Years experience Hadoop administration
  • Deep Understanding of HDFS architecture and operations
  • Deep Understanding of YARN and Application Scheduling (i.e. Capacity Scheduler)
  • Understanding of Map/Reduce principles on Hadoop
  • Experience supporting Hive, Spark, and Sqoop
  • Experience maintaining large clusters (>2PB or >200 Datanodes)
  • Demonstrated proficiency with languages such as Python and Bash
  • Deep understanding of Linux administration and tuning
  • Ability to use OS and Network metrics to identify bottlenecks
  • Excellent SQL skills 

 

Preferred Qualifications:

  • Java Development leveraging APIs in the Hadoop Distro
  • Experience with JVM and Garbage Collection tuning
  • Experience with the Hortonworks HDP Distro
  • Experience working in a secured Hadoop Cluster environment leveraging network access restrictions and Kerberos
  • Experience using Ansible for configuration management and automation of tasks
  • Experience with Apache Kafka, Spark, Sqoop, Hive, Pig, and Presto DB
  • Experience with the setup and administration of HiveServer2
  • Past experience with running Hadoop in AWS is a bonus

Meet Some of Pandora's Employees

Mike O.

VP, Head of Music Maker Strategy & Operations

In his role, Mike is focused on opening up Pandora to music makers and helping artists maximize their use of the platform with content and live events.

Maira B.

Director Of Engineering

Maira likes to say she manages the heart of Pandora, as she is responsible for leading the team of engineers that produces the algorithms that create the sequence of music listeners hear.


Back to top