Software Engineer, Data Infrastructure

At Lyft, community is what we are and it’s what we do. It’s what makes us different. To create the best ride for all, we start in our own community by creating an open, inclusive, and diverse organization where all team members are recognized for what they bring.

From day one, Lyft’s mission has been to improve people’s lives with the world’s best transportation. And self-driving cars are critical to that mission: they can make our streets safer, cities greener, and traffic a thing of the past. That’s why we started Level 5, our self-driving division, where we’re building a self-driving system to operate on the Lyft network. 
 
Level 5 is looking for doers and creative problem solvers to join us in developing the leading self-driving system for ridesharing. Our team members come from diverse backgrounds and areas of expertise, and each has the opportunity to have an outsized influence on the future of our technology. Our world-class software and hardware experts work in brand new garages and labs in Palo Alto, California, and offices in London, England and Munich, Germany. And we’re moving at an incredible pace: we’re currently servicing employee rides in our test vehicles on the Lyft app. Learn more at lyft.com/level5

The Data Infrastructure team is responsible for building a massive-scale data ingestion and processing platform. Each Autonomous Vehicle (AV) is equipped with dozens of sensors (Lidars, Radars, HD cameras, etc.). Single AV produces data at rate that is comparable to all of Twitter users combined; the platforms we build need to be able to process Petabytes of Autonomous-Vehicle data daily. If you are excited about joining a team of talented engineers working on cutting-edge problems, join us! Some of the challenges the team deals with are:

  • Architecting fault tolerant and self-healing distributed systems
  • Re-building our data storage and indexing pipelines to support multiple orders of growth
  • Designing solid APIs to serve data for downstream applications (REST, gRPC, streaming)
  • Supporting ML and manual labeling workflows

Responsibilities:


  • Design and implement reliable, scalable, and performant distributed systems and data pipelines

  • Provide observability into the systems health and execution flow, build tools and dashboards for monitoring and improving efficiency

  • Design and operate compute platform processing PB/day

  • Educate, and evangelize best data-processing practices across the entire Autonomous Vehicles organization


Experience & Skills:

  • Excellent Software Engineering and Computer Science fundamentals. It usually comes with Bachelors or higher degree in CS, or 3+ years of experience in top-performing teams (ideally both)

  • Extensive programming experience, especially in Java, Python, and/or C++ (Rust, Go is a plus)

  • Ability to work effectively with a diverse team of talented engineers

  • Experience building REST or gRPC services

  • Understanding of containerization, including Docker and Kubernetes

  • Experience with ELK and Grafana (Stackdriver is a plus)


Nice To Have:

  • Experience with various data-store technologies (e.g. DynamoDB, Elasticsearch, Spanner, BigQuery), distributed messaging platforms (e.g. Kafka, Kinesis), or data processing frameworks (e.g. Spark, Flink, Beam)

  • Extensive experience with AWS or GCP

  • Familiarly with infrastructure management tools, like Terraform or Salt


Lyft is an Equal Employment Opportunity employer that proudly pursues and hires a diverse workforce. Lyft does not make hiring or employment decisions on the basis of race, color, religion or religious belief, ethnic or national origin, nationality, sex, gender, gender-identity, sexual orientation, disability, age, military or veteran status, or any other basis protected by applicable local, state, or federal laws or prohibited by Company policy.  Lyft also strives for a healthy and safe workplace and strictly prohibits harassment of any kind. Pursuant to the San Francisco Fair Chance Ordinance and other similar state laws and local ordinances, Lyft will also consider for employment qualified applicants with arrest and conviction records.


 


Back to top