Software Development Manager - Managed Apache Flink

1 month agoCambridge, United Kingdom


Come and build the future with us as we change the way the world processes & analyzes real-time streaming data at never before seen scale. The Amazon Web Services (AWS) Kinesis Data Analytics (KDA) team is looking for engineering leaders who are looking to work on Apache Flink engine, distributed stateful stream processing engine.

Real-time data processing from a stream has historically required substantial investments from customers in writing the application and maintaining the necessary infrastructure. Our team's service provides customers with a fully managed stream processing platform where customers can develop their applications using Java, SQL, Scala.

With KDA, customers need only program the business logic and our service takes care of the rest; setting up Apache Flink clusters, ensuring availability, setting up backend for state and checkpoints, etc. We are committed to delivering a simple, enjoyable, and serverless stream processing experience for our customers!

Responsibilities of a Software Development Manager include:
• Hiring and developing your team. A successful service starts with a great team, and delivering through others is your primary responsibility.
• Defining and executing on a roadmap for your service. You'll know and talk with your customers on a regular basis, as well as using data and metrics to understand how your service is used, and build and deliver on a roadmap that delights them.
• Making the operation of your service safe and sustainable. Leaders in AWS know the details of their service and prioritise the right improvements to keep things running smoothly.
• Project ownership. You'll drive execution of projects within your team and work with your peers to keep everyone aligned. You'll clearly and transparently communicate status to leadership and get help where needed to keep your team unblocked.
• Contributing to the overall AWS Streaming Services Cambridge leadership team. You'll be part of defining our culture, ensuring our teams have everything they need to be productive and excited to work at AWS, and helping to drive site-wide initiatives that improve life for all our teams.

Building a High-Performing & Inclusive Team Culture
You should be passionate about attracting & developing a world-class team that welcomes, celebrates, and leverages a diverse set of backgrounds and skill-sets to deliver results. Driving results through others is your primary responsibility, and doing so in a way that builds on our inclusive culture is key to our long term success.

Work/Life Balance
KDA is family-oriented and values work-life balance. Most days, our entire team is co-located in the Cambridge office, but we're also flexible when people occasionally need to work from home. We generally keep core in-office hours from 10am to 4pm. About half of us come in earlier and the other half of us stay later. We are builder-operators of our services at AWS and have a modest on-call rotation where you'll participate once every 2-3 months.

Energizing and Interesting Technical Problems
You will be working on enabling your team to build and operate an open source stream processing engine, Apache Flink, to make KDA the defacto service to run stream processing applications. Up-stream changes are a key investment in this space, so this is a truly unique role where you'll get to partner closely with a vibrant open source community to define the features and roadmap of the service. It's humbling and energizing to integrate the latest open-source technologies with AWS scale.

Mentorship & Career Growth
We're committed to the growth and development of every member of KDA, and that includes our Development Managers. You will have the opportunity to contribute to the culture and direction of the entire Kinesis org and deliver site-wide initiatives that will improve the life of all of our teams.

You will be joining the team at a very exciting time with a lot of growth in front of us as we make stream processing mainstream.


• Bachelor's degree in Computer Science or similar, or comparable years of experience
• Several years experience of building, retaining, and managing high performing diverse and inclusive teams of engineers
• Proven skills in designing and developing solutions to complex problems in a large scale enterprise environment
• A track record of delivery for large, cross-functional projects, including building roadmaps to meet organizational business goals on time


• A track record of communicating well with executives and non-technical leaders
• Experience with big-data technologies such as Apache Flink, Apache Spark, Map-Reduce, etc.
• Experience with big data and massively-scaled distributed computing
• Experience operating cloud scale online services
• MS/PhD Degree in Computer Science
• Excellent written and verbal communication skills with the ability to present complex technical information in a clear and concise manner to a variety of audiences

Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( to know more about how we collect, use and transfer the personal data of our candidates.

All offers are conditional on references, verification of the right to work in the UK, and successful background screening check. This will include previous employment verification, qualification verification (if relevant) and a relevant criminal check.

Job ID: Amazon-1455410