SRE Tech Lead (Machine Learning Systems) - TikTok Infrastructure

At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

About the Team
The Machine Learning (ML) System team combines system engineering and the art of machine learning to develop and maintain massively distributed ML training and Inference system/services around the world.

In our team, you'll have the opportunity to build the large scale heterogeneous system integrating with GPU/RDMA/Storage and keep it running stable and reliable, enrich your expertise in coding, performance analysis and distributed system, and be involved in the decision-making process. You'll also be part of a global team with members from the United States, China and Singapore working collaboratively towards unified project direction. We embrace a culture of diversity, intellectual curiosity, openness, and problem-solving. We encourage close collaboration while promoting self-direction.

As a Tech Lead, you are expected to set up necessary processes for efficient execution and advocate good engineering practices. You will also need to regularly communicate with other infrastructure teams and our users.

Responsibilities:
1. Lead a team of engineers who are committed to building and operating scalable and reliable ML systems globally, driving resource utilisation and cost optimisation, formulating relevant specifications and strategies, etc;
2. Mentor and provide technical leadership and guidance to both the team members and project peers;
3. Responsible for the cross functional collaboration with both internal stakeholders, such as Data center team, Network team, Storage team and infrastructure team, and external stakeholders to drive engineering efforts;
4. Stay up-to-date with industry trends and emerging technologies to lead the team's efforts in innovation innovation efforts;
5. Oversee the acquisition and development of software systems in organisational units.
6. Monitor the results and quality of the different software solutions and projects implemented in the organisation.
7. Oversee the development of Proof-of-Concept/ solutions and provide technical expertise on the development of software and platform features, ensuring that appropriate security and risk factors are considered.

Qualifications

1. Bachelor's degree or above, major in Computer Science, computer engineering or related;
2. At least 6 years of professional experience in backend engineering, site reliability engineering, or related fields;
3. Demonstrates strong experience in problem analysis from different perspectives with abilities to propose multiple solutions to resolve problems;
4. Demonstrate ability to organise, implement and deliver large scale projects with efficient cross functional collaboration;
5. Excellent risk analysis and risk management experiences;
6. Possesses a strong sense of responsibility, good learning ability, self-drive, good team spirit

Preferred:
- Experience in large-scale GPU distributed systems and large model training and inference systems

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.