Responsibilities
About the Team
The Data Management Suite team is building products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These products support various businesses, so data engineers and data scientists could greatly boost their productivity.
As a software engineer in the data management suite team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on core systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.
Want more jobs like this?
Get Software Engineering jobs in Singapore delivered to your inbox every week.
Responsibilities:
Be responsible for the production stability for big data development and governance systems;
Engage in and improve the whole lifecycle of service, from inception and design, through to deployment, operation and refinement;
Maintain services once they are live by measuring and monitoring availability, latency and overall system health. Practice sustainable incident response and blameless postmortems;
Establish best engineering practice for engineers as well as non-technical people;
Design and implement reliable, scalable, robust and extensible big data systems that support core products and business;
Qualifications
Minimum Qualifications
Bachelor's degree in Computer Science, a related technical field involving software or systems engineering, or equivalent practical experience
Experience with site reliability engineering, monitoring, alerting for big data related systems
Experience writing code in Java, Go, Python or a similar language
Preferred Qualifications
Knowledge about a variety of strategies for ingesting, modeling, processing, and persisting data, ETL design, job scheduling and dimensional modeling;
Familiarity with running production grade services at scale and understanding cloud native technologies and networking;
Experience developing tools and APIs to reduce human interaction with systems and applications using a variety of coding and scripting standards;
Expertise in designing, analyzing, and troubleshooting large-scale distributed systems is a plus (Hadoop, M/R, Hive, Spark, Presto, Flume, Kafka, ClickHouse, Flink or comparable solutions);
Systematic problem-solving approach, coupled with effective communication skills and a sense of drive;