Senior Spark Data Engineer

Position Overview

You will work in Global Data & Analytics organization that is responsible for designing, building, and maintaining cloud-based (Azure) analytics products for that directly impacts Coca-Cola's business growth globally with an emphasis on continuous learning. Our development teams embrace agile principles to quickly generate value for our stakeholders. We have the freedom to try new ideas, experiment and are expected to be constantly learning and growing. There is also a strong emphasis on mentoring others in the group, enabling them to grow and learn.

Relocation and Work Sponsorship will not be available.

What You'll Do for Us

• Lead end to end design and development of the data solutions.
• Provide guidance, mentorship, and technical expertise to the team members on the spark compute-based data engineering projects.
• Develop data pipelines to ingest and transform data using Scala and SQL on Spark.
• Setup orchestration of the pipelines using Azure Synapse pipeline.
• Source and version control code/configuration artifacts using GitHub.
• Create GitHub actions to deploy code/configuration artifacts.
• Create tables/views (using SQL) in Synapse for reporting/visualization.
• Investigate and remediate data pipeline errors or performance issues.

• Bachelor's degree or higher in Computer Science or a related field.
• 5+ years of experience in developing code on JVM (Java or Scala preferred).
• 5+ years of Spark experience in data engineering.

• Proficient in at least one of the programming languages like Scala, Python, and Java.
• Knowledge of source code repository like GIT/Azure Repos & build tools like Maven.
• Familiarly with agile development practices.

• Deep understanding of distributed computing (Spark), cloud architecture and SQL.
• Experience working with public clouds like Azure, AWS, Google etc.
• Personal qualities such as creativity, tenacity, curiosity, and passion for deep technical excellence.