Data Engineer - Graph

Title And Summary

Data Engineer

Role Overview
We are looking for a skilled Data Engineer to join our growing data engineering team. In this role, you will be responsible for designing, building, and optimizing robust, scalable data pipelines and infrastructure to support advanced analytics, reporting, and decision-making across the organization.
You will take ownership of complex data projects, contribute to architectural decisions, and mentor junior engineers. This role requires deep technical expertise in big data technologies, strong problem-solving abilities, and a collaborative mindset to work cross-functionally with data scientists, analysts, and engineers.

Key Responsibilities
• Develop, and maintain scalable and reliable data pipelines for batch and streaming data.
• Collaborate with cross-functional teams to translate data requirements into technical solutions.
• Ensure data integrity and quality through testing, validation, and continuous monitoring.
• Implement and enforce data governance, privacy, and security best practices.
• Evaluate and integrate modern tools and technologies to enhance the data ecosystem.
• Participate in code reviews and contribute to engineering best practices and process improvements.
• Manage production incidents, perform root cause analysis, and implement mitigation plans.

Essential Skills & Experience
• 3+ years of hands-on experience in data engineering with expertise in big data technologies such as Hadoop, Apache Spark, Spark SQL, Kafka, NiFi, and ETL frameworks.
• Strong experience with databases such as Oracle and Netezza; excellent SQL skills.
• Experience developing scalable streaming solutions using the Hadoop ecosystem (HDFS, Ozone, Hive/Impala).
• Proficient in building data pipelines using Git, Shell scripting, Java or Python on Hadoop or object storage systems (S3/CEPH).
• Demonstrated experience in delivering end-to-end data warehouse projects in big data environments.
• Strong analytical and debugging skills with demonstrated ability to resolve production issues independently.
• Excellent communication skills, with a collaborative approach to working across teams.

Preferred Qualifications
• Experience with AI/ML workloads using Python on Hadoop platforms is a plus.
• Familiarity with tools like NiFi, APIs, Unix/Linux environments.
• Exposure to Agile methodologies and experience working in Agile teams.
• Experience with microservices architecture, messaging systems (e.g., Kafka, RabbitMQ).
• Hands-on knowledge of containerization and orchestration tools like Docker and Kubernetes.
• Deep understanding of data security, compliance, and governance frameworks.
• Ability to work on multiple projects simultaneously, providing guidance and technical oversight.
• Proactive, self-motivated, and able to operate effectively under pressure in a fast-paced environment.
• A strong sense of ownership with a proven track record of delivering high-impact solutions.
Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard's security policies and practices.
• Ensure the confidentiality and integrity of the information being accessed.
• Report any suspected information security violation or breach, and
• Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard's security policies and practices;
• Ensure the confidentiality and integrity of the information being accessed;
• Report any suspected information security violation or breach, and
• Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.