Data Engineer II

Your role will involve creating high-performance algorithms, cutting-edge analytical techniques, and intuitive workflows to help users derive actionable insights from big data. You will work with large-scale data sets and front-end visualizations to unlock the value of big data and support business needs through innovative data-driven solutions.

Role:
1.Drive the evolution of data and services platforms with a strong emphasis on data engineering and data science, ensuring impactful advancements in data quality, scalability, and efficiency.
2.Develop and fine-tune methods and algorithms to generate precise, high-quality data at scale, including the creation and maintenance of feature stores, analytical stores and curated datasets for enhanced data integrity and usability.
3.Solve complex data challenges involving multi-layered data sets and optimize the performance of existing data pipelines, libraries, and frameworks.
4.Provide support for deployed data applications and analytical models, identifying data issues and guiding resolutions.
5.Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.
6.Integrate diverse data sources, including real-time, streaming, batch, and API-based data, to enrich platform insights and drive data-driven decision-making.
7.Experiment with new tools to streamline the development, testing, deployment, and running of our data pipelines.
8.Develop and enforce best practices for data engineering, including coding standards, code reviews, and documentation.
9.Ensure data security and privacy compliance, implementing measures to protect sensitive data.
10.Communicate, collaborate and work effectively in a global environment.

All About You:
1.Bachelor's degree in Computer Science, Software Engineering, or a related field
2.Extensive hands-on experience in Data Engineering, including implementing multiple end-to-end data warehouse projects in Big Data environments.
3.Proficiency in application development frameworks (Python, Java/Scala) and data processing/storage frameworks (Hadoop, Spark, Kafka).
4.Experience in developing data orchestration workflows using tools such as Apache NiFi, Apache Airflow, or similar platforms to automate and streamline data pipelines.
5.Experience with performance tuning of database schemas, databases, SQL, ETL jobs, and related scripts.
6.Experience of working in Agile teams
7.Experience in development of data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale using Java, Scala, or Python. This includes all phases such as data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting analytics.
8.Experience in developing integrated cloud applications with services like Azure, Databricks, AWS or GCP.
9.Excellent analytical and problem-solving skills, with the ability to analyze complex data issues and develop practical solutions.
10.Strong communication and interpersonal skills, with the ability to collaborate effectively with and facilitate activities across cross-functional teams, geographically distributed, and stakeholders.

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard's security policies and practices;
• Ensure the confidentiality and integrity of the information being accessed;
• Report any suspected information security violation or breach, and
• Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.