Role - Lead Consultant
Technology - Azure Data Platform Services,SQL (T-SQL), Python, and scripting (PowerShell/Azure CLI) & ETL/ELT
Location - Amsterdam, Netherlands.
Business Unit - DX
Compensation - Competitive (including bonus)
Job Description
We are seeking a highly experienced and technically proficient Lead/Senior Data Engineer with experience in building, optimizing, and managing robust data solutions on Microsoft Azure. The ideal candidate will be a hands-on expert in Azure Data Platform services, possess deep knowledge of SQL (T-SQL), Python, and scripting (PowerShell/Azure CLI), and have a strong grasp of ETL/ELT concepts. This role requires a professional who can lead data initiatives, ensure data quality and governance, and demonstrate exposure to Generative AI concepts for future-proofing data strategies.
Want more jobs like this?
Get jobs in Amsterdam, Netherlands delivered to your inbox every week.
Your role
In the role of an Azure Data Engineer, you will serve to facilitate the design, implementation, and maintenance of scalable and robust data solutions within the Microsoft Azure ecosystem. You should be committed to data engineering best practices, cloud principles, and efficient data pipeline development-but should also remain flexible and open to opportunities for continuous improvement and leveraging emerging Azure data technologies.
Anchor the engagement effort for assignments, all the way from data source identification and problem definition to solution design, development, and deployment of data pipelines and warehouses. You will be pivotal to problem definition and discovery of the overall data solution, guiding teams on data ingestion strategies, transformation processes, and data quality. As a thought leader in your domain, you will be the key advisor to data architecture and design reviews. You will anchor business pursuit initiatives, client training, and in-house capability building related to Azure data services. You will have the opportunity to shape value-adding data solutions that enable our clients to meet the changing needs of the global data landscape.
Responsibilities .
- Azure Data Platform Expertise: Design, develop, deploy, and manage scalable and secure data solutions using a wide range of Azure Data Platform services, including but not limited to:
- Azure Data Lake Storage (ADLS Gen2)
- Azure Databricks
- Azure Synapse Analytics (SQL Pool, Spark Pool, Pipelines)
- Azure Data Factory (ADF)
- Azure SQL Database / Azure SQL Managed Instance
- Azure Stream Analytics (optional, depending on real-time needs)
- Azure Cosmos DB (optional, depending on NoSQL needs)
- Azure Event Hubs / IoT Hub (optional, depending on streaming needs)
- Exposure/Knowledge in ECM Tools.
- Data Pipeline Development (ETL/ELT): Lead the design, development, and optimization of complex ETL/ELT pipelines for data ingestion, transformation, and loading from diverse sources into Azure. Implement robust data orchestration, scheduling, and monitoring.
- SQL Development: Develop, optimize, and tune complex T-SQL queries, stored procedures, functions, and views for high-performance data processing and reporting within Azure SQL environments.
- Python Programming: Utilize Python extensively for data manipulation, analysis, scripting, API integrations, and developing custom data processing logic within Azure Databricks or other compute environments.
- Scripting & Automation: Automate data processes, deployments, and infrastructure management using PowerShell and Azure CLI. Develop and maintain CI/CD pipelines for data solutions.
- Data Governance & Quality: Champion data governance best practices. Implement and enforce data quality frameworks, establish data lineage, define data dictionaries, and ensure the accuracy, consistency, and reliability of data across the data platform.
- Performance Optimization & Tuning: Proactively identify and resolve performance bottlenecks within the Azure data ecosystem. Optimize data storage, compute, and query performance.
- Architectural Contributions: Contribute significantly to the architectural design and roadmap of enterprise-level data solutions on Azure. Provide technical leadership and guidance to junior team members.
- Troubleshooting & Support: Provide expert-level support for data-related issues, perform root cause analysis, and implement effective solutions.
- Stakeholder Collaboration: Work closely with data architects, data scientists, business analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Documentation: Create and maintain comprehensive technical documentation, including data models, data flows, and solution designs.
- Generative AI Exposure: Demonstrate an understanding of Generative AI concepts and their potential applications in data engineering, such as synthetic data generation, intelligent data cataloging, or enhanced data quality checks. Be keen to explore and integrate Gen AI capabilities into future data initiatives.
- Mentorship & Leadership: Mentor and guide junior data engineers, fostering a culture of continuous learning and technical excellence. Lead technical discussions and provide thought leadership.
- Should have minimum 10 years of experience as Azure Data Engineer
- Should have excellent Verbal and Written Communication Skills.
- Should be excellent planner when it comes to perform release planning and other delivery planning.
- Should have excellent problem-solving skills
- Responsible for Coaching and mentoring team members
- Good to have experience in leading Frontend Web Development - Angular, react and Backend (Java , node Js) team.
- Nice to have experience with HTML, CSS, Java etc.
- Nice to have understanding of RESTful APIs and how to use them (experience with GraphQL is a plus)
Besides the professional qualifications of the candidates we place great importance in addition to various forms personality profile. These include:
- High analytical skills
- High customer orientation
- High quality awareness
- Excellent verbal and written communication skills
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
Infosys is an equal opportunity employer and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.