Senior Data Engineer

About the role

Are you an engineer with a passion for big data? Do you keep up to date with cutting-edge technologies within D&A?

If so, then you have a fantastic opportunity to join a multi-disciplinary team of engineers, architects, designers, and strategists as we continue to grow our Data & Analytics practice across Europe.
We're looking for a Senior Data Engineer with Azure, Databricks and PySpark to join our team in London.
A willingness to travel into office or client site a few times per week is required.

Responsibilities

• Build and maintain data pipelines and data platform solutions in public clouds like Azure , AWS, or GCP
• Develop data pipelines and migration of data from on-premise to public clouds and building components for central enterprise data platforms
• Collaborate with data scientists and analysts to ensure data accessibility and readiness for analysis
• Monitor data performance and modify infrastructure as needed
• Establish data operations best practices
• Design and implement the new business requirements
• Share knowledge and act as a mentor

• At least 4 years experience in a data engineering position or similar engineering role
• Strong experience working within Azure cloud services (ADLS 2, ADF, Azure KeyVault, etc.) and environment
• Strong experience working with Databricks
• Strong experience working with PySpark
• Experience working in an agile environment

• Hands-on experience with Scala for Apache Spark
• Knowledge or experience working with other Clouds such as AWS or GCP

• A competitive group pension plan and protection benefits including life assurance, income protection and critical illness cover
• Private medical insurance and dental care
• Cyclescheme, Techscheme and season ticket loans
• Employee assistance program
• Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications, well-being programs, LinkedIn Learning Solutions and much more
• EPAM Employee Stock Purchase Plan (ESPP)
• Various perks such as gym discounts, free Wednesday lunch in-office, on-site massages and regular social events
• Certain benefits and perks may be subject to eligibility requirements and may be available only after you have passed your probationary period

• EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential