Senior Big Data Engineer

Do you have a passion for the ever-evolving beauty industry and a drive to push boundaries?
Join the team of professionals for one of the beauty industry leader! Our customer is not only the best-in-class product and service provider but a pioneer who are constantly seeking new ways to redefine beauty and create unforgettable experiences for its customers.
Their "try then buy" philosophy is exemplified through its in-store beauty stations where customers can test products and receive personalized advice from knowledgeable staff members.
We are looking for an experienced senior developer who will be deeply involved in aggregation of commercial purchases, marketing campaigns, catalog data, etc from various sources into the data lake.

• Architect and maintain our code base for ETL and ELT pipelines, large batch/micro batch processing and streaming systems
• Build out the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using ADF, Spark, Kafka, or similar technologies
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
• For the top management and stakeholders - act as a single point of responsibility over any delivery-related matters, including escalations, upsells, ramp-downs, etc
• Accountable for the technical leadership regarding the delivery. Ensuring a sound and future-proof architecture is planned and the implementation meets the technical quality standards
• Comfortable writing stories and associated acceptance criteria for agile/scrum workflow
• Coordinate between multiple disciplines, stakeholders
• Ensure that projects are delivered in line with our client processes and methodologies; Well-versed in different delivery models, with focus on agile approaches
• Establish a strategy of continuous delivery risk management that enables proactive decisions and actions throughout the delivery life cycle
• Measure and improve delivery productivity
• Serve as a consultant to the Data Engineers in support of quality and timely delivery of work
• Perform production support and deployment activities

• Must have:
  • SQL
  • Spark
  • Scala
• Nice to have:
  • Spark Streaming
  • Azure
• Databricks
• Strong interpersonal and communications skills
• English level - B2+ (It's crucial due to the direct communication with the client)

• Competitive compensation depending on experience and skills
• Individual career path
• Unlimited access to LinkedIn learning solutions
• Sick leave and regular vacation
• English classes with certified English teachers
• Flexible work hours

• EPAM is a leading global provider of digital platform engineering and development services. We are committed to positively impacting our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to learn and grow continuously. You will join a dedicated, creative, and diverse community that will help you discover your fullest potential. EPAM is committed to providing our global team of 53,150+ EPAMers with inspiring careers. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success, and we value collaboration, try always to understand our customers' business, and strive for the highest standards of excellence