Lead Data Software Engineer (Databricks)

We are looking for a Lead Data Software Engineer with experience and knowledge in Databricks and open-minded personality, who can join our friendly environment and become a core contributor to our team of experts.
Do you have background and wide experience in Data engineering and strong knowledge in Databricks? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Lead Data Software Engineer.

#LI-DNI

Responsibilities

• Lead a small team of engineers in creating and maintaining scalable data pipelines and architectures
• Develop and optimize data models and ETL processes utilizing Databricks alongside other technologies
• Implement data quality checks and monitoring frameworks to ensure high data integrity
• Stay abreast with emerging data engineering trends and technologies, advocating for the adoption of new tools when beneficial
• Troubleshoot and resolve data-related issues efficiently
• Conduct code reviews and uphold high standards of code quality
• Foster a collaborative and inclusive environment for the team to grow their skills and expertise
• Interact with clients, managing expectations and delivering high-quality solutions that meet their needs
• Drive innovation by proposing new data strategies and enhancements
• Work collaboratively within an Agile framework to meet project timelines and deliverables

• Hands-on experience with Databricks, including Delta Lake, workflows, Delta Live Tables, deployment, and versioning
• Capability to lead a development team of 2-5 engineers
• Solid understanding of data architectures and proficient in data modeling, building, and optimizing ETL pipelines with Databricks using external orchestrators like Airflow
• Expertise in Spark, using either Scala or PySpark
• Knowledge of the software development lifecycle and Agile frameworks
• Proficiency in cloud-native technologies and familiarity with engineering best practices including containers, unit tests, linting, and code style checks
• Engineering experience in cloud environments with AWS, Azure, or GCP
• Experience focused on big data and performance optimization of data-intensive applications
• Proactive approach with the ability to operate independently
• Excellent client-facing skills and ability to handle ambiguous situations effectively
• Fluent English communication skills at a B2+ level

• Private health insurance
• EPAM Employees Stock Purchase Plan
• 100% paid sick leave
• Referral Program
• Professional certification
• Language courses

• Why Join EPAM
• WORK AND LIFE BALANCE. Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays.
• CONTINUOUS LEARNING CULTURE. Craft your personal Career Development Plan to align with your learning objectives. Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses.
• CLEAR AND DIFFERENT CAREER PATHS. Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager.
• STRONG PROFESSIONAL COMMUNITY. Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends.