Lead Data Software Engineer

DESCRIPTION

As a Data Software Lead, you will design, develop, and maintain data systems and solutions. You will collaborate with cross-functional teams to ensure data integration, quality, and security.

We are looking for a hands-on and lead data software engineer focused on Azure Data stack (Databricks) to join our growing Data Practice.

Responsibilities

• Lead modern data platforms implementation starting from requirements identification and up to production releases
• Design and develop highly scalable, maintainable and data centric solutions using Azure cloud and Databricks
• Design, create, optimize and maintain EL/ETL/ELT data pipelines and orchestration processes
• Design, create, optimize and maintain data models
• Ensure data quality processes, monitoring and data cleansing
• Contribute to data governance activities
• Collaborate with cross-functional teams to integrate data into various systems and applications
• Drive and facilitate direct communication with project sponsors and business stakeholders

• Azure Data stack experience: Databricks, Data Lakehouse, Delta Lake, ADF, ADLS, Apache Spark, SQL/NoSQL, Key vault
• Strong experience with Python, PySpark
• Strong understanding of data processing design patterns: EL, ETL, ELT, incremental/delta loads and data streaming (optional)
• Strong knowledge of RDBMS, data marts and Lakehouse design concepts
• Ability to support infrastructure, security, network, and data exchange and distribution topics
• Ability to work collaboratively with cross-functional teams
• Excellent problem-solving skills and attention to detail
• Upper-Intermediate level of English, both spoken and written (B2+)

• Competitive compensation depending on experience and skills
• Variety of projects within one company
• Being a part of a project following engineering excellence standards
• Individual career path and professional growth opportunities
• Internal events and communities
• Flexible work hours