Senior / Lead Data Software Engineer

DESCRIPTION

We are looking for an open-minded Senior / Lead Data Engineer to develop and maintain data-driven architecture. On our projects, we are developing pipelines to build business-related data products and design cloud-based platform solutions to support DataHub functionality.

What You'll Do

• Design and implement data pipelines
• Perform data ingestion processes to include existing data sources in the new platform
• Participate in platform engineering, including cloud-based solutions to support solution architecture, such as Ingestion Frameworks, Platform Orchestrators, Exploratory environments etc
• Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines
• Take part in the design of on-prem to cloud migration activities

• Solid experience in Java, Python or Scala
• Proficiency in SQL
• Understanding of common Big Data problems (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and related technologies (Apache Spark, Map-Reduce, HDFS)
• Acquaintance with data modeling: relational/dimensional data, SCD, snowflaking, etc
• English level - B1+, both written and spoken

• Familiarity with common data-related architectures such as Data-Hub/Data Lake
• Experience in cloud-based solutions, GCP, Terraform, Kubernetes

• Apache Spark, Kubernetes, Hadoop, Cloud Storage (S3, ADLS, GS, etc.), Cloud Functions, Airflow, Apache Kafka, Jenkins, Terraform, Avro, Parquet

• We connect like-minded people:
  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 50+ countries
  • Corporate and social events
• We invest in your growth:
  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru
  • Free English classes with certified teachers

• We cover it all:
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Six trust days per year (sick leave without a medical certificate)
  • Coverage of psychology sessions of your choice
  • Discounts for fitness clubs and sports programs
  • Benefits package (hotels, bookstores, food delivery)

• EPAM Kyrgyzstan is a team of technologists and innovators united by a passion for technology. In 2022, we opened our first office in Bishkek that works with the world's leading companies across many different industries. EPAM builds a continuously learning organization and helps its employees reach their full potential and achieve their professional goals through learning. Our agile methodologies, customer collaboration frameworks, engineering excellence programs, and hybrid teams offer many career paths and development opportunities