Lead Big Data Engineer

We are seeking a highly skilled Lead Big Data Engineer to lead the design and implementation of innovative analytical solutions using cutting-edge Big Data technologies.

As a key team member, you will assess new features and architectures across Cloud, on-premise, and Hybrid solutions and closely cooperate with product and engineering teams.

The remote option applies only to the Candidates who will be working from any location in Kazakhstan.

What You'll Do

• Lead and implement innovative analytical solutions using Big Data related technologies, evaluating new features and architecture in Cloud, on premise & Hybrid solutions
• Collaborate with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
• Establish collaborative partnerships with architects and key individuals across various functional groups
• Perform detailed analysis of business problems and technical environments to design quality technical solutions
• Actively participate in code reviews and test solutions for best practice compliance
• Cultivate a high-performance engineering culture, mentor team, and provide necessary tools and motivation
• Write project documentation

• Advanced experience in software development with Big Data (administration, configuration management, monitoring and performance tuning)
• Skills in designing, automating and managing scalable, fault-tolerant cloud systems
• Advanced knowledge of Cloud-based data pipeline development
• Experience With Cloud Service Lines:
  • AWS: AWS Glue, EMR, S3, Redshift, Kinesis, Databricks, AWS Lake Formation
  • Azure: Data Lake, Databricks, Synapse, Data Factory
  • GCP: DataFlow, GCS, BigQuery, Dataproc, Cloud Composer
• Competency in any object-oriented/object function scripting language: Python, Java, Node.js
• Background in Big Data Stacks such as Spark & Spark Streaming
• Strong knowledge of building data ingestion pipelines (simulating Extract, Transform, Load workload), Data Warehouse or Database architecture
• Expert knowledge of data modeling and modern Big Data component development
• Understanding of CI/CD principles and best practices
• Exposure working with Snowflake
• Proficiency in direct customer communications
• Expertise in technology/team leading of data-oriented projects
• In-depth comprehension of distributed computing principles

• We connect like-minded people::
  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 50+ countries
  • Corporate and social events
• We invest in your growth::
  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru
  • Free English classes with certified teachers

  • Discounts in local language schools, including online courses for the Kazakh language
• We cover it all::
  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Six trust days per year (sick leave without a medical certificate)
  • Coverage of psychology sessions of your choice
  • Discounts for fitness clubs and sports programs
  • Benefits package (hotels, tech stores, food delivery)

• EPAM Kazakhstan is a team of technologists and innovators united by a passion for technology. Today, we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. In 2023, EPAM Kazakhstan received the Export Excellence Award at the esteemed Digital Bridge Awards, showcasing our commitment to excellence and innovation