Lead Big Data Engineer

DESCRIPTION

You are curious, persistent, logical and clever - a true techie at heart. You enjoy living by the code of your craft and developing elegant solutions for complex problems. If this sounds like you, this could be the perfect opportunity to join EPAM as a Lead Big Data Software Engineer. Scroll down to learn more about the position's responsibilities and requirements.
#REF_LV_RDS

What You'll Do

• Lead, design and implement innovative analytical solutions using Big Data related technologies, evaluating new features and architecture in Cloud, on premise & Hybrid solutions
• Work with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
• Build collaborative partnerships with architects and key individuals within other functional groups
• Perform detailed analysis of business problems and technical environments and use this in designing quality technical solutions
• Actively participate in code review and test solutions to ensure it meets best practice specifications
• Build and foster a high-performance engineering culture, mentor team members and provide team with the tools and motivation
• Write project documentation

• Advanced experience in software development with Big Data technologies (administration, configuration management, monitoring and performance tuning)
• Experience in designing, automation, provisioning, deploying and administering scalable, available and fault tolerant cloud systems
• Advanced knowledge of cloud-based data pipeline development
• Experience With Cloud Service Lines:
  • AWS: AWS Glue, EMR, S3, Redshift, Kinesis, Databricks, AWS Lake Formation
  • Azure: Data Lake, Databricks, Synapse, Data Factory
  • GCP: DataFlow, GCS, BigQuery, Dataproc, Cloud Composer
• Extensive experience with any object-oriented/object function scripting language: Python, Java, Node.js
• Extensive experience with Big Data Stacks such as Spark & Spark Streaming
• Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), Data Warehouse or Database architecture
• Experience with data modeling; hands-on development experience with modern Big Data components
• Good understanding of CI/CD principles and best practices
• Exposure working with Snowflake
• Analytical approach to problem-solving with an ability to work at an abstract level and gain consensus; excellent interpersonal, leadership and communication skills
• Experience in direct customer communications
• Experience in technology/team leading of data-oriented projects
• Advanced understanding of distributed computing principles

• Salary range 4500-6200 EUR gross, based on your experience and interview results
• Innovative solutions delivery to the world's industry leaders
• Outstanding career development roadmap to accelerate your journey
• Engineering community of 61,600+ industry's top professionals
• Certification and mentoring programs, trainings, and unlimited access to LinkedIn Learning
• Regular assessments and salary reviews
• Bonuses for participating in the referral program
• Flexible schedule and opportunity to work remotely from any place in Latvia
• Relocation within offices in 45+ countries with throughout support for you and your family
• High-quality medical services in terms of corporate health insurance