Technology Lead - AWS Data Engineer

Infosys is seeking an experienced Data Engineer with 6+ years of experience in building scalable data platforms and ETL pipelines. The ideal candidate should have strong hands-on expertise in AWS Athena, Scala, and Apache Spark, with experience designing and optimizing large-scale data processing solutions in AWS environments. Experience with AWS data lake architectures, performance tuning, and distributed data processing is essential. The requirements align with enterprise data engineering practices found in internal data engineering profiles and job descriptions.

Required Qualifications

• Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
• At least 4 years of Information Technology experience
• Candidate must be located within commuting distance of Burnaby, BC or be willing to relocate to one of these areas. This position may require travel.

• Design, develop, and maintain scalable ETL/ELT pipelines using Scala and Apache Spark.
• Build and optimize data processing workflows for large-scale structured and semi-structured datasets.
• Develop and manage data lake solutions using AWS S3, Athena, Glue, and EMR.
• Optimize Athena queries, partitions, and data storage formats to improve performance and reduce costs.
• Implement data quality checks, validation frameworks, and monitoring solutions.
• Integrate data from multiple sources including databases, APIs, streaming platforms, and flat files.
• Collaborate with Data Architects, Analysts, and Business Stakeholders to deliver data solutions.
• Tune Spark jobs by optimizing joins, partitioning, caching, and shuffle operations.
• Support CI/CD deployments, release management, and production issue resolution.
• Participate in Agile ceremonies, code reviews, and technical design discussions.
• At least 6 years of experience in Data Engineering.
• Strong hands-on experience with AWS Athena.
• Strong development experience in Scala.
• Expertise in Apache Spark (Spark Core, Spark SQL).
• Experience with AWS services such as S3, Glue, EMR, IAM, CloudWatch.
• Strong SQL and data modeling skills.
• Experience building and maintaining ETL/ELT pipelines.
• Good understanding of distributed data processing and performance tuning.
• Experience with Git and CI/CD practices.