Data Engineering Manager

Overview

Primary focus would be to design and implement data processing pipelines using Databricks, Spark, Python, and other tools and languages prevalent in the Azure ecosystem ensuring high quality solutions through code reviews, engineering best practices documentation. You will be given the opportunity to own the design/implementation of projects. You will collaborate with product managers, solution architects, engineers, and data scientists to accomplish your tasks.

Responsibilities

• Lead delivery of key Azure Data Lake projects within time and budget
• Drive solution design and build to ensure scalability, performance and reuse of data and other components
• Ensure on time and on budget delivery which satisfies project requirements, while adhering to enterprise architecture standards.
• Oversee coordination and partnerships with Business Relationship Managers, Architecture and IT services teams to develop and maintain data lake best practices and standards along with appropriate quality assurance policies and procedures
• May lead a team of employee and contract resources to meet build requirements:

• Set priorities for the team to ensure task completion
• Coordinate work activities with other IT services and business teams.
• Hold team accountable for milestone deliverables

• The expected compensation range for this position is between $106,400 - $178,100
• Location, confirmed job-related skills, experience, and education will be considered in setting actual starting salary. Your recruiter can share more about the specific salary range during the hiring process
• Bonus based on performance and eligibility target payout is 12% of annual salary paid out annually
• Paid time off subject to eligibility, including paid parental leave, vacation, sick, and bereavement
• In addition to salary, PepsiCo offers a comprehensive benefits package to support our employees and their families, subject to elections and eligibility: Medical, Dental, Vision, Disability, Health, and Dependent Care Reimbursement Accounts, Employee Assistance Program (EAP), Insurance (Accident, Group Legal, Life), Defined Contribution Retirement Plan

• Bachelors or Masters degree in Computer Science, MIS, Business Management, or related field
• 14 + years of experience in Information Technology or Business Relationship Management
• 8 + years of experience in Data Warehouse/Azure Data Lake; 2+ years of big data experience
• Minimum 4 years of experience as project lead

• Solutions Delivery experience in Data, BI or Analytics projects - expertise in system development lifecycle, integration, and sustainability
• Strong programming experience, Python/Scala/SQL
• Experience working with Big Data processing frameworks within Azure (BLOB/ADLS, Databricks/Spark, Azure Data Factory, etc.)
• Experience working with Data Warehousing platforms and projects (experience with star schemas, slowing changing dimensions, etc.)
• Experience working with Big Data streaming services and tools such as Kafka, Spark Streaming, etc.