Data Engineer III

Our Opportunity:

We are looking for a Data Engineer III at our facility in Boston, Massachusetts, to act as a member of Chewy’s Content Platform team, influence the vision and implementation of architecture, design, and features for this critical business line.

What You’ll Do: 

• Act as an individual contributor as part of a team of strong engineers building services for competition Engine and delivery mechanism to allow for full operationalization of targeting as an evergreen strategy used to drive high value actions (HVA) and improve the overall site experience for Chewy customers.
• Develop, train, deploy, evaluate, and refine data pipelines for ML/DL models at scale in a production environment.
• Implement data-driven solutions in a production environment using tools such as Spark and Kafka.
• Explore structured/unstructured data sources and deliver ‘quick wins’ by building robust data pipelines for ML/DL models.
• Write simple and sustainable code that reflects a constant understanding of the business impacts.
• Act in the capacity of a Data engineer to actively participate in the definition, design, development, testing and implementation of Data Pipelines using the Agile methodology.
• Create or modify complex programs, modules, routines, scripts and data objects from a detailed design where efficiency, performance and reliability are critical.
• Work with and advise both business and technology teams (internal and external) on how best to implement desired features and enhancements.
• Ensure that technical solutions follow best practices, are reliable, are easily maintainable and are scalable under sustained load.
• Participate in design and code reviews.
• Collaborate to identify, isolate and resolve malfunctions related to software.
• Conduct knowledge transition on solutions to the designated application support team(s).
• Create and evolve application documentation as required.
• Operate in compliance with IT standards, policies, procedures, and best practices.
• Work in an agile development environment and collaborate with multiple teams while experimenting with new technologies helping create solutions that puts Chewy on the cutting edge.
• Local telecommuting permitted.

What You’ll Need:

• Bachelor’s degree in Computer Science, Engineering, or a related field and 8 years of experience.
• Experience must include 2 years in the following: active development with Python, Anaconda, Spark, Hive, and Kafka;
• Developing and managing development of Data Integration applications with experience in both batch and online systems;
• Big Data (in Hadoop);
• Data warehousing;
• Consumer analytics and near real time data processing (Spark Streaming);
• Relational database and No-SQL development;
• Building a data integration tool;
• Working across fully automated stacks in a CI/CD ecosystem;
• Distributed data stores at scale;
• Leading the design, development, and deployment of business software at scale;
• Experience as an Engineer writing code or debugging issues;
• Professional software engineering practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations;
• Mentoring and training the engineering community on complex technical issues;
• Design patterns;
• Cloud and orchestration technologies (AWS Services, Terraform, and Ansible);
• Domain knowledge in retail e-commerce;
• Designing, implementing, and automating the deployment of distributed systems for collecting and processing log events from multiple sources;
• Designing data schema and operating internal data warehouses and SQL/NoSQL database systems;
• Owning the design, development, and maintenance of ongoing metrics, reports, analyses, and dashboards to drive critical business decisions;
• Monitoring and troubleshooting operational or data issues in data pipelines;
• Driving architectural plans and implementation for future data storage, reporting, and analytic solutions;
• Designing and developing features using Python;
• Airflow, AWS, Kafka, Git, Kubernetes, CI/CD, and Docker Containerization.
• Local telecommuting permitted.
• The position is eligible for the Employee Referral Program.