Senior Software Dev Engineer

1 month agoNew York, NY


Amazon's Catalog Quality team is looking for an exceptional software engineer to develop algorithms and build systems to automatically solve a variety of Information Retrieval, Machine Learning and Data Mining problems related to the Amazon Product Catalog - one of the biggest assets of the company.

Our principal challenge is to improve the shopping experience by detecting duplicate products for sale in the catalog and merging them. Merchants on provide information about the products they want to sell. Amazon attempts to match these product data submissions to items in its catalog so that it can display offers for the same product on a single page. Poorly structured or incomplete data makes this problem challenging and often results in duplicate products getting created in the catalog. These duplicate products are shown in search results and end up confusing customers, leading to a bad customer experience. The Catalog Quality team detects these duplicate products in the catalog using an innovative mix of Information Retrieval, Machine Learning, Data Mining and Text Analysis algorithms and human intelligence. We then automatically group products detected as duplicates together, improving customer experience and the quality of the catalog.

Our problems are in the application of Machine Learning techniques at enormous scale - processing billions of data elements each year, with the Amazon product catalog growing in different markets, in new categories and adding products every day. Theoretical approaches may work fine with small datasets, but applying new ideas in a fast moving business context is a unique challenge that few teams can offer. The team relies on a distributed data pipeline that can adapt and deal with the large volume of data elements to process while maintaining a high quality and operating efficiency. Our operational load is low and there is a lot of new software development with open ended business problems.

We are a highly-motivated, co-operative and fun loving team who thrive on solving challenging problems with innovation. As part of this team you will be analyzing data, developing new algorithms, building large-scale distributed software systems in Java using open source technologies such as Hadoop, Lucene and JBoss and other proprietary technologies.

Amazon is an Equal Opportunity-Affirmative Action Employer Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation


  • 4+ years of professional software development experience
  • 3+ years of programming experience with at least one modern language such as Java, C++, or C# including object-oriented design
  • 2+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
- Bachelors degree in Computer Science, Math or related field with 5+ years of experience
- Experience with building high-performance, highly-available and scalable distributed systems
- Fundamentals in design and coding skills in Java/C++ on Unix Platforms - Familiar with Perl and have an understanding of SQL


- Masters degree in Computer Science or Math or related field
- Past experience in at least one of the following areas - Information Retrieval, Data Mining, Text Analysis or Machine Learning
- Desire to analyze data while developing solutions to problems
- Experience taking a leading role in building complex software systems that have been successfully delivered to customers
- Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
- Experience with distributed computing and enterprise-wide systems
- Experience in communicating with users, other technical teams, and senior management to collect requirements, describe software product features, technical designs, and product strategy
- Experience mentoring junior software engineers to improve their skills, and make them more effective, product software engineers
- Experience influencing software engineers best practices within your team
- Excellent written and verbal communication skills

Amazon is an Equal Opportunity-Affirmative Action Employer Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation

Client-provided location(s): New York, NY, USA
Job ID: Amazon-1397703

Company Videos

Hear directly from employees about what it's like to work at Amazon.