Amazon

Senior Software Development Engineer - Aws Glue

2 months agoPalo Alto, CA

DESCRIPTION

Amazon Web Services (AWS) provides companies of all sizes with an infrastructure web services platform in the cloud. With AWS, you can requisition compute power, storage, and other services paying as you go for only the resources you need. This role will be focused on building a new V1 service: AWS Glue.

AWS provides a collection of rapidly growing Big Data services designed for the cloud that span the gamut from EMR to Redshift to RDS Aurora. These services manage all the work needed to set up, operate, and scale data services ranging from big data platforms to data warehouses to operational databases. By automating tedious, labor-intensive administrative tasks, these services enable customers to spend their time focusing on their data and business insights.

The AWS Glue team provides a scalable, resilient, highly performant and secure data platform and infrastructure for users running Business Intelligence, Analytics and ML applications. The team is responsible for data orchestration and workflow management service, metadata platform with Glue catalog (lineage, discovery, search, annotations), services that move data around (Apache Spark SQL, data ingestion and dispersal), streaming and batch querying systems (based on Spark SQL and Spark structured streaming), advanced data processing platforms (based on Spark SQL and ML, and other Data Science tools), Data Warehousing, and security (using AWS Lake Formation), and the underlying storage and resource management infrastructure (with serverless Apache Spark, Amazon S3, Apache Yarn and HDFS).

Joining the AWS Glue gives you the opportunity to:


• Work on a disruptive product that's still in its early stages

• Solve challenging problems that will revolutionize database computing in the cloud

• Build a product that will leverage the scale of resources available in the cloud

• Work for a company that's a recognized leader in the cloud computing space

• Be involved in the fast growing, big data space

We are looking for developers with expertise and passion for building
large-scale data-intensive systems and distributed systems. In
particular, we are looking for developers that want to work on the
next generation big data systems that will transform data management on AWS and across the industry.

Experience with large scale data analytics, big data platforms, highly
available/fault tolerant systems, replicated data storage, and
operating complex services running in the cloud are all pluses.
In this role, you will have responsibility for:


• Translating functional and technical requirements into detailed architecture and design

• Coding and testing complex system components

• Participating in code and design reviews to maintain our high development standards

• Working with other teams to deliver and operate large scale, distributed services in the cloud

• Overall system architecture, scalability, reliability, and performance

• Mentoring other engineers, defining our challenging technical culture, and helping to build a fast-growing team

Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon's culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.

Our team puts a high value on work-life balance. It isn't about how many hours you spend at home or at work; it's about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.

BASIC QUALIFICATIONS

• 4+ years of professional software development experience
• 3+ years of programming experience with at least one modern language such as Java, C++, or C# including object-oriented design
• 2+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
• 3 - 5 years experience writing large scale systems in Java and/or Python. C/C++ is a plus.

• Bachelors in Computer Science or Engineering, or equivalent experience

PREFERRED QUALIFICATIONS

• Strong knowledge of data structures and algorithms

• Experienced writing multi-threaded programs requiring concurrency and synchronization primitives

• Write very high quality code that is robust and easy to maintain

• Experienced debugging, diagnosing, and trouble-shooting complex, production software

• Strong understanding of system performance and scaling

• Ability to drive tasks to completion and take ownership of projects

• Ability to work in a fast paced and agile development environment

• Possess excellent communication, sharp analytical abilities, and proven design skills

• Experience delivering and operating large scale, highly available distributed systems is a plus

• Experience with database systems internals, query optimization, and storage systems

• Experience with large-scale data analytics and data warehousing is a plus

• Masters or PhD in Computer Science

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities
who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and we host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon's culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.

Job ID: Amazon-1411770