Product Engineer (Python/pyspark)
Company Description
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.
We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.
We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.
Description
Job description
Job Summary:
We are looking for a proactive and detail-oriented Product Engineer to support the development and maintenance of data pipelines and backend services. You will work with AWS, Python, and PySpark to build reliable data workflows and assist in API development using Java. This role offers an excellent opportunity to grow your skills in cloud technologies, big data processing, and backend development while collaborating with experienced engineers and cross-functional teams.
Want more jobs like this?
Get jobs in Hyderabad, India delivered to your inbox every week.
Key Responsibilities:
- Assist in designing and maintaining scalable data pipelines using AWS services.
- Support data processing tasks using PySpark and Python.
- Contribute to backend service and API development using Java.
- Collaborate with senior engineers and stakeholders to understand data requirements.
- Monitor and troubleshoot data workflows and performance issues.
- Ensure data accuracy and consistency across platforms.
- Learn and apply best practices in data engineering and software development.
Required Skills:
- Hands-on experience with AWS services like S3, Lambda, and Glue.
- Working knowledge of PySpark and Python for data processing.
- Basic experience with Java (at least 1 year).
- Familiarity with ETL processes and data warehousing concepts.
- Understanding of relational databases and NoSQL systems.
- Exposure to version control tools like Git.
- Good problem-solving and communication skills.
- Eagerness to learn and grow in a collaborative environment.
Preferred Qualifications:
- Exposure to CI/CD pipelines.
- Awareness of data security and compliance practices.
AWS foundational or associate-level certification is a plus.
Qualifications
Qualifications
- AWS: S3, Lambda, Glue, Working knowledge of PySpark & Python for data processing, Basic Java experience (~1+ year)
- Familiarity with ETL processes and data warehousing concepts, Understanding of relational databases and NoSQL systems
- Exposure to version control tools like Git
Additional Information
Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Perks and Benefits
Health and Wellness
- Health Insurance
- Dental Insurance
- Vision Insurance
- Life Insurance
- Short-Term Disability
- Long-Term Disability
- HSA With Employer Contribution
- FSA
- HSA
- Pet Insurance
- Mental Health Benefits
Parental Benefits
- Birth Parent or Maternity Leave
- Adoption Assistance Program
- Family Support Resources
- Adoption Leave
- Non-Birth Parent or Paternity Leave
- Fertility Benefits
Work Flexibility
- Hybrid Work Opportunities
- Remote Work Opportunities
- Flexible Work Hours
Office Life and Perks
- Casual Dress
- Commuter Benefits Program
Vacation and Time Off
- Paid Holidays
- Personal/Sick Days
- Volunteer Time Off
- Paid Vacation
- Leave of Absence
Financial and Retirement
- 401(K) With Company Matching
- Company Equity
- Performance Bonus
- Stock Purchase Program
Professional Development
- Leadership Training Program
- Tuition Reimbursement
- Promote From Within
- Shadowing Opportunities
- Access to Online Courses
- Internship Program
- Work Visa Sponsorship
- Associate or Rotational Training Program
- Mentor Program
Diversity and Inclusion
- Employee Resource Groups (ERG)
- Unconscious Bias Training
- Diversity, Equity, and Inclusion Program