We are looking for a Senior Data Engineer to join our team. In this role, you will work closely with product owners, information engineers, data scientists, data modelers, infrastructure support, and data governance positions. If you have experience in designing, building, maintaining, and supporting complex data flows - don’t miss this opportunity and apply!
Work at Exadel - Who We Are
We don’t just follow trends—we help define them. For 25+ years, Exadel has transformed global enterprises. Now, we’re leading the charge in AI-driven solutions that scale with impact. And it’s our people who make it happen—driven, collaborative, and always learning.
About Our Customer
The leading provider of vehicle lifecycle solutions, with headquarters in Chicago, enables the companies that build, insure, and replace vehicles to power the next generation of transportation. Its platform delivers advanced mobile, artificial intelligence, and car technologies. It connects a network of 350+ insurance companies, 24,000+ repair facilities, hundreds of parts suppliers, and dozens of third-party data and service providers. The customer's collective solutions enhance productivity and help clients deliver better experiences for end consumers.
About the Project
Want more jobs like this?
Get jobs delivered to your inbox every week.
The team builds platforms to provide insights to internal and external clients in auto property damage and repair, medical claims, and telematics data. Our data engineers use big data technology to create the best-in-industry analytics capability. This position is an opportunity to use Hadoop and Spark ecosystem tools and technology for micro-batch and streaming analytics. The role has the responsibility to understand, prepare, process, and analyze data to drive operational, analytical, and strategic business decisions.
Project Tech Stack
Python, PySpark, AWS, Airflow, SQL, Unix, Hadoop, Spark.
Requirements
- Master’s or bachelor’s degree with Engineering/Programming/Analytics Specialization
- 4 + years’ experience with building, maintaining, and supporting complex data flows with structural and un-structural data
- Proficiency in Python and PySpark
- Hands-on experience in AWS components such as EMR and S3
- Experience in Apache Airflow to orchestrate and schedule complex data flows
- Ability to use SQL for data profiling and data validation
- Experience in Unix commands and scripting
Nice to have
- Experience and understanding of Continuous Integration and Continuous Delivery (CI/CD)
- Knowledge in performance tuning in a distributed computing environment (such as Hadoop cluster or EMR)
- Prior experience in managing other engineers and leading projects
- Familiarity with BI tools (such as Tableau) and commonly use data modeling techniques.
- Interest in and familiarity with AI models, including experience using commonly available Generative AI (GenAI) tools
English level
Upper-Intermediate+
Responsibilities
- Own and be responsible for data engineering projects from start to finish
- Build end-to-end data flows from sources to fully curated and enhanced data sets. This can include the effort to locate and analyze source data, create data flows to extract, profile, and store ingested data, define and build data cleansing and imputation, map to a common data model, transform to satisfy business rules and statistical computations, and validate data content
- Modify, maintain, and support existing data pipelines to provide business continuity and fulfill product enhancement requests
- Provide technical expertise to diagnose errors from production support teams
- Participate as both a leader and a learner in team tasks for architecture, design, and analysis
- Be a mentor and be supportive to the growth of other Engineers
- Coordinate within the European team as well as work seamlessly with the US team