EPAM Systems

Senior Big Data Software Engineer

3+ months agoLviv, Ukraine

Our customer is an insurance company, offering automobile, property, liability, agriculture, and surety insurance. It is the 9th largest property and casualty insurance company in Canada, by direct written premium and the 20th largest insurance company in Canada, by total assets. As of 2014, it had about 1.6 billion in mutual policyholder's equity. Investments in innovation, customer service, and operations underpin the future of the company. It is poised to grow, invest, expand, and deliver value to its broker partners and customers.

  • Collaborate with Product Owners and Team Leads to identify, design, and implement new features to support the growing real time data needs
  • Assist and mentor Junior Engineers in troubleshooting and tuning of high volume, distributed applications, primarily on Spark
  • Identify and suggest or implement remediation of cases where we diverge from industry best practices
  • Evangelize and practice an extremely high standard of code quality, system reliability, and performance to ensure SLAs are met for uptime, data freshness, data correctness, and quality
  • Display sense of ownership over assigned work, requiring minimal direction and driving to completion in a sometimes fuzzy and uncharted environment
  • Focus on enabling developers and analysts through self-service and automated tooling, rather than manual requests and acting as a gatekeeper
  • Strong hands-on Spark (Scala, Java) experience including performance optimization
  • Hands-on experience with Cloudera Hadoop stack including Hive and Impala performance optimization
  • Data Quality management knowledge is highly desirable
  • Experience with real-time data processing technologies: Flume, Message Queues (preferably IBM Websphere MQ)
  • Knowledge of Insurance field and Guidewire system would be a plus
  • Hadoop stack: HDFS, Hive, Impala 2+ years
  • Spark 2+ years
  • ETL tools experience, preferably Pentaho 1+ year
  • Cloudera 5.1+
We offer
  • Competitive compensation depending on experience and skills
  • Individual career path
  • Unlimited access to LinkedIn learning solutions
  • Social package - medical insurance, sports
  • Compensation for sick lists and regular vacations
  • English classes with native speakers (certified English teachers)
  • Flexible work hours

Job ID: EPAM-60478