Skip to main contentA logo with &quat;the muse&quat; in dark blue text.
HUB International

Big Data Engineer

About Us:

HUB International Limited ("HUB") is the 7th largest global insurance and employee benefits broker, providing a broad array of property, casualty, risk management, life and health, employee benefits, investment and wealth management products and services. With over 10,000 employees in 450 offices throughout North America, HUB has grown substantially, in part due to our industry leading success in Mergers and Acquisitions. The company is headquartered in Chicago and is currently owned by Hellman & Friedman.

About the Position:

The Big Data Engineer will lead the development of applications or system software and improve the efficiency of information processing systems. The candidate should have experience in designing, developing and testing a company's data management software, ensuring that it meets business requirements and industry practices. This position requires experience in training internal and external resources to integrate new products and software packages into the system in the organization.

Want more jobs like this?

Get Software Engineer jobs delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.

Responsibilities:

  • Responsible for designing, developing, testing, and deploying distributed machine learning systems and large-scale data mining solutions
  • Designs and implements data-oriented applications using a wide variety of technologies, including Microsoft's Cloud technology stack (Azure).
  • Implement data-intensive, horizontally-scalable systems (such as on Map-Reduce frameworks like Hadoop, Spark, etc.).
  • Develops distributed applications to solve large scale processing problems, utilizing various languages like Java, Scala , Shell etc.
  • Implements, troubleshoots, and optimizes solutions based on modern big data technologies like Hadoop, Spark, Elastic Search, Storm, Kafka, etc. in both an on premise and cloud deployment model
  • Implements data architecture, including data ingress in batch and real time from a broad variety of external systems; data transformations to prepare data for analytics processing, and data egress for availability of analytics results to visualization systems, applications, or external data stores
  • Supports documentation, change control, and QA processes consistent with enterprise requirements
  • Establishes strong teamwork with client technical resources, and effectively communicates project status, technical issue options and resolution, and operational requirements to client stakeholders
  • Communicate via RESTful APIs with HTTP and JSON
  • Research and development of novel technologies and methodologies for extreme scale data analytics, big data processing, data mining, and machine learning on traditional and emerging computing architectures

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Systems or related field preferred
  • 7 to 10 years of experience in a professional capacity as described above
  • Experience with one or more of the cloud products: Azure, Amazon AWS, OpenStack, CloudFoundry, Mesos and Docker
  • Very strong server-side Java or .NET experience, especially in an open source, data-intensive, distributed environments
  • Expert in the Hadoop Framework & java programming (i.e. Spark, MapReduce, Pig, Hive, Kafka, Storm, etc.) including performance tuning
  • Good understanding of algorithms, data structure, and performance optimization techniques
  • Experience with agile development methodologies like Scrum
  • Self motivated, and has the ability to drive technical discussions
  • Organized, detail oriented, able to work both independently and in a team
  • Excellent problem solver, analytical thinker and quick learner
  • Strong verbal and written communication skills
  • Proficient in Data Architecture, Master Data Management and Governance
  • Experience in NoSQL DB such as Cassandra and MongoDB
  • Certifications a plus: Amazon, Cloudera, Spark
  • LI-MP1
Job ID: f2f537aec8d1a174dce99b46be89e35c
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Health Reimbursement Account
    • Dental Insurance
    • Vision Insurance
    • FSA
    • HSA
    • HSA With Employer Contribution
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
  • Office Life and Perks

    • Commuter Benefits Program
    • Happy Hours
    • Company Outings
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
  • Financial and Retirement

    • 401(K)
    • 401(K) With Company Matching
  • Professional Development

    • Promote From Within
    • Mentor Program
    • Shadowing Opportunities
    • Access to Online Courses
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program

This job is no longer available.

Search all jobs