Product Consultant - Hadoop

As the healthcare industry continues to rapidly transform, our Health Tech team conceives, develops and delivers impactful technology solutions to support access to quality, affordable healthcare for our members. We are driven by our collective company purpose: To do everything in our power to stand with our members in sickness and in health®. Our Health Tech team unleashes the power of this purpose through technology. We come to work every day to make a difference, and we deliver the highest quality and best solutions to our members.

Job Purpose: This position is responsible for leading ideation, technical development, and launch of new Infrastructure products for their assigned products; developing infrastructure architecture roadmap and alignment with enterprise architecture; assisting in the development of preliminary product business case(s) aligned to required business capabilities, long term architecture direction, & customer demand; supporting the infrastructure Product Manager in establishing a shared vision with IT Portfolio and DevOps stakeholders by building consensus on priorities and product design; supporting platform services, advanced integration, Bigdata or Analytics.

Required Job Qualifications:

Bachelor degree and 8 years in Information Technology or relevant experience OR Technical Certification and/or College Courses and 9 year Information Technology experience OR 10 years Information Technology experience.
Predictive Analytics and Infrastructure Automation.
Experience with As a Service technologies
Experience with Cloud Orchestration and Management technologies(e.g.Azure,AWS)
Excellent knowledge and experience with the Hadoop ecosystem, architecting Hadoop based data lakes and solutions.
Experience with Monitoring and Event Management
Experience with Infrastructure Operations.
Experience with solutions to enable Operations Management, ITILv3 .
Experience with Bigdata and Analytics, (e.g.,Hadoop, Cloudbreak,Datastage,Cognos,SAS,PowerBIetc).
Experience with Cloud Technologies (e.g. Azure,AWS)
Hands-on experience with Cloudera/HDP/Apache distributions
Hands on experience in deploying Big Data clusters involving Hadoop (HDFS/Yarn/Hive), HBase, Kafka, Solr, Spark, Zookeeper, Oozie using Ambari/Cloudera Manager
Good understanding of Hadoop benchmarks and other performance benchmarks for optimal configuration
Solid troubleshooting abilities and able to work with a team to fix large production issues
Knowledge of Infrastructure Operations.
Solutions to enable Operations Management, ITILv3.
Experience with system and technology integration.
Ability to simplify & standardize complex concepts / processes.
Customer relationship management.
Understanding of business priorities (e.g., vision), trends (e.g., industry knowledge) and markets (e.g., existing/ planned)
Ability to understand and support strategic vision.

Preferred Job Qualifications:

Bachelor's Degree (Computer Science, MIS, or related degrees).
Architecting and designing Hadoop data architectures, including HBase and Hive database design, and data processing/transformation using Spark, NiFi, and/or Pig
Architecting and designing large scale Hadoop infrastructures, providing for scalability and availability
Hortonworks/Cloudera distributions
Develop Hadoop components using Scala, Java, Python, Map Reduce or other languages/tools ( experience with Scala is preferred)
Hands on experience on monitoring tools like Nagios, Ganglia etc.
Hadoop performance tuning and optimization
Security Architecture Setup of Hadoop environments using LDAP, AD, and Ranger
common Hadoop file formats including Avro, Parquet, and ORC
Data ingestion from Kafka,NIFI and the use of such data for streaming analytics
Support Scrum teams on a day to day basis helping with code reviews and detail design walkthrough
Build and help with PoCs and Tools evaluation
Ability to troubleshoot Hadoop operational challenges
Experience with automation using Ansible or other tools
Performance Tuning effort
Infrastructure sizing/capacity planning
Expert in Java or SCALA programming language
Working knowledge of Hadoop data consumption via SQL front-ends, BI tools, and so on would be a big plus
Oral & written communication.
Problem-solving/ analytical skills, tools, and techniques.


HCSC is committed to diversity in the workplace and to providing equal opportunity and affirmative action to employees and applicants. We are an Equal Opportunity Employment / Affirmative Action employer dedicated to workforce diversity and a drug-free and smoke-free workplace. Drug screening and background investigation are required, as allowed by law. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.


Expertise Information Technology Job Type Full-Time Regular Location TX - Richardson, IL - Chicago

Meet Some of HCSC's Employees

Chitra G.

Business Analyst

Chitra works in the Provider Network Department, translating needs into technical terms so that designers can create new features and enhance existing tools.

Tony H.

Senior Data Scientist

Tony utilizes his personal experience and background in analytics to have an impact at HCSC. As a Senior Data Scientist, he is able to comb through data and find information that could lead to a reduction in cost and more affordable health care for HCSC's members.

Back to top