Principal Consultant - Pyspark and Databricks
Infosys is seeking a highly skilled Principal Consultant with experience in Databricks, PySpark, AWS, and Snowflake to lead the overall solution of design/development of scalable data solutions tailored for the clients of Infosys. This role will focus on designing the robust data pipelines and platforms that support reading data from external 3rd Party Sources. You will design and implement scalable data pipelines to process data from various 3rd Party Sources and move it to cloud storage like S3 and Snowflake. Build, optimize and monitor the applications using Databricks and PySpark for batch and real-time processing. Collaborate with client stakeholders to deliver data solutions aligned with business goals. Ensure data quality, lineage, and governance in compliance with the client requirements. Lead and mentor a team of data engineers, promoting the best practices in coding, testing, and documentation.
Required Qualifications:
- Candidate must be located within commuting distance of Hartford, CT or be willing to relocate to the area. This position may require travel to project locations.
- Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 11 years of experience in Information Technology
- Strong hands-on experience with Databricks, PySpark, and AWS data services.
- Strong experience in data engineering, preferably in the insurance or financial services domain.
- Experience in leading the response to RFPs, RFIs, and proactive proposals. Coordinate with pre-sales, solution architects, and delivery teams to craft compelling, customized proposals that align with client expectations
- Managed client relationships at Director/GM at customer organization
- Able to lead the team at customer location and experience in managing large teams in a global delivery model
- Experience in data platform transformation/migration to cloud platforms (Azure, AWS, GCP, Databricks/Snowflake
- Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time
Want more jobs like this?
Get jobs in Hartford, CT delivered to your inbox every week.

- Strong knowledge of Snowflake architecture, performance tuning, and cost optimization.
- Proficiency in Python, SQL, and data modeling techniques.
- Experience in solving business problem in the relevant industry, understanding of E2E functional flows of the customer business
- Able to create a Business Plan for expanding business - with a good understanding of potential business opportunities, competition strengths and weaknesses
- Continuous improvement, Innovation, and growth Mindset
- Good communication, articulation, and presentation skills
- Good understanding of solutions, accelerators and value proposition in Data, Analytics and AI
- Learnability and focus on new / emerging areas
- Good understanding of Agile software development frameworks
- Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
- Experience and desire to work in a global delivery environment
Along with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits :-
- Medical/Dental/Vision/Life Insurance
- Long-term/Short-term Disability
- Health and Dependent Care Reimbursement Accounts
- Insurance (Accident, Critical Illness , Hospital Indemnity, Legal)
- 401(k) plan and contributions dependent on salary level
- Paid holidays plus Paid Time Off
Perks and Benefits
Health and Wellness
- Health Insurance
- Life Insurance
- HSA
- Short-Term Disability
Parental Benefits
- Birth Parent or Maternity Leave
- Non-Birth Parent or Paternity Leave
- On-site/Nearby Childcare
Work Flexibility
Office Life and Perks
- Commuter Benefits Program
Vacation and Time Off
- Paid Vacation
- Paid Holidays
- Personal/Sick Days
- Sabbatical
Financial and Retirement
- 401(K)
- Relocation Assistance
Professional Development
- Learning and Development Stipend
Diversity and Inclusion
- Employee Resource Groups (ERG)