Hadoop and PySpark Lead Developer

Infosys is seeking a Hadoop and PySpark Lead Developer. In this role, one will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. One will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. Candidate will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.

Required Qualifications:

• Candidate must be located within commuting distance of Tampa/FL, Irving/TX or be willing to relocate to the area.
• At least 4 years of experience in Information Technology.
• Experience to develop/lead Big Data solutions at enterprise scale with at least one end-to-end implementation
• Bachelor's degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education
• Applicants authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.

Preferred Qualifications:

• Expertise in software development building large scale distributed data processing systems/application, Data Engineering or large-scale internet systems.
• Strong experience in programming languages: Big Data, Spark/PySpark, SQL, Python, and Shell scripting.
• Good experience with Spark/Hadoop/HDFS architecture, YARN, Confluent Kafka, HBase, Hive, Impala, and NoSQL databases
• Experience with batch processing and AutoSys job scheduling and monitoring
• Performance analysis, troubleshooting, and resolution (including familiarity with Cloudera/Hadoop logs)
• Experience working with Cloudera on open issues leading to cluster configuration changes and implementation. Strong experience with databases such as SQL, Hive, Elasticsearch, HBase, etc.
• Knowledge of Hadoop security, data management, and governance
• Good understanding of data integration, data quality and data architecture. Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data

The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements.

Along with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits: -

• Medical/Dental/Vision/Life Insurance
• Long-term/Short-term Disability
• Health and Dependent Care Reimbursement Accounts
• Insurance (Accident, Critical Illness, Hospital Indemnity, Legal)
• 401(k) plan and contributions dependent on salary level

Client-provided location(s): Irving, TX

Job ID: Infosys-146054BR

Employment Type: FULL_TIME

Posted: 2026-04-03T18:40:30