Software Engineer II, PySpark, Databricks

Description

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

Job summary

As a Software Engineer II at JPMorgan Chase within the Corporate technology, you design and deliver trusted technology products in a secure, stable, and scalable way. You are responsible for implementing critical solutions across multiple technical areas to support the firm's business objectives.

Job responsibilities

• Execute software solutions, design, development, and technical troubleshooting to solve complex problems.
• Create secure, high-quality production code and maintain algorithms that run synchronously with systems.
• Produce architecture and design artifacts for complex applications, ensuring design constraints are met.
• Gather, analyze, and develop visualizations and reporting from large, diverse data sets to improve applications and systems.
• Identify hidden problems and patterns in data to drive improvements in coding hygiene and system architecture.
• Contribute to software engineering communities of practice and events exploring new and emerging technologies.

• Formal training or certification on software engineering concepts and 2+ years applied experience
• At least one year of practical experience with Spark, SQL, Databricks, and AWS cloud ecosystem.
• Expertise in Apache NiFi, Lakehouse or Delta Lake architectures, system design, application development, testing, and operational stability.
• Strong programming skills in PySpark and SparkSQL.
• Proficient in orchestration using Airflow.
• In-depth knowledge of Big Data and data warehousing concepts.
• Experience with CI/CD processes.

• Familiarity with Snowflake, Terraform, and large language models.
• Exposure to cloud technologies such as AWS Glue, S3, SQS, SNS, Lambda.
• AWS certifications such as Solutions Architect Associate, Developer Associate, Data Analytics Specialty, or Databricks certification.