Software Engineer III - AI Engineer

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III at JPMorganChase within the Consumer and Community Banking, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.

Job responsibilities

• Develop production-ready FastAPI applications and RESTful APIs that serve AI models and orchestrate complex workflows
• Design and implement RAG systems that combine large language models with external knowledge sources for intelligent information retrieval
• Build autonomous agentic AI systems capable of multi-step reasoning, tool utilization, and dynamic decision-making
• Optimize AI pipelines for latency, throughput, and cost efficiency
• Write clean, maintainable code with comprehensive testing (unit, integration, and end-to-end tests)
• Lead technical design reviews and contribute to architectural decisions. Design scalable microservices architectures to handle enterprise-grade workloads
• Plan and implement cloud infrastructure on AWS for maximum reliability and performance
• Establish best practices for deployment, monitoring, and incident response
• Evaluate and integrate emerging AI/ML technologies and frameworks
• Partner with ML engineers, data scientists, and product teams to translate requirements into technical solutions. Mentor and support junior engineers through code reviews and technical guidance
• Document systems and knowledge to enable team collaboration. Contribute to continuous improvement of engineering practices and tools

• Formal training or certification on software engineering concepts and 3+ years applied experience
• You're proficient in Python and have shipped multiple FastAPI applications to production. You've successfully built and deployed RAG systems, understanding vector databases, embeddings, and retrieval strategies
• You have hands-on experience with agentic AI systems, LLM orchestration, and multi-agent frameworks. You excel at system design-you can architect complex systems, think about trade-offs, and optimize for scalability and reliability
• You're an AWS expert with deep knowledge of core services and cloud-native architecture patterns
• You hold an active AWS Cloud Certification (Solutions Architect Professional, Developer Associate, or equivalent)
• Strong fundamentals in data structures, algorithms, and distributed systems
• Experience working with vector databases (Pinecone, Weaviate, Milvus) and embedding models. Familiarity with LLM frameworks and orchestration tools (LangChain, LlamaIndex, AutoGen)
• Proficiency with containerization (Docker) and infrastructure-as-code (Terraform). Solid understanding of CI/CD pipelines and modern DevOps practices
• Experience with testing frameworks and a commitment to code quality. Excellent communication skills-you can explain complex ideas clearly to both technical and non-technical stakeholders
• Proactive and self-motivated; you take ownership of problems and drive them to resolution. Collaborative team player who thrives in fast-paced environments
• Curious learner who stays current with AI/ML advancements and best practices. Leader with a growth mindset and willingness to mentor others