Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

LLM Product Manager - Senior Associate

AT JPMorgan Chase
JPMorgan Chase

LLM Product Manager - Senior Associate

New York, NY

You enjoy contributing to the future of product innovation, supporting value creation for customers, assisting in successful launches, and meeting expectations. Join our dynamic team and make a meaningful impact by supporting the delivery of high-quality products that resonate with clients.

As a Product Associate in Global Banking (GB), you will assist in delivering a business-friendly, best-in-class enterprise Search capability incorporating the latest technologies (including AI/LLM) and applying best practices. You are expected to support the design and architecture of the solutions while focusing on various stages of the Software Development Lifecycle (SDLC).

Job Responsibilities

  • Assist in developing and communicating a clear product vision and strategy for both conventional Search and Large Language Model (LLM)-based conversational User Interface (UI) initiatives within GB. Align product goals with business objectives and market needs.
  • Leverage a wide range of cutting-edge technologies such as Semantic Search, Personalized Search, Supervised Fine-Tuning (SFT), Reinforcement Learning with Human Feedback (RLHF), Retrieval-Augmented Generation (RAG), and Agents to enhance user experiences.
  • Incorporate established search methodologies and technologies, including Boolean Search, Keyword Search, Faceted Search, and Full-Text Search, to improve overall search capabilities and user experience.
  • Collaborate with internal stakeholders, including business leaders, data scientists, engineers, and designers, to gather requirements, define product features, and ensure successful product delivery.
  • Oversee the integration and release of Search and LLM technologies into GB products and services. Ensure that solutions are scalable, secure, and compliant with regulatory requirements.
  • Help define and track key performance indicators (KPIs) to measure the success of Search and LLM products. Use data-driven insights to support informed decisions and drive continuous improvement.

Want more jobs like this?

Get jobs delivered to your inbox every week.

Select a location
By signing up, you agree to our Terms of Service & Privacy Policy.

Required Qualifications, Capabilities, and Skills

  • 1-3+ years of experience in Search / LLM product management or analytics.
  • Strong collaboration skills, with the ability to positively influence technology teams and stakeholders.
  • Knowledge of AI/LLM and data product lifecycle, including discovery, data processing, model development, model deployment, and model monitoring.
  • Familiarity with ElasticSearch, Supervised Fine-Tuning (SFT), Reinforcement Learning with Human Feedback (RLHF), RAG, and Agents.
  • Knowledge of LLM frameworks such as LangChain, LangGraph, and OpenLLM.
  • Understanding of operationalizing AI products responsibly through MLOps pipeline.
  • Basic expertise in Cloud computing and architecture (e.g., AWS).

Preferred Qualifications, Capabilities, and Skills

  • Experience in Financial Services or other highly regulated industries.


ABOUT US

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

ABOUT THE TEAM

J.P. Morgan's Global Banking business is one of the largest wholesale banking client franchises in the world. We serve clients, including corporations, governments, states, municipalities, healthcare organizations, education institutions, banks and investors.

Commercial Banking provides credit and financing, treasury and payment services, international banking and real estate services to clients-including corporations, municipalities, institutions, real estate investors and owners, and not-for-profit organizations.

Client-provided location(s): New York, NY, USA; Palo Alto, CA, USA
Job ID: JPMorgan-210633252
Employment Type: Full Time