Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Generative AI Software Architect - Sr. Consultant

AT Visa
Visa

Generative AI Software Architect - Sr. Consultant

Austin, TX

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Are you a hands-on Architect who is passionate about the future of GenAI and eager to shape the next generation of intelligent, agentic applications? Our Corporate Generative AI Team is seeking a visionary Generative AI Architect to lead the design and implementation of cutting-edge GenAI and agentic AI solutions. This role is pivotal in defining the architecture and technical direction for enterprise-scale AI systems that power our internal corporate functions.

Want more jobs like this?

Get jobs in Austin, TX delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.


As a GenAI Architect, you will collaborate with cross-functional teams to build scalable, secure, and production-ready Corporate GenAI platforms and solutions. You will serve as a thought leader, influencing both technical strategies and executive-level decisions, while staying ahead of emerging trends in LLMs, AI agents, and orchestration frameworks.

Key Responsibilities

Enterprise GenAI Architecture & Strategy

  • Define and evolve the enterprise-wide architecture blueprint for GenAI and agentic systems.
  • Lead the design of modular, reusable, and scalable architecture patterns for GenAI and agentic applications.
  • Design single pane of Glass GenAI product(s) which caters to multiple corporate domains and multiple personas.
  • Develop and design robust, secure solution patterns that can be operationalized across enterprise environments.

Agentic AI Frameworks & Orchestration

  • Architect and implement agentic AI systems using frameworks like LangGraph, LangChain, or CrewAI.
  • Design agent coordination strategies and evaluation pipelines for autonomous enterprise workflows.

Prompt Engineering, Intent Understanding & Model Selection

  • Develop architectural patterns for advanced prompt engineering, including dynamic prompt templates and multi-turn dialogue strategies.
  • Implement intent analysis techniques to enhance agent decision-making and user interaction quality.
  • Demonstrate deep understanding of various LLM models (e.g., GPT, Claude, Gemini, open-source models) and determine the right model for each use case based on performance, cost, latency, and compliance.
  • Rapidly develop PoCs and iterate solutions using an agile, experimental approach—without compromising architectural integrity or long-term scalability.

Scalable Infrastructure & Deployment

  • Build cloud-native, containerized infrastructure (Kubernetes, ECS, EKS) for deploying GenAI models at scale.
  • Integrate CI/CD pipelines, model versioning, and automated testing for continuous delivery.

Enterprise Integration & Operationalization

  • Design APIs and microservices to integrate GenAI capabilities into enterprise systems (ERP, CRM, HRIS).
  • Architect solutions that are highly secure and have High availability, resiliency, uptime, and built-in insights.
  • Establish monitoring frameworks for agent behavior, hallucination detection, and model drift.

Innovation & Thought Leadership

  • Stay ahead of trends in agentic AI, autonomous systems, and LLM orchestration.
  • Lead internal workshops, and innovation sprints to explore new use cases.

Documentation & Knowledge Sharing

  • Maintain detailed architectural documentation and operational playbooks.
  • Mentor engineering teams and promote best practices in GenAI development.


This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.

 

Qualifications

Basic Qualifications:

  • 8+ years of relevant work experience with a Bachelor’s Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD, OR 11+ years of relevant work experience.


Preferred Qualifications:

  • 9 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 3 or more years of experience with a PhD
  • 5+ years of experience as a software architect, in designing and implementing scalable, secure, and resilient architectures for enterprise-grade global applications.
  • 3+ years of hands-on experience in architecting and deploying AI, ML, GenAI based enterprise solutions, including the integration of large language models (LLMs) and agentic frameworks to automate complex workflows, enhance decision-making, and deliver personalized user experiences.
  • Proven track record of delivering highly resilient enterprise solutions.
  • Proven architectural expertise in building conversational agents with short-term memory (context windows, session state) and long-term memory (vector stores, memory graphs).
  • Deep architectural knowledge of LLM orchestration frameworks (e.g., LangGraph, CrewAI, Semantic Kernel) and multi-agent systems.
  • Familiarity with multi-agent GenAI solutions that incorporate agentic behaviors using A2A and MCP protocols.
  • Experience with vector databases (e.g., Pinecone, ChromaDB), embedding models, and RAG pipelines.
  • Experience in retrieval-augmented generation (RAG) pipelines, hybrid search strategies, and embedding optimization.
  • Experience with DevOps/MLOps practices, CI/CD pipelines, and version control systems.
  • Proven ability to lead cross-functional AI initiatives, including PoC development, stakeholder alignment, and enterprise rollout.
  • Excellent communication skills with the ability to translate complex technical concepts to business stakeholders.

Technical Skills:

  • Languages & Frameworks: Python, FastAPI, PyTorch, LangChain, LangGraph, CrewAI
  • Cloud & Infrastructure: AWS, Azure, Docker, Kubernetes, ECS, EKS
  • MLOps & DevOps: MLflow, Databricks, Airflow, Ray, Git, CI/CD pipelines
  • LLM & GenAI Tools: OpenAI, Claude, Gemini, Hugging Face Transformers, RAG
  • Databases & Storage: Pinecone, ChromaDB, Redis, PostgreSQL
  • Orchestration & Agents: Semantic Kernel, multi-agent coordination, memory management, MCP, A2A.
  • Monitoring & Governance: Prometheus, Grafana, audit logging, access control
  • Frontend: ReactJS, HTML, CSS, JavaScript

Additional Information

Work Hours: Varies upon the needs of the department.

Travel Requirements: This position requires travel 5-10% of the time.

Mental/Physical Requirements: This position will be performed in an office setting.  The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer.  Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.  Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law, including the requirements of Article 49 of the San Francisco Police Code.

U.S. APPLICANTS ONLY: The estimated salary range for a new hire into this position is 143,200.00 to 207,800.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401 (k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.

Client-provided location(s): Austin, TX, USA
Job ID: 3b121272-9ce2-4e47-8b0c-07198a776306
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Long-Term Disability
    • HSA With Employer Contribution
    • On-Site Gym
    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Health Reimbursement Account
    • Mental Health Benefits
    • Virtual Fitness Classes
    • HSA
  • Parental Benefits

    • Fertility Benefits
    • Family Support Resources
    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Commuter Benefits Program
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
    • Happy Hours
    • Casual Dress
  • Vacation and Time Off

    • Paid Holidays
    • Paid Vacation
    • Volunteer Time Off
    • Summer Fridays
    • Leave of Absence
    • Personal/Sick Days
  • Financial and Retirement

    • 401(K)
    • Relocation Assistance
    • Performance Bonus
    • Stock Purchase Program
    • Company Equity
    • 401(K) With Company Matching
    • Financial Counseling
  • Professional Development

    • Shadowing Opportunities
    • Access to Online Courses
    • Promote From Within
    • Learning and Development Stipend
    • Tuition Reimbursement
    • Mentor Program
    • Leadership Training Program
    • Associate or Rotational Training Program
    • Lunch and Learns
    • Internship Program
    • Professional Coaching
  • Diversity and Inclusion

    • Diversity, Equity, and Inclusion Program
    • Employee Resource Groups (ERG)