Gen AI Lead Consultant

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.

Job Description
The Software Engineer Lead Consultant architects and designs their digital products using modern tools, technologies, frameworks, and systems. They apply a systematic application of scientific and technological knowledge, methods, and experience to the design, implementation, testing, and documentation of software. They own and manage running their application in production, and ultimately becomes accountable for the success of their digital products through achieving KPIs.

About the Role

We are looking for a Generative AI Software Engineer to join our team and help build next-generation AI-driven solutions. This role blends traditional Software engineering with cutting-edge AI integration, enabling innovative digital products and services. You will work closely with cross-functional teams to design, develop, and deploy secure, scalable applications and integrate advanced AI models into production environments.

Key Responsibilities

Sofware Engineering

• Build secure, scalable, and high-performance microservices and applications using Java Spring Boot / Python.
• Design and maintain RESTful APIs and microservices architecture with asynchronous processing.
• Deploy and manage applications on cloud platforms, preferably Microsoft Azure.

• Integrate and deploy Generative AI models (e.g., OpenAI, Hugging Face, LangChain) into production environments.
• Optimize LLMs for specific use cases and implement RAG (Retrieval-Augmented Generation) pipelines.
• Work with embedding models, vector databases, and prompt engineering techniques.
• Explore multi-modal AI systems and agentic AI frameworks for advanced capabilities.

• Leverage tools like GitHub Copilot and agentic AI for code reviews, unit testing, and pull requests.
• Leverage APM tools like DataDog to enhance Observability posture for your application.
• Collaborate with platform consultants, product engineers, and digital product managers to integrate AI solutions.

• Implement best practices for model deployment, scaling, versioning, and monitoring.
• Develop and maintain scalable data pipelines for ingestion, processing, and feature engineering.
• Ensure compliance with ethical AI standards and data governance as per Allstate standards.

• 3+ years of backend development experience using Java Spring Boot / Python.
• Strong understanding of RESTful APIs, microservices architecture, and asynchronous processing.
• Experience working with Generative AI APIs and/or open-source models.
• Knowledge of LangChain, LLM orchestration, and prompt engineering.

• Exposure to multi-modal AI systems and agentic AI frameworks.
• Experience with MLOps workflows and cloud deployment (Azure/AI Foundry preferred).
• Strong problem-solving and debugging skills.

• Knowledge of ethical AI practices and compliance frameworks.
• Familiarity with data preprocessing, token management, and embedding generation.