Product Manager, Specialist – Generative AI

The Product Manager, Specialist – Generative AI will lead the evolution and scale of this AI-powered conversational experience. This role owns end-to-end for multiple domains, from problem discovery and experimentation through pilot, rollout, and governance.

The Specialist will identify high-impact AI opportunities (domain), define strategy, establish evaluation and monitoring frameworks, and design human oversight mechanisms appropriate for a regulated financial environment. The role requires strong product fundamentals combined with a working knowledge of Generative AI principles like LLM’s, SLM’s, conversational design, evaluation techniques, and AI safety considerations.

This individual treat trust, safety, and continuous learning as core product features, not afterthoughts.

Core Responsibilities:

Strategic Product Leadership

1. Lead product management efforts across one or more strategic domains.

2. Identify and prioritize high-impact AI use cases that expand the AI assistant’s value to clients and internal stakeholders.

3. Work with senior product leadership along with peers leading other domain work to evolve its product vision, roadmap, and measurable success outcomes including quality, trust, adoption, and business impact.

AI Product Lifecycle Management

4. Drive initiatives through discovery, feasibility assessment, experimentation, pilot, and scale.

5. Validate that Generative AI is the appropriate solution versus deterministic or rules-based approaches.

6. Define measurable quality bars and acceptance criteria for it’s outputs, including accuracy, completeness, compliance, explainability, and latency.

Evaluation and Model Performance

7. Establish evaluations for your domain area including ground truth creation, annotation strategies, precision and recall trade-offs, and continuous model monitoring.

8. Partner with data science and engineering to track model performance, drift, hallucinations, confidence thresholds, and flagged interactions.

9. Translate model behavior and evaluation results into actionable product decisions and iteration plans.

Human Oversight and Responsible AI

10. Continue to work with other product teams to manage human-in-the-loop systems, including review workflows, escalation paths, and confidence gating.

11. Collaborate closely with Legal, Compliance, Risk, and Data Governance to ensure appropriate disclosures, guardrails, and privacy controls are embedded from inception.

12. Define acceptable versus unacceptable use cases and ensure outputs align with enterprise standards for safety, transparency, and explainability.

UX and Conversational Experience

13. Partner with UX and prompt engineers to design this AI assistant’s conversational experience, reducing ambiguity and supporting recovery from misunderstandings.

14. Balance accuracy, latency, and client trust in its conversational flows.

15. Leverage user feedback, flagged conversations, and behavioral metrics to continuously refine the AI assistant’s experience.

Cross-Functional Collaboration

16. Work closely with engineering, data science, UX, legal, compliance, operations, and business stakeholders to align on priorities and deliverables.

17. Translate strategy into clear requirements, experiments, and execution plans.

18. Participate in ongoing planning, departmental prioritization activities, and enterprise AI strategy discussions as required.

This AI assistant serves as the foundation for Vanguard’s broader AI-powered client experience strategy.

Qualifications:

• 5 years related work experience. 2 years of leading large cross-functional teams on major organizational projects preferred.

• Product Management experience utilizing GenAI

Preferences:

• Undergraduate degree or equivalent combination of training and experience required. Graduate degree preferred.

Special Factors

Sponsorship

About Vanguard

At Vanguard, we don't just have a mission—we're on a mission.

To work for the long-term financial wellbeing of our clients. To lead through product and services that transform our clients' lives. To learn and develop our skills as individuals and as a team. From Malvern to Melbourne, our mission drives us forward and inspires us to be our best.

How We Work

Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.