Netomi Logo

Netomi

Lead / Senior Product Manager Analytics, Evals & Conversational BI (Agentic Studio)

Posted 17 Days Ago
In-Office or Remote
Hiring Remotely in Toronto, ON
Senior level
In-Office or Remote
Hiring Remotely in Toronto, ON
Senior level
Lead the product development of analytics and conversational BI for agentic customer experiences. Collaborate with Data Science and Engineering to establish usability and governance metrics, ensuring effective enterprise analytics applications.
The summary above was generated by AI
About the Company:
Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and simple, scalable management of AI agents for any CX use case. Backed by WndrCo, Y Combinator, and Index Ventures, we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences.

Want to be part of the AI revolution and transform how the world’s largest global brands do business? Join us!

About the Role
Netomi is hiring a Lead/Senior Product Manager to own the Analytics, Reporting, and Conversational BI product surfaces in Agentic Studio—the measurement and trust layer that helps enterprises build, operate, and continuously improve agentic customer experiences across chat, mobile, email, messaging, and voice/IVR. In mission‑critical environments (airlines, retail, banking, gaming), analytics is not a “dashboard”; it’s the control plane for reliability, governance, and outcomes. You will lead the productization of end-to-end analytics including real-time operational monitoring, historical reporting, LLM quality/evaluation (autoevals), observability for tool calling and workflows, and Conversational BI (natural language exploration over a governed metrics model). This role requires deep domain fluency in data science, data preparation, analytics systems, and the realities of LLM-driven systems (probabilistic outputs, evaluation, safety/guardrails, and runtime tracing)—combined with strong product craft, design sense, and delivery execution. This is an opportunity to lead with data at the frontier: partnering with internal Data Science and Engineering teams while collaborating with frontier model and cloud ecosystem partners to deliver best-in-class analytics and governance for enterprise agentic AI.

Responsibilities

  • Define and execute the Analytics/Evals/Governance roadmap with clear sequencing (MVP → v1 → v2) and measurable adoption targets.
  • Partner deeply with Data Science to productize evaluation methodology (what we score, how we calibrate, how we prevent “gaming,” how we track drift).
  • Partner with Engineering and Observability teams to standardize telemetry (tool spans, workflow transitions, model calls, cost/latency metrics) and make it usable in product.
  • Drive a cohesive Agentic Studio UX across Build / Operate / Improve workflows: dashboards, drill-downs, investigation flows, alerts, and remediation actions.
  • Establish objective success metrics and instrument them end-to-end (data correctness, timeliness, reliability, and customer impact).
  • Work with Delivery/CS and enterprise partners to ensure analytics is usable for real operational processes: incident response, change management, governance reviews, and quarterly business reviews.

Requirements

  • Bachelor’s degree in Computer Science, Data Science, Engineering, Statistics, or a related quantitative/technical field (Master’s a plus).
  • 6–10+ years of experience across Product Management and/or Data Science/Analytics leadership, including shipping analytics products to enterprise users.
  • Demonstrated depth in: data modeling, telemetry/event schemas, ETL/ELT concepts, and analytics correctness.
  • Building operational + business reporting (real-time monitoring and historical analytics).
  • Experimentation and measurement design (A/B testing concepts, uplift measurement, cohorting).
  • Strong hands-on experience applied to AI/LLM or data science platforms, including at least several of:
  • LLM evaluation methods (automated scoring, multi-turn evaluation, calibration).
  • Observability for probabilistic systems (quality + latency + cost).
  • Tool calling / workflow execution analytics and failure taxonomy.
  • Governance measurement (policy outcomes, escalation triggers, compliance reporting).
  • Strong product craft: UX and information architecture instincts, ability to design operator workflows, and capability packaging that scales across customers.

Preferred Qualification

  • Experience building analytics for multi-tenant SaaS and regulated customers (auditability, RBAC, retention controls, privacy-by-design).
  • Familiarity with cloud analytics stacks and enterprise BI integration patterns.
  • Experience partnering with major cloud and frontier AI vendors (model providers, observability stacks, data platforms) to ship joint capabilities.
  • Experience with contact center / CX metrics (containment, resolution, AHT, CSAT, handoff performance) and multi-channel operations (voice + digital).

Netomi is an equal opportunity employer committed to diversity in the workplace. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, disability, veteran status, and other protected characteristics.

Top Skills

AI
Analytics
Bi Integration
Cloud Analytics
Data Science
Elt
ETL
Llm Evaluation Methods

Similar Jobs

2 Hours Ago
Remote
Canada
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Join Atlassian to engage with enterprise customers, build solutions, collaborate with sales teams, and showcase the value of Atlassian products in a pre-sales context.
Top Skills: Atlassian Software ProductsPre-SalesSolutions
2 Hours Ago
Remote or Hybrid
ON, CAN
115K-165K Annually
Mid level
115K-165K Annually
Mid level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design and implement scalable Kubernetes platforms, optimize infrastructure reliability, mentor engineers, and evaluate open-source technologies.
Top Skills: Amazon Web ServicesArgoBashCiliumClusterapiFluxcdHelmKubernetesPythonRook
2 Hours Ago
Remote or Hybrid
ON, CAN
Mid level
Mid level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Technical Writer II, you'll create product documentation, collaborating with teams to ensure clarity and comprehensibility for customers. You'll manage projects independently, develop product knowledge, and tailor content for users.
Top Skills: DitaGitOxygen Xml EditorXML

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account