Medallion Logo

Medallion

Director of Engineering, AI Platform

Posted 2 Days Ago
Remote
Hiring Remotely in USA
Expert/Leader
Remote
Hiring Remotely in USA
Expert/Leader
Lead the Applied AI & Data Platform team to turn LLMs and point solutions into production-grade agents and data systems. Own AI roadmap, production reliability (evals, observability, HITL), data pipelines and tooling, and scale the org by hiring and mentoring managers and senior engineers to ship safe, measurable AI outcomes.
The summary above was generated by AI
About Medallion:

At Medallion, we believe healthcare teams should focus on what truly matters - delivering exceptional patient care. That’s why we’ve built a leading provider operations platform to eliminate the administrative bottlenecks that slow healthcare organizations down. By automating licensing, credentialing, payer enrollment, and compliance monitoring, Medallion empowers healthcare operations teams to streamline their workflows, improve provider satisfaction, and accelerate revenue generation, all while ensuring superior patient outcomes.

As one of the fastest-growing healthcare technology companies - ranked #3 on Inc. Magazine’s 2024 Fastest-Growing Private Companies in the Pacific Region, #5 on LinkedIn's 2024 Top US Startups, a Glassdoor Best Place to Work in 2024 & 2025, and featured on The Today Show - Medallion is revolutionizing provider network management. Our CEO, Derek Lo, has been named one of the Top 50 Healthcare Technology CEOs of 2024 by The Healthcare Technology Report. Backed by $130M in funding from world-class investors like Sequoia Capital, Google Ventures, Optum Ventures, Salesforce Ventures, Acrew Capital, Washington Harbour, and NFDG, we’re on a mission to transform healthcare at scale.

The Role

We're looking for a Director of Engineering to lead our Applied AI & Data Platform organization, the group turning today's best models into reliable agents that do real administrative work, plus the data systems behind them. You'll report to the CTO and lead a growing org of engineering managers, staff engineers, ML engineers, and data specialists. You'll work with Product, Operations, and our domain experts to decide where AI creates lasting advantage for Medallion.

You'll scale what's already working. We've built the point solutions: LLM inference and model lifecycle, voice agents, document and data-extraction pipelines, early evals. Your job is to turn them into a platform, with shared tooling, rigorous evaluation, scalable data ops, and a repeatable way to ship new agents safely.

We want someone who's here to build an AI practice, driving real outcomes, not bolt features onto a product.

What You'll Do
  • Own the AI roadmap. Set direction across our AI surfaces: voice and computer-use agents that work payers and provider portals, email triage, and the models that extract and structure data from clinical and legal documents. The build-vs-buy and fine-tune-vs-prompt calls are yours.
  • Push AI deeper. Take our systems from assisting people, to making decisions, to running whole service requests, and into licensing, enrollment, monitoring, and the customer-facing product.
  • Make it production-grade. Build the evals, observability, and human-in-the-loop systems that let us ship models and agents we'll stand behind and back with guarantees.
  • Lead the data platform. Own the pipelines, datasets, and tooling behind the models. Our real-world data is our biggest advantage, so make it fast to use and trustworthy to build on.
  • Build the org. Hire and grow managers and senior engineers, set the structure, and hold the bar as we scale. Stay close enough to the work to earn their trust in a design review.
What We're Looking For
  • Manager of managers. 10+ years across engineering, ML, or data science, with experience leading a multi-team org through other managers.
  • Breadth across functions. You've run a mix of disciplines, including engineering, ML, data science, and data labeling or human-in-the-loop operations, rather than a single eng team.
  • Shipped ML/AI at scale. You've put applied ML and LLM systems into production, with the teams to back them, well beyond prototypes and research.
  • Hands-on AI depth. You understand LLMs, agents, retrieval, and structured extraction well enough to set direction, and you know what production reliability actually takes.
  • Data platform strength. You're grounded in the data and infrastructure side: pipelines, orchestration, inference, and the eval and observability tooling that supports ML.
  • Owns the outcome. You weigh speed, cost, quality, and risk, and you take accuracy seriously where mistakes have real consequences.
Why Join

The healthcare back office is about to be reinvented, and we're the ones doing it. We started with licensing, credentialing, and enrollment, but the ambition is bigger: every workflow we automate earns the right to take on the next, until we run the back office end to end. It's the kind of problem applied AI is finally good enough for, and we're positioned to do it. 300+ organizations run on Medallion today, which gives us proprietary data, verifiable ground truth, and tight production feedback loops, plus the domain expertise and funding to go after it properly.

Getting there means applying ML and AI across more of the back office, a data platform that makes those systems reliable, and the team to build it all.

 
#LI-Remote

We prioritize candidate safety. Please be aware that official communication will only come from @medallion.co email addresses.

Similar Jobs

9 Hours Ago
In-Office or Remote
Home, TN, USA
175K-335K Annually
Expert/Leader
175K-335K Annually
Expert/Leader
Fitness • Healthtech • Retail • Pharmaceutical
Lead design, build, and operation of an on-prem AI compute platform (GPU, storage, network, Kubernetes/OpenShift). Establish SRE practices, 24/7 operations, observability, security/compliance, vendor and budget ownership, and hire and develop teams to ensure >99.99% availability and long-term operational sustainability.
Top Skills: Bare-Metal KubernetesBase Command ManagerCisco UcsDistributed Nvme StorageEcnEvpn-VxlanGpu ClustersInfinibandInfrastructure-As-CodeNvidia Ai EnterpriseNvidia BlackwellNvidia DgxNvidia HgxOpenshiftPfcRoce V2Run:AiSpine-Leaf TopologyVast
14 Days Ago
In-Office or Remote
2 Locations
180K-190K Annually
Expert/Leader
180K-190K Annually
Expert/Leader
Fintech • Insurance • Financial Services
Lead design, build, and operation of production-grade AI platform services (LLM apps, RAG, agentic workflows, vector search). Establish reusable APIs, CI/CD and MLOps practices, monitoring, governance, and secure data integration with Databricks/Snowflake. Partner with risk/compliance, mentor engineering teams, and drive enterprise adoption and cost-optimized AI operations in a regulated financial services environment.
Top Skills: APIsArtifact RegistryAzure AiCi/Cd For MlCopilot StudioDatabricksKnowledge GraphsLlmMicroservicesMlopsModel RegistryModel ServingPrompt EngineeringRetrieval-Augmented Generation (Rag)Semantic SearchSnowflakeVector DatabaseVector Search
22 Days Ago
Remote
USA
213K-284K Annually
Expert/Leader
213K-284K Annually
Expert/Leader
Fashion
Lead the engineering organization for data and AI platforms, making architectural decisions and driving product vision while managing teams and aligning with business priorities.
Top Skills: AirflowApache IcebergAWSDelta LakeFlinkKafkaKubernetesPrestoRay ServeSparkTrinoTriton

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account