Staff Data & AI Platform Engineer, MLOps

Teladoc Health is a global, whole person care company made up of a diverse community of people dedicated to transforming the healthcare experience. As an employee, you’re empowered to show up every day as your most authentic self and be a part of something bigger – thriving both personally and professionally. Together, let’s empower people everywhere to live their healthiest lives.

Summary of Position

We are seeking a Staff Platform Engineer – Data & AI Platform to lead the design, deployment, and operationalization of scalable machine learning (ML) and large language model (LLM) infrastructure across Azure ML, Databricks, Snowflake, and Terraform. This role is responsible for defining and executing MLOps/LLMOps strategies, integrating ML workflows with Snowflake, and building robust CI/CD pipelines for AI infrastructure.

The ideal candidate will have 8+ years of experience in ML platform engineering, including hands-on expertise with Azure ML, Databricks, Snowflake ML features, and Terraform automation. The Staff Platform Engineer will drive AI platform roadmaps, optimize model performance, and ensure operational maturity across ML environments. Strong skills in infrastructure as code, container orchestration, and model governance are essential.

Essential Duties and Responsibilities

• Manage and mentor team members on advanced Azure ML, Databricks, MLflow, and Terraform implementations.

• Lead the implementation and optimization of AI platforms, including Azure OpenAI, Snowflake ML, and LLM deployment strategies.

• Define long-term MLOps/LLMOps vision and drive platform roadmaps focused on scalability, reliability, and compliance.

• Architect scalable ML environments, including compute optimization, model serving, and reusable Terraform modules.

• Build and deploy CI/CD pipelines for Azure ML, Databricks, Snowflake ML workflows, and containerized ML applications.

• Provide technical oversight for ML workspace structures, data pipeline dependencies, and infrastructure automation.

• Document architecture patterns, integration standards, and infrastructure specifications.

• Deliver internal training on MLOps best practices and AI platform tools.

• Analyze model performance, inference latency, and infrastructure issues to implement preventive measures.

• Ensure operational maturity across AI platforms, maintaining security compliance and model governance.

• Participate in 24x7 on-call rotation for AI platform incident escalation.

• Collaborate with Security and Cloud Ops on ML security, governance, and compliance frameworks.

The time spent on each responsibility reflects an estimate and is subject to change dependent on business needs.

Supervisory Responsibilities

No

Qualifications Expected for Position

• Bachelor’s degree in Computer Science, Engineering, or related field; equivalent work experience is acceptable.

• 8+ years of experience with Azure ML, Databricks, Terraform, and ML application deployment integrating into modern data lake platforms.

• Proven experience in MLOps/LLMOps architecture and AI platform development.

• Expertise in CI/CD pipeline design using GitHub Actions, Azure DevOps, MLflow, and/or Terraform Cloud.

• Infrastructure as Code proficiency with Terraform for Azure ML, Azure AI Foundry, AWS Bedrock, and/or AKS provisioning.

• Containerization and orchestration using Docker, Kubernetes, and/or Azure Container Services.

• ML observability using OpenTelemetry and Azure Monitor for drift detection and performance tracking.

• Experience with LLM frameworks (LangChain, OpenAI APIs, Azure OpenAI), vector databases, and RAG implementation.

• Familiarity with AI ethics compliance, model governance, and regulated industry ML requirements.

Bonus Qualifications

• Excellent communication skills for translating technical concepts to diverse audiences.

• Strong problem-solving and critical thinking abilities.

• Self-starter with initiative and motivation to drive innovation.

• Databricks, Azure ML and/or AI certifications preferred.

The base salary range for this position is $145,000-$165,000. In addition to a base salary, this position is eligible for a performance bonus and benefits (subject to eligibility requirements) listed here: Teladoc Health Benefits 2025. Total compensation is based on several factors including, but not limited to, type of position, location, education level, work experience, and certifications. This information is applicable for all full-time positions.

#LI-SS2 #LI-Remote

Teladoc Health will not sponsor or transfer employment work visas for this position. Applicants must be currently authorized to work in the United States without the need for visa sponsorship now or in the future.