Runpod Logo

Runpod

Site Reliability Engineer

Posted An Hour Ago
Easy Apply
Remote
Hiring Remotely in USA
150K-200K Annually
Senior level
Easy Apply
Remote
Hiring Remotely in USA
150K-200K Annually
Senior level
Ensure stability and resilience of Runpod's distributed AI platform by defining SLIs/SLOs, leading incident response, building observability and reliability tooling, automating operational workflows, and partnering with engineering teams to reduce toil and improve production readiness.
The summary above was generated by AI

Runpod is the AI Developer Cloud. More than one million developers, from indie researchers to teams running frontier models in production, use Runpod to experiment, train, fine-tune, deploy, and scale AI on one platform. The platform has processed more than 20 billion inference requests. We closed a $100M Series A in June 2026. We're at an inflection point for AI infrastructure, and we're building the platform the next generation of developers will depend on.

 

We're a small, remote-first team. We take ownership seriously, move fast, and ship work that more than a million developers rely on every day. We're looking for people who care deeply, build with urgency, and want to matter at scale.

 

Learn more in our CEO's funding announcement: https://www.runpod.io/blog/one-million-developers.

The Reliability team owns the availability, performance, and operational excellence of Runpod’s global platform. While infrastructure teams build the systems, the Reliability team ensures those systems remain resilient, observable, and scalable under real-world production conditions.

This team is responsible for:

  • Defining and enforcing reliability standards across engineering

  • Designing incident response processes and improving recovery times

  • Building observability systems and reliability tooling

  • Driving SLO adoption and production readiness reviews

  • Reducing operational toil through automation

The Reliability team works cross-functionally with Infrastructure, Product Engineering, and Support to ensure our systems remain stable and performant as we scale rapidly. We value proactive problem solving, automation-first thinking, and strong ownership of production systems.

As a Site Reliability Engineer on the Reliability team, you will focus on ensuring the stability and resilience of Runpod’s distributed platform. You will partner with engineering teams to improve system design, strengthen observability, and prevent incidents before they happen.

This role blends software engineering with production operations. You’ll work on reliability frameworks, SLO design, automation, and production hardening, reducing errors and improving performance across different services and infrastructure.

This is a high-impact role central to maintaining trust with developers running critical AI workloads on Runpod.

Your Impact

  • Increase platform uptime and reduce incident frequency and duration

  • Establish and operationalize SLIs/SLOs across services

  • Improve MTTR through better tooling, automation, and runbooks

  • Strengthen production readiness standards

  • Drive long-term systemic reliability improvements

You will influence how reliability is defined and measured across Runpod and help build the operational backbone of the company.

Responsibilities:

Reliability Engineering

  • Define and implement SLIs/SLOs for critical services

  • Lead incident response and coordinate cross-team mitigation efforts

  • Conduct blameless postmortems and ensure corrective actions are completed

  • Perform production readiness reviews for new services and features

  • Identify systemic risks and drive preventative improvements

Observability & Monitoring

  • Design and improve monitoring, alerting, and dashboards (Prometheus, Grafana, etc.)

  • Improve signal-to-noise ratio in alerts and reduce alert fatigue

  • Build internal tooling for reliability tracking and reporting

  • Improve visibility into GPU performance and distributed systems health

Automation & Toil Reduction

  • Automate recurring operational workflows

  • Build tools and scripts (Python, Go, Bash) to eliminate manual processes

  • Improve deployment safety through automation and guardrails

  • Strengthen CI/CD reliability and release processes

Cross-Functional Reliability Advocacy

  • Partner with engineering teams to improve system resilience

  • Provide guidance on fault tolerance, scalability, and failure handling

  • Contribute to architectural discussions with a reliability-first mindset

Requirements:

  • 5+ years of experience in SRE, Reliability Engineering, or Production Engineering

  • Strong Linux systems and Networking expertise

  • Experience managing containerized production systems

  • Strong understanding of distributed systems and failure modes

  • Experience defining and managing SLIs/SLOs

  • Proven incident response and postmortem leadership experience

  • Strong scripting or programming skills

  • Experience with monitoring and alerting systems

  • Excellent written communication skills

  • Successful completion of a background check

Preferred:

  • Experience with GPU infrastructure or AI/ML platforms

  • Experience improving reliability in high-growth or large scale environments

  • Familiarity with GPU observability tooling

  • Experience with Infrastructure as Code

  • Experience working in startup environments

  • Experience building internal reliability platforms or frameworks

What You’ll Receive:

  • The competitive base pay for this position ranges from $150,000- $200,000 usd. This salary range may be inclusive of several career levels at Runpod and will be narrowed during the interview process based on a number of factors, including the candidate’s experience, qualifications, and location

  • Meaningful equity in a fast-growing company- everyone on the team receives stock options — your impact drives our growth, and you share in the upside.

  • Generous medical, dental & vision plans

  • Flexible PTO- take the time you need to recharge

  • Most roles are remote work first with an inclusive, collaborative teams utilizing slack as the main form of internal communication 

  • Join a passionate team on the cutting edge of AI infrastructure — where culture, learning, and ownership are at the heart of how we scale.

Runpod is committed to maintaining a workplace free from discrimination and upholding the principles of equality and respect for all individuals. We believe that diversity in all its forms enhances our team. As an equal opportunity employer, Runpod is committed to creating an inclusive workforce at every level. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, protected veteran status, disability status, or any other characteristic protected by law. We welcome every qualified candidate eligible to work in the United States; however, we are currently unable to sponsor employment visas.

 

Similar Jobs at Runpod

Yesterday
Easy Apply
Remote
USA
Easy Apply
225K-325K Annually
Senior level
225K-325K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead and scale core cloud and bare-metal infrastructure including SRE, global and HPC networking, and distributed storage. Define SLOs/SLAs, incident response, observability, and IaC. Architect InfiniBand/RoCE networks and high-performance storage to support large GPU workloads. Hire and mentor managers and senior ICs, partner with product and program teams to forecast capacity and drive reliability, throughput, and low-latency infrastructure at scale.
Top Skills: AnsibleBare-MetalBgpCephContainer OrchestrationInfinibandInfrastructure As CodeKubernetesLustreNvlinkNvme-OfObservabilityRdmaRoceSpine-Leaf ArchitectureTerraformWeka
Yesterday
Easy Apply
Remote
USA
Easy Apply
225K-325K Annually
Senior level
225K-325K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead and scale core cloud and bare-metal infrastructure teams (SRE, networking, storage). Own SLA/SLOs, incident response, observability, and automated remediation. Architect and operate ultra-low-latency HPC networks (InfiniBand/RoCE, BGP) and high-performance distributed storage (Ceph, Lustre, NVMe-oF). Hire and mentor engineering managers and senior ICs, partner with Product and PM to forecast capacity and shape roadmaps, and drive measurable reliability and delivery improvements.
Top Skills: AnsibleBgpCephInfinibandKubernetesLustreNvlinkNvme-OfRdmaRoceTerraformWeka
2 Days Ago
Easy Apply
Remote
USA
Easy Apply
125K-220K Annually
Senior level
125K-220K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Own end-to-end product design for Runpod's AI infrastructure platform, turning complex workflows (compute, deployment, storage, networking, billing, observability, model ops) into intuitive, polished experiences. Rapidly identify UX problems, prototype high-fidelity designs, define design systems, partner with Engineering and Product, and use user research and analytics to iterate and raise product craft and developer trust.
Top Skills: Ai/MlAPIsCloud PlatformsDevOpsFront-EndObservability

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account