Cerebras Systems Logo

Cerebras Systems

Sr. Deployment Engineer, AI Inference

Reposted 12 Days Ago
Easy Apply
In-Office or Remote
2 Locations
Senior level
Easy Apply
In-Office or Remote
2 Locations
Senior level
The Deployment Engineer will build and operate AI inference clusters, ensure scalable deployments, optimize allocation, and maintain infrastructure. Responsibilities include software updates, telemetry development, and collaborative improvements with teams.
The summary above was generated by AI

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.  

Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.

About Us

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.   

Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In 2024, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services. 

About The Role 

We are seeking a highly skilled and experienced Sr. Deployment Engineer to build and operate our cutting-edge inference clusters. These clusters would provide the candidate an opportunity to work with the world's largest computer chip, the Wafer-Scale Engine (WSE), and the systems that harness its unparalleled power.  

You will play a critical role in ensuring reliable, efficient, and scalable deployment of AI inference workloads across our global infrastructure. On the operational side, you’ll own the rollout of the new software versions and AI replica updates, along the capacity reallocations across our custom-built, high-capacity datacenters. 
 
Beyond operations, you’ll drive improvements to our telemetry, observability and the fully automated pipeline. This role involves working with advanced allocation strategies to maximize utilization of large-scale computer fleets.  

The ideal candidate combines hands-on operation rigor with strong systems engineering skills and thrives on building resilient pipelines that keep pace with cutting-edge AI models. 

This role does not require 24/7 hour on-call rotations. 

 
 Responsibilities 

  • Deploy AI inference replicas and cluster software across multiple datacenters 
  • Operate across heterogeneous datacenter environments undergoing rapid 10x growth 
  • Maximize capacity allocation and optimize replica placement using constraint-solver algorithms 
  • Operate bare-metal inference infrastructure while supporting transition to K8S-based platform 
  • Develop and extend telemetry, observability and alerting solutions to ensure deployment reliability at scale 
  • Develop and extend a fully automated deployment pipeline to support fast software updates and capacity reallocation at scale 
  • Translate technical and customer needs into actionable requirements for the Dev Infra, Cluster, Platform and Core teams 
  • Stay up to date with the latest advancements in AI compute infrastructure and related technologies.  

Skills And Requirements 

  • 5-7 years of experience in operating on-prem compute infrastructure (ideally in Machine Learning or High-Performance Compute) or id developing and managing complex AWS plane infrastructure for hybrid deployments 
  • Strong proficiency in Python for automation, orchestration, and deployment tooling 
  • Solid understanding of Linux-based systems and command-line tools 
  • Extensive knowledge of Docker containers and container orchestration platforms like K8S 
  • Familiarity with spine-leaf (Clos) networking architecture 
  • Proficiency with telemetry and observability stacks such as Prometheus, InfluxDB and Grafana 
  • Strong ownership mindset and accountability for complex deployments 
  • Ability to work effectively in a fast-paced environment.  

Location  

  • SF Bay Area. 
  • Toronto
  • Remote

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection  point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU.
  2. Publish and open source their cutting-edge AI research.
  3. Work on one of the fastest AI supercomputers in the world.
  4. Enjoy job stability with startup vitality.
  5. Our simple, non-corporate work culture that respects individual beliefs.

Read our blog: Five Reasons to Join Cerebras in 2025.

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Top Skills

Docker
Grafana
Influxdb
K8S
Linux
Prometheus
Python

Similar Jobs

16 Hours Ago
Easy Apply
Remote or Hybrid
6 Locations
Easy Apply
146K-222K Annually
Senior level
146K-222K Annually
Senior level
Fintech • HR Tech
The Staff Product Designer will lead the design of user-centric solutions for complex tax credit systems at Gusto, driving design strategy, collaboration with cross-functional teams, and user research.
Top Skills: Design SystemsProduct DesignUx Research
16 Hours Ago
Easy Apply
Remote or Hybrid
4 Locations
Easy Apply
166K-240K Annually
Senior level
166K-240K Annually
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
As a Solutions Architect at Coda, you will design and implement solutions for enterprise customers, focusing on business outcomes through Coda's platform, collaborating with cross-functional teams to optimize processes and drive success.
Top Skills: AirtableAPIsCodaDatabase ArchitectureExcelLow-Code ToolsNo-Code ToolsSheetsZapier
16 Hours Ago
Easy Apply
Remote or Hybrid
4 Locations
Easy Apply
191K-290K Annually
Senior level
191K-290K Annually
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
The Manager of Solutions Architecture leads a team to optimize customer onboarding and technical implementation of Superhuman's AI tools, ensuring client success through effective communication and technical excellence.
Top Skills: APIsEntra IdGoogle WorkspaceJAMFLinuxmacOSOktaSAMLSccmScimWindows

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account