NVIDIA Logo

NVIDIA

Principal System Cloud Architect

Posted 5 Days Ago
Be an Early Applicant
Remote
2 Locations
272K-426K
Expert/Leader
Remote
2 Locations
272K-426K
Expert/Leader
Lead the architectural vision for NVIDIA's GPU IaaS offerings, define scalable designs, collaborate with partners, and make impactful architectural decisions for high-performance cloud infrastructure.
The summary above was generated by AI

We are seeking a Principal System Architect to lead the architectural vision for NVIDIA’s GPU Infrastructure-as-a-Service (IaaS) offerings. This strategic role focuses on defining reference architectures and system blueprints that integrate NVIDIA’s latest innovations — including GB200 Grace Blackwell systems, Spectrum-X, Bluefield, InfiniBand, Storage (Block, File, Object), and AI Enterprise software stacks — into scalable, high-performance cloud infrastructure for on-prem, Neo Clouds, and CSPs.

This role requires deep engagements across hardware, networking, orchestration, and partner ecosystems to define the future of GPU cloud services.

What you’ll be doing:
  • Architect Future-Ready GPU Infrastructure

  • Define scalable, secure, and efficient architectures for GPU-based IaaS using NVIDIA’s full stack: DGX/HGX, GB200, NVLink/NVSwitch, InfiniBand, and Spectrum-X.

  • Lead Reference Architecture Development

  • Work with internal engineering, cloud partners, and OEMs to define and publish validated reference architectures covering bare-metal provisioning, virtualization, storage fabrics, and networking.

  • Drive End-to-End Cloud Infrastructure Strategy

  • Architect solutions for bare-metal-as-a-service, VMaaS, and container orchestration (Kubernetes), integrated with virtual networking (VPCs), Infiniband fabrics, high-performance storage, and AI workloads.

  • Influence Product Strategy Across Domains

  • Partner with silicon, platform, networking, and software teams to ensure alignment of architecture with NVIDIA’s roadmap for GPU, DPU, and AI services.

  • Engage with Ecosystem Partners

  • Represent NVIDIA in joint solution development with CSPs, OEMs, and hyperscale customers to align infrastructure strategies and deployment practices.

  • Evaluate Trade-Offs and Drive Decisions

  • Make high-impact architectural decisions across performance, scalability, multi-tenancy, power efficiency, and manageability

What we need to see:
  • 15+ years in system architecture, with deep experience in cloud-scale infrastructure, HPC, or AI platforms.

  • Proven expertise in GPU platforms, data center networking (InfiniBand, RoCE, Spectrum), virtual networking, storage, and orchestration technologies.

  • Strong understanding of Kubernetes, VM provisioning, bare-metal provisioning, and infrastructure automation.

  • MS or PhD in Computer Engineering, Electrical Engineering, related field, or equivalent experience..

  • Demonstrated ability to define, document, and present architectural designs and influence cross-functional teams.

Ways to stand out from the crowd:
  • Experience with NVIDIA technologies such as DGX, HGX, GB200, NVLink, NVSwitch, BlueField, Magnum IO, and Spectrum-X.

  • Deep knowledge of AI/ML workloads, distributed training architectures, and GPU scheduler integration.

  • Familiarity with CSP environments (AWS, Azure, OCI, GCP) and hybrid/multi-cloud architectures.

  • Participation in open standards and industry bodies (e.g., OCP, CNCF, Kubernetes SIGs).

With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers; we have some of the most forward-thinking and hardworking people in the world working for us and, due to unparalleled growth, our outstanding teams are rapidly growing.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 425,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 24, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

Dgx
Gb200
Gpu Infrastructure-As-A-Service
Hgx
Infiniband
Kubernetes
Nvlink
Nvswitch
Spectrum-X

Similar Jobs

12 Hours Ago
Remote or Hybrid
Atlanta, GA, USA
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Seeking a Lead Client Director to manage executive relationships, drive multi-year transformation initiatives, and oversee strategic account planning to foster business growth.
12 Hours Ago
Remote or Hybrid
Chicago, IL, USA
170K-298K Annually
Expert/Leader
170K-298K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Director will manage release and deployment processes, lead a team, define release vision and metrics, and ensure efficient delivery of software releases.
Top Skills: Agile MethodologiesCi/Cd PipelinesCloud PlatformsDevops PracticesItsm PlatformsSource Control
12 Hours Ago
Remote or Hybrid
Memphis, TN, USA
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Client Director will manage relationships with major clients like FedEx, lead teams to develop solutions, and achieve financial targets.
Top Skills: AIIt Service Management

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account