System Software Engineer, Platform Compute

For over 25 years, NVIDIA has pioneered visual and accelerated computing. Today, we're defining the future of AI, equipping millions with groundbreaking tools and essential training to lead a new era of innovation. Every month, NVIDIA’s training platform enables thousands of developers around the world to advance their AI skills and excel in their life’s work. We're seeking a foundational System Software Engineer to ensure the 24/7 operation, maintenance, and scaling of a multi-cloud and multi-architecture training delivery platform across 3-4 CSPs and ~50 regions. Your work will be instrumental in managing substantial operational expenditure, optimizing cost per learner, and preventing compute capacity shortages amidst a rapidly expanding user base and potential 10x increase in training demand.

Join a close-knit team where your contributions truly matter. As a core member of our learning systems platform team, you'll partner with experts and creative educators, setting the standard for scalable, reliable learning experiences. You'll play a crucial role in making our purpose-built Learning Management System (LMS) platform a delightful and efficient tool that empowers both learners and instructors. Are you driven to build platforms that open the door to new careers? Do you thrive on creating systems that enable people to confidently apply advanced tools in their work? Want to be at the heart of making pivotal technologies like generative AI accessible and profoundly learnable for everyone? If so, let’s talk!
 

What you’ll be doing:

• Building systems to support the maintenance, scaling, and operation of diverse, global compute platforms spanning multiple cloud providers.

• Driving continuous cost optimization for compute resources, focusing on efficiency and expenditure management.

• Designing and implementing flexible solutions to ensure adequate compute capacity and resource availability, support diverse workload requirements and new compute initiatives, and meet fluctuating demands.

• Building, maintain, and optimize orchestration functions by mapping workload requirements to cloud provider capabilities, implementing workers, and refining job queue and scaling systems.

• Managing and maintaining artifacts to establish a consistent baseline compute capability across all supported cloud providers and regions.

What we need to see:

• Bachelor’s degree in Computer Science, a related technical field, or equivalent experience.

• 8+ years of DevOps experience optimizing, deploying, and running heterogeneous containerized applications (Docker, Kubernetes) across trust boundaries, on AWS, Azure, and GCP, including hands-on work with EKS, AKS, and GKE.

• Practical experience in building scalable, reliable services and distributed system integration topologies

• Hands-on experience maintaining AWS security groups, roles, IAM, and role delegation.

• Proficiency in Python and Linux shell scripting for automation, application development, system administration, and problem resolution.

• Validated experience architecting, implementing, and managing cloud infrastructure using Terraform.

• Demonstrated ability as a meticulous problem-solver with strong analytical skills, capable of rapidly diagnosing and resolving complex technical challenges.

• Excellent communication, teamwork, and collaboration skills, with an ability to articulate technical concepts clearly to diverse audiences and lead technical responses during incidents.

Ways to stand out from the crowd:

• Proven experience with event-driven architectures using pub/sub patterns (e.g., AWS SNS/SQS, Google Pub/Sub, Azure Service Bus).

• Knowledge of generative AI architectures (LLMs, diffusion models) and concepts such as RAG and vector databases.

• Hands-on experience with the NVIDIA AI stack (NeMo, Triton Inference Server, TensorRT), with Production experience with NVIDIA NIM as a strong plus.

• Experienced in building and running CI/CD pipelines (Jenkins, GitLab CI) and applying SRE principles to automate, enhance reliability, and improve performance.

• Familiarity with Python-based Learning Management Systems (LMS) such as Open edX as well as practical experience with highly heterogeneous compute deployments.

With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers; we have some of the most forward-thinking and hardworking people in the world working for us and, due to unparalleled growth, our best-in-class teams are rapidly growing.

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 264,500 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.Applications for this job will be accepted at least until September 12, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.