NVIDIA GPU Architecture Group is seeking a senior software engineer to automate and optimize performance analysis workflows for AI training and inference workloads. You will not only perform analysis but also reshape how it's done, building tools and workflows that scale across a broad audience of engineers. NVIDIA is a world-class leader in AI workload optimization, and your work will push these boundaries even further!
What you'll be doing:
Design and build performance analysis tools and workflows for AI training and inference workloads.
Understand how AI performance engineers work and translate their needs into scalable, intuitive tooling.
Develop integrations between profiling infrastructure and AI frameworks and workflows.
Collaborate with performance engineers, hardware architects, and software teams to ensure profiling capabilities align with real-world AI workloads.
Identify performance bottlenecks in AI workloads and develop automated approaches to detect and diagnose them.
What we need to see:
M.S., or PhD in Computer Science, Computer Engineering, or a related field (or equivalent experience). 6+ years of relevant work experience
Deep knowledge of AI workloads, frameworks, and performance characteristics.
Experience building tools, workflows, or infrastructure used by other engineers.
Strong software development skills (Python, C++ preferred).
Ability to translate user requirements into scalable tooling solutions.
Up to date with AI-enabled tooling for software development and performance analysis.
Strong interpersonal skills for understanding engineer difficulties and working across multi-functional teams.
Ways to stand out from the crowd:
Experience profiling or optimizing AI training or inference pipelines at scale
Background building developer tools or platforms for ML engineers
Contributions to open-source AI tooling or frameworks
184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Similar Jobs
What you need to know about the Charlotte Tech Scene
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus


