The Impact of a Lead Cloud Software Engineer at Coupa:
AI is reshaping how the world builds, learns, and connects. At our company, we believe the next generation of enterprise software will be powered by AI-driven platforms that are secure, scalable, and built for constant innovation. As our Lead of AI LLM Platform DevOps team, you will build solutions that enable this vision. From CI/CD pipelines, ML Ops, GenAI, Agentic AI platforms to AI governance and observability, you will define how our engineers build, test and ship the technologies that power global enterprises. This is your chance to lead & shape the evolution of Coupa’s AI platform. You will lead system design, code development, deployment, automation for our LLM/GenAI/Agentic AI platforms ensuring reliability, scalability of infrastructure.
What You’ll Do
- Lead Platform Architecture and Strategy: Define and drive the long-term technical vision for Agentic AI platform and LLM infrastructure, making strategic decisions on technology choices, architectural patterns and platform evolution.
- Design Enterprise-Scale Platform Solutions: Architect complex, multi-tenant platform systems that support high availability, scalability, and security requirements across global multi-cloud environments
- Drive Technical Leadership and Mentorship: Lead and mentor a team of platform devops engineers, providing technical guidance, code reviews, and career development while fostering a culture of engineering excellence
- Establish Platform Engineering Standards: Define and implement best practices, coding standards and architectural principles that ensure consistency, reliability, and maintainability across all platform components
- Involve in evaluation of new products and technologies like RAG, MCP servers. AI Agents, Agentic Workflows, etc.
- Deployment and Life cycle Management of LLM & Embedding Models.
- Build and manage MLOps pipeline.
- Infrastructure As Code (IaC e.g Terraform) with Multi Cloud Deployments.
- Ensure technical quality through code reviews, architecture discussions, and engineering standards.
- Collaborate with the Principal Architect and AI/ML Engineering Lead on technical direction.
- Collaborate with platform, Dev & QE teams to plan & deploy the releases.
- Participate in design reviews, code reviews, troubleshooting incidents & write, and review Incident RCAs
What You Will Bring to Coupa
- Senior Platform Engineering Leadership: 10+ years of hands-on platform engineering experience with 3+ years in technical leadership roles, including experience managing complex cloud infrastructure at enterprise scale
- Advanced Cloud Architecture Expertise: Deep expertise in cloud-native architectures, multi-cloud strategies, and advanced services across AWS or GCP, with proven experience designing systems that handle millions of transactions
- Enterprise Platform Design: Proven track record designing and implementing large-scale platform solutions, including microservices architectures, container orchestration, and distributed systems patterns
- Advanced Automation and Programming: Expert-level programming skills in multiple languages (Python, Go, Java, etc.) with extensive experience building sophisticated automation frameworks and platform tools
- Strategic CI/CD and DevOps: Deep expertise in enterprise CI/CD design, MLOps pipelines, and DevOps transformation initiatives, with experience implementing these practices across large engineering organizations
- Architectural Decision Making: Proven ability to make complex technical trade-offs, evaluate emerging technologies, and drive architectural decisions that balance current needs with long-term scalability
- Enterprise AI platform infrastructure development experience
- Experience building enterprise grade, scalable, cost-efficient, secure AI/ML platforms with a focus on resiliency, automation, observability.
- Deployment and Life cycle Management of LLM & Embedding Models (OpenAI, AWS Bedrock, Amazon SageMaker) and Vector Databases like LanceDB
- Exposure to evaluation of new products and technologies like RAG, MCP servers, AI Agents, Agentic Workflows, LangChain etc.
- Manage AWS core & AI /GenAI services (S3, IAM, EKS, Bedrock, etc), Expert in IaC (Terraform).
- Containerization and Orchestration: Deep knowledge of Docker and Kubernetes (especially GKE or EKS) for scaling inference services, Build, deploy workloads.
- A leader who thrives in fast-moving environments, motivates teams, and embraces innovation.
- Strong communication skills across geographies.
- BS/MS in Computer Science or equivalent experience.
- Global Wellness Days: Enjoy two designated, company-wide paid wellness days off each year (typically the first Friday in March and the last Friday in September) so the entire global team can unplug, step away, and recharge together .
- Birthday Time-Off: Celebrate your day! Coupa provides a paid day off on your birthday or another day of your choice within your birthday month .
- Volunteer Time Off (VTO): Giving back is in our DNA. We offer 40 hours of paid VTO annually to support the community initiatives and volunteer programs you are passionate about .
- Employee Assistance Program (EAP): Access free, confidential, 24/7/365 counseling and resources for emotional support, work-life solutions, financial advice, legal guidance, and support for new parents .
- Business Travel Protection: Travel with peace of mind. Zurich Travel Assist provides medical, safety, pre-trip planning, and emergency support during any business travel .
- Referral Bonus Program: Share the Coupa experience! Receive generous monetary referral bonuses when you successfully refer talented friends or acquaintances who are hired into open roles .
Similar Jobs at Coupa
What you need to know about the Charlotte Tech Scene
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

