Fireworks AI Logo

Fireworks AI

AI Product Engineer

Posted 2 Hours Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in USA
200K-350K Annually
Mid level
In-Office or Remote
Hiring Remotely in USA
200K-350K Annually
Mid level
Build and own developer-facing product features for an LLM inference and fine-tuning platform, spanning frontend (console, playground), backend services, APIs, deployment, billing, and instrumentation. Ship end-to-end features, collaborate with cross-functional teams, and iterate rapidly based on usage data.
The summary above was generated by AI
About Us:

At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.

About the Role

We're looking for a product-minded engineer to join Fireworks as a Member of Technical Staff on our Product Engineering team. You'll build the product surfaces that developers and enterprises interact with every day — from the inference API and developer console to fine-tuning workflows, model deployment, billing, and new products like Fire Pass.

Fireworks owns the full stack: training, fine-tuning (SFT and RFT at frontier scale), serverless and dedicated inference, multi-LoRA serving, and agentic orchestration — all on infrastructure we built from scratch. Product Engineering sits on top of that stack and turns it into things developers and Enterprises can actually use. You'll work across the surfaces where our platform meets its users: the APIs they call, the console they configure deployments in, the fine-tuning jobs they launch, the billing systems that meter their usage, and the agentic tooling they build with.

This is a high-autonomy IC role. You'll own features end-to-end — from understanding the problem, to designing the solution, to shipping it, to watching how developers actually use it. We're a small team building a platform that processes trillions of tokens daily, so the work you do will be used immediately and at enormous scale.

 Key Responsibilities
  • Design, build, and ship product features across the Fireworks platform — including the developer console, API surfaces, model playground, fine-tuning workflows, deployment management, and billing
  • Own features end-to-end: scope the problem, build the solution, ship it, instrument it, and iterate based on real usage
  • Build and improve the developer experience for Fireworks' core product capabilities — serverless and on-demand inference, supervised and reinforcement fine-tuning, multi-LoRA serving, and agentic orchestration
  • Work across the full stack — frontend (React/TypeScript), backend services (Python, Go), APIs, and data layers — to deliver polished, production-quality product surfaces
  • Build for products that are evolving rapidly: new model types, new serving paths (standard, priority, fast), new consumption models like Fire Pass, and new capabilities like multi-agent harness tooling
  • Partner closely with Infrastructure, Applied Research, Growth, Data and Design to translate platform capabilities into intuitive developer-facing products
  • Instrument and monitor the systems you build, using data to understand how developers use the platform and where friction exists
  • Move fast and make pragmatic trade-offs — the pace of AI infrastructure demands shipping early, learning quickly, and iterating with conviction
 Minimum Qualifications
  • 3 years of experience as a software engineer, with meaningful time spent building user-facing products
  • Strong full stack development skills — comfortable working across frontend (React/TypeScript), backend (Python, Go, or similar), APIs, and databases
  • Experience building and shipping developer-facing products: APIs, dashboards, consoles, CLIs, or developer tools
  • Track record of owning features end-to-end — you're as comfortable scoping a problem as you are deploying the fix
  • Strong product instincts — you think about the developer experience, not just the implementation
  • Demonstrated ability to operate at high velocity with extreme ownership: you ship fast, make pragmatic trade-offs, and don't wait to be told what to build
 Preferred Qualifications
  • Experience building products on top of complex infrastructure — inference platforms, cloud services, data platforms, or ML tooling
  • Experience building for deeply technical users (developers, ML engineers, platform teams) where the product surface is an API as much as a UI
  • Comfort working in a fast-moving, founder-led environment where the product is evolving week to week and the map is being drawn as you go
  • You build with AI tools daily — you use them to accelerate your own work and have strong intuition for what great AI developer experience looks like from the inside

Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.

Base Pay Range (Plus Equity)
$200,000$350,000 USD
Why Fireworks AI?
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Similar Jobs

Yesterday
In-Office or Remote
200K-250K Annually
Senior level
200K-250K Annually
Senior level
Software
Lead API product direction for search and retrieval primitives, partner with strategic accounts to architect integrations, translate customer insights into product specs and roadmaps, run technical deep-dives and documentation, and prototype and ship production code to improve developer experience and platform reliability.
Top Skills: APIsLlmsRetrieval SystemsSearch Infrastructure
11 Days Ago
Remote
United States
130K-208K Annually
Senior level
130K-208K Annually
Senior level
Database • Analytics
Build and ship production agents and reusable skills on a petabyte-scale observability platform. Own end-to-end agent stack (context engineering, tooling, MCP servers, SDKs, integrations), improve agent observability, evaluate models, and optimize for latency, cost, and reliability while collaborating openly with OSS contributors and customers.
Top Skills: ClickhouseColumnar DatabasesDockerEvent Ingestion PipelinesGoKubernetesLlmsMcpNode.jsOpentelemetryPythonRustSQLTypescript
13 Days Ago
Remote
United States
150K-210K Annually
Senior level
150K-210K Annually
Senior level
Healthtech
The role involves leading product engineering efforts, making technical decisions, collaborating with teams, and mentoring others, focused on building AI-powered healthcare infrastructure.
Top Skills: Ai ToolsAPIsPostgresPythonReactSQL

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account