Snorkel AI Logo

Snorkel AI

Research Scientist - Frontier Benchmarks

Reposted One Month Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in New York City, NY
200K-375K Annually
Expert/Leader
In-Office or Remote
Hiring Remotely in New York City, NY
200K-375K Annually
Expert/Leader
The Research Scientist will design frontier benchmarks and datasets, collaborate across teams, communicate findings, and represent Snorkel's research externally.
The summary above was generated by AI

About Snorkel

Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes. 
Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

ABOUT THE ROLE 

We're looking for a Research Scientist to lead the design of next-generation benchmarks and datasets that push the boundaries of frontier model evaluation. You'll define what "good" looks like across a range of hard tasks, drawing on conversations with customers and academic partners to ground your datasets in real performance gaps. You'll build both the benchmarks that measure those gaps and the training data that helps close them, then partner with delivery, product, and go-to-market to bring what you build into production.

This role is ideal for someone who wants to shape how the field measures progress in frontier AI, and who's energized by doing that work inside a fast-moving, cross-functional startup.

MAIN RESPONSIBILITIES 

  • Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships 
  • Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert-curated data for customer-facing presentations, technical reports, and go-to-market materials.
  • Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap. 
  • Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows
  • Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI

PREFERRED QUALIFICATIONS 

  • Strong research background in AI/ML evaluation, NLP, or related fields, with a track record of rigorous experimental design — especially around measuring the impact of training and evaluation data on model behavior. 
  • Exceptional communication skills — able to present complex technical findings clearly to both technical and non-technical audiences 
  • Comfort operating in a fast-moving, cross-functional environment with ambiguous problem spaces 
  • Genuine interest in GTM strategy, startup dynamics, and the commercial side of AI data services. 
  • Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered.

Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.

Salary range(s) for this role
$200,000—$375,000 USD

Be Your Best at Snorkel

Joining Snorkel AI means becoming part of a company that has market proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success.

Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Similar Jobs

2 Minutes Ago
Easy Apply
Remote
United States
Easy Apply
115K-194K Annually
Senior level
115K-194K Annually
Senior level
Cloud • Security • Software • Cybersecurity • Automation
Owns and improves the operational toolkit supporting Solutions Architects, including systems, workflows, reporting, documentation, support requests, engagement tracking, capacity planning, and data quality. Partners with revenue technology, analytics, and system owners to translate field needs into requirements, automate processes, improve handoffs, and sustain adoption. Supports SA leadership through reporting, business reviews, operating rhythms, testing, rollouts, and continuous operational improvements.
Top Skills: AICRMDevsecopsExcelGitlabGoogle SheetsSalesforceSQL
4 Minutes Ago
Remote or Hybrid
USA
115K-136K Annually
Senior level
115K-136K Annually
Senior level
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Drives net-new enterprise SaaS business by prospecting, managing complex sales cycles, building ROI-based business cases, presenting to finance and C-suite leaders, negotiating contracts, and closing opportunities. The role requires territory planning, pipeline forecasting, CRM hygiene, cross-functional collaboration, and approximately 30% travel for in-person customer engagement.
Top Skills: CRMSaaS
6 Minutes Ago
Remote or Hybrid
US
110K-135K Annually
Senior level
110K-135K Annually
Senior level
HR Tech • Information Technology • Professional Services • Sales • Software
Manage HiBob’s end-to-end RFP and proposal response process across multiple concurrent projects. Develop compelling proposal documents, maintain response content repositories, improve workflows, and collaborate with Sales, Product, Marketing, Finance, Security, Legal, and other teams. Use AI tools to create efficiencies and sales enablement materials, identify process improvements, support product launches, and provide strategic insights to global go-to-market leaders.
Top Skills: ChatgptGoogle GeminiGoogle WorkspaceInventive

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account