Capabilities
Capabilities
How it works
Research-led data and environment development for the frontier's hardest problems
Learn more
Data development
Overview
Expert-curated datasets for frontier AI
Use cases
See how our data improves frontier models
Specialized agents
Overview
Custom AI systems built to unlock ROI fast
Enterprise stories
Real-world results from enterprise deployments
Research
Research
Research
Research hub
Our latest papers and data-centric AI findings
Leaderboards
Compare model performance across benchmarks
Open Benchmarks Grants
Funding for open-source AI research
Featured BENCHMARK
Agentic Coding benchmark
A benchmark for evaluating AI models on complex, real-world coding tasks that require multi-step reasoning, tool use, and autonomous problem-solving.
Resources
Resources
Resources
Resource library
Guides, papers, and tools for data-centric AI
Events
Upcoming talks, workshops, and conferences
Reading Group
AI discussions for researchers and practitioners
Blog
News, updates, and perspectives from our team
featured BLOG
Terminal-Bench 2.0
Developed by Stanford and Laude Institute with contributions from Snorkel AI, it’s a major leap forward in evaluating AI coding agents.
Company
Company
Company
About
Our mission, story, and values
Careers
Open roles and life at our company
Press
Media resources and announcements
Partners
Organizations we work with
Security
How we keep data safe
Contact us
Get in touch with our team
Join our expert community
Get paid to shape safer, smarter AI
Learn more
Get started
Get started
Category
Data development
Our picks
Building better enterprise AI: incorporating expert feedback in system development
Enterprises that aim to build valuable GenAI applications must view them from a systems-level. LLMs are just one part of an ecosystem.
January 30, 2024
•
Chris Glaze
AI data development: a guide for data science projects
What is AI data development? AI data development includes any action taken to convert raw information into a format useful to AI.
November 13, 2024
•
Matt Casey
LLM evaluation in enterprise applications: a new era in ML
Learn about the obstacles faced by data scientists in LLM evaluation and discover effective strategies for overcoming them.
November 25, 2024
•
Matt Casey
All articles on Data development
Weak supervision for non-categorical applications + superalignment
We need more labeled data than ever, so we have explored weak supervision for non-categorical applications—with notable results.
July 2, 2024
•
Changho Shin
Vision language models: how LLMs boost image classification
Vision language models demonstrate impressive image classification capabilities, but LLMs can help improve their performance. Learn how.
June 12, 2024
•
Reza Esfandiarpoor
How Bonito helps fine-tune specialized LLMs faster than ever
Fine-tuning specialized LLMs demands a lot of time and cost We developed Bonito to make this process faster, cheaper, and easier.
May 28, 2024
•
Nihal Nayak
Accelerating AI development in manufacturing with Snorkel Flow and AWS SageMaker
The manufacturing industry has experienced a massive influx of data. Snorkel AI and AWS Sage Maker can make that data actionable.
May 1, 2024
•
Ryan Gooch (Guest Blogger)
The art of data development for Enterprise LLMs
Snorkel’s Paroma Varma and Google’s Ali Arsenjani discus the role of data in the development and implementation of LLMs.
April 16, 2024
•
Team Snorkel
How Snorkel topped the AlpacaEval leaderboard (and why we’re not there anymore)
Snorkel AI placed a model at the top of the AlpacaEval leaderboard. Here’s how we built it, and how it changed AlpacaEval’s metrics.
April 9, 2024
•
Hoang Tran
CRFM’s HELM and enterprise LLM evaluation beyond accuracy
As Snorkel AI prepares to build better enterprise LLM evaluations, we spoke with Yifan Mail from Stanford’s CRFM HELM project.
April 3, 2024
•
Vivek Krishnamurthy
Here’s how Snorkel Flow + Google AI built an enterprise-ready model in a day
Google and Snorkel AI customized PaLM 2 using domain expertise and data development to improve performance by 38 F1 points in a matter of hours.
March 19, 2024
•
Paroma Varma
,
Ali Arsanjani
How Skill-it! enables faster, better LLM training
Humans learn tasks better when taught in a logical order. So do LLMs. Researchers developed a way to exploit this tendency called “Skill-it!”
March 12, 2024
•
Fred Sala
Fine-tuned representation models boost LLM systems. Here’s how
Fine-tuned representation models are often the most effective way to boost the performance of AI applications. Learn why.
March 5, 2024
•
Trung Nguyen
Enterprises must shift their focus from models to data in AI development
Snorkel AI CEO Alex Ratner explains his view on the importance of AI in data development and illustrates his position with two case studies.
February 9, 2024
•
Alex Ratner
Scaling human preferences in AI: Snorkel’s programmatic approach
We’ve developed new approaches to scale human preferences and align LLM output to enterprise users’ expectations by magnifying SME impact.
January 31, 2024
•
Hoang Tran
Building better enterprise AI: incorporating expert feedback in system development
Enterprises that aim to build valuable GenAI applications must view them from a systems-level. LLMs are just one part of an ecosystem.
January 30, 2024
•
Chris Glaze
“Fall in love with your data”—Snorkel AI’s Enterprise LLM Summit
Snorkel AI’s Jan. 25 Enterprise LLM Summit focused on one theme: AI data development drives enterprise AI success.
January 26, 2024
•
Snorkel Team
New benchmark results demonstrate value of Snorkel AI approach to LLM alignment
Snorkel researchers’ state-of-the-art methods created a 7B LLM that ranked 2nd, behind only GPT-4 Turbo, on AlpacaEval 2.0 leaderboard.
January 24, 2024
•
Cate Lochead
Prev
1
2
3
4
Next