resources

Resource library

Explore our complete library of resources including blogs, benchmarks, research papers and more.
Image for Evaluating Coding Agent Capabilities with Terminal-Bench: Snorkel’s Role in Building the Next Generation Benchmark
Blog

Evaluating Coding Agent Capabilities with Terminal-Bench: Snorkel’s Role in Building the Next Generation Benchmark

Announcing a $3M commitment to launch Open Benchmarks Grants
September 30, 2025
Image for Closing the Evaluation Gap in Agentic AI
Blog

Closing the Evaluation Gap in Agentic AI

Announcing a $3M commitment to launch Open Benchmarks Grants

February 11, 2026
Image for Benchtalks #1: Alex Shaw (Terminal-Bench, Harbor) – Building the Benchmark Factory
Blog

Benchtalks #1: Alex Shaw (Terminal-Bench, Harbor) – Building the Benchmark Factory

Announcing a $3M commitment to launch Open Benchmarks Grants
March 31, 2026
Image for Building FinQA: An Open RL Environment for Financial Reasoning Agents
Blog

Building FinQA: An Open RL Environment for Financial Reasoning Agents

Announcing a $3M commitment to launch Open Benchmarks Grants
March 30, 2026
Image for The science of rubric design
Blog

The science of rubric design

Announcing a $3M commitment to launch Open Benchmarks Grants
September 11, 2025
of
Type: All Types
Sort: Newest
Scaling human preferences in AI: Snorkel’s programmatic approach
Blog
Scaling human preferences in AI: Snorkel’s programmatic approach

We’ve developed new approaches to scale human preferences and align LLM output to enterprise users’ expectations by magnifying SME impact.

Jan 31, 2024
Learn more about Scaling human preferences in AI: Snorkel’s programmatic approach
Building better enterprise AI: incorporating expert feedback in system development
Blog
Building better enterprise AI: incorporating expert feedback in system development

Enterprises that aim to build valuable GenAI applications must view them from a systems-level. LLMs are just one part of an ecosystem.

Jan 30, 2024
Learn more about Building better enterprise AI: incorporating expert feedback in system development
“Fall in love with your data”—Snorkel AI’s Enterprise LLM Summit
Blog
“Fall in love with your data”—Snorkel AI’s Enterprise LLM Summit

Snorkel AI’s Jan. 25 Enterprise LLM Summit focused on one theme: AI data development drives enterprise AI success.

Jan 26, 2024
Learn more about “Fall in love with your data”—Snorkel AI’s Enterprise LLM Summit
Why QBE Ventures invested in Snorkel AI
Blog
Why QBE Ventures invested in Snorkel AI

QBE Ventures made a strategic investment in Snorkel AI because it provides what Insurers need: scalable and affordable ways to customize AI.

Learn more about Why QBE Ventures invested in Snorkel AI
New benchmark results demonstrate value of Snorkel AI approach to LLM alignment
Blog
New benchmark results demonstrate value of Snorkel AI approach to LLM alignment

Snorkel researchers’ state-of-the-art methods created a 7B LLM that ranked 2nd, behind only GPT-4 Turbo, on AlpacaEval 2.0 leaderboard.

Jan 24, 2024
Learn more about New benchmark results demonstrate value of Snorkel AI approach to LLM alignment
Retrieval augmented generation (RAG): a conversation with its creator
Blog
Retrieval augmented generation (RAG): a conversation with its creator

Snorkel CEO Alex Ratner spoke with Douwe Keila, an author of the original paper about retrieval augmented generation (RAG).

Jan 16, 2024
Learn more about Retrieval augmented generation (RAG): a conversation with its creator
Characterizing the Impacts of Semi-supervised Learning for Weak Supervision
Labeling training data is a critical and expensive step in producing high accuracy ML models, whether training from scratch or fine-tuning. To make labeling more efficient, two major approaches are programmatic weak supervision (WS) and semi-supervised learning (SSL). More recent works have either explicitly or implicitly used techniques at their intersection, but in various complex and ad hoc ways. In this work, we define a simple, modular design space to study the use of SSL techniques for WS more systematically. Surprisingly, we find that fairly simple methods from our design space match the performance of more complex state-of-the-art methods, averaging...
Research Paper
Characterizing the Impacts of Semi-supervised Learning for Weak Supervision

Labeling training data is a critical and expensive step in producing high accuracy ML models, whether training from scratch or fine-tuning. To make labeling more efficient, two major approaches are programmatic weak supervision (WS) and semi-supervised learning (SSL). More recent works have either explicitly or implicitly used techniques at their intersection, but in various complex and ad hoc ways. In…

Jan 16, 2024

Jeffrey Li, Jieyu Zhang, Ludwig Schmidt & Alexander Ratner

Learn more about Characterizing the Impacts of Semi-supervised Learning for Weak Supervision
Promises and Pitfalls of Threshold-based Auto-labeling
Creating large-scale high-quality labeled datasets is a major bottleneck in supervised machine learning workflows. Threshold-based auto-labeling (TBAL), where validation data obtained from humans is used to find a confidence threshold above which the data is machine-labeled, reduces reliance on manual annotation. TBAL is emerging as a widely-used solution in practice. Given the long shelf-life and diverse usage of the resulting datasets, understanding when the data obtained by such auto-labeling systems can be relied on is crucial. This is the first work to analyze TBAL systems and derive sample complexity bounds on the amount of human-labeled validation data required for guaranteeing...
Research Paper
Promises and Pitfalls of Threshold-based Auto-labeling

Creating large-scale high-quality labeled datasets is a major bottleneck in supervised machine learning workflows. Threshold-based auto-labeling (TBAL), where validation data obtained from humans is used to find a confidence threshold above which the data is machine-labeled, reduces reliance on manual annotation. TBAL is emerging as a widely-used solution in practice. Given the long shelf-life and diverse usage of the resulting…

Jan 11, 2024

H. Vishwakarma, et al.

Learn more about Promises and Pitfalls of Threshold-based Auto-labeling
Snorkel Flow 2023.R4: enhanced UI + PDF  and Databricks tools
Blog
Snorkel Flow 2023.R4: enhanced UI + PDF and Databricks tools

New unified prompting UI + RAG features, PDF annotation, Databricks MLflow integration, Snorkel Flow Studio, and datasets load 2x faster!

Jan 09, 2024
Learn more about Snorkel Flow 2023.R4: enhanced UI + PDF and Databricks tools
1 20 21 22 64
Image
Image

Join our newsletter

For expert advice, the latest research, and exclusive events.
By submitting this form, I acknowledge I will receive email updates from Snorkel AI, and I agree to the Terms of Use and acknowledge that my information will be used in accordance with the Privacy Policy.