Category

Data development

Our picks

Image for Building better enterprise AI: incorporating expert feedback in system development
Building better enterprise AI: incorporating expert feedback in system development
Enterprises that aim to build valuable GenAI applications must view them from a systems-level. LLMs are just one part of an ecosystem.
January 30, 2024
Chris Glaze
Image for AI data development: a guide for data science projects
AI data development: a guide for data science projects
What is AI data development? AI data development includes any action taken to convert raw information into a format useful to AI.
November 13, 2024
Matt Casey
Image for LLM evaluation in enterprise applications: a new era in ML
LLM evaluation in enterprise applications: a new era in ML
Learn about the obstacles faced by data scientists in LLM evaluation and discover effective strategies for overcoming them.
November 25, 2024
Matt Casey

All articles on Data development

Image
Weak supervision for non-categorical applications + superalignment
We need more labeled data than ever, so we have explored weak supervision for non-categorical applications—with notable results.
July 2, 2024
Changho Shin
Image
Vision language models: how LLMs boost image classification
Vision language models demonstrate impressive image classification capabilities, but LLMs can help improve their performance. Learn how.
June 12, 2024
Reza Esfandiarpoor
Image
How Bonito helps fine-tune specialized LLMs faster than ever
Fine-tuning specialized LLMs demands a lot of time and cost We developed Bonito to make this process faster, cheaper, and easier.
May 28, 2024
Nihal Nayak
Image
Accelerating AI development in manufacturing with Snorkel Flow and AWS SageMaker
The manufacturing industry has experienced a massive influx of data. Snorkel AI and AWS Sage Maker can make that data actionable.
May 1, 2024
Ryan Gooch (Guest Blogger)
Image
The art of data development for Enterprise LLMs
Snorkel’s Paroma Varma and Google’s Ali Arsenjani discus the role of data in the development and implementation of LLMs.
April 16, 2024
Team Snorkel
Image1
How Snorkel topped the AlpacaEval leaderboard (and why we’re not there anymore)
Snorkel AI placed a model at the top of the AlpacaEval leaderboard. Here’s how we built it, and how it changed AlpacaEval’s metrics.
April 9, 2024
Hoang Tran
Image1
CRFM’s HELM and enterprise LLM evaluation beyond accuracy
As Snorkel AI prepares to build better enterprise LLM evaluations, we spoke with Yifan Mail from Stanford’s CRFM HELM project.
April 3, 2024
Vivek Krishnamurthy
Image
Here’s how Snorkel Flow + Google AI built an enterprise-ready model in a day
Google and Snorkel AI customized PaLM 2 using domain expertise and data development to improve performance by 38 F1 points in a matter of hours.
March 19, 2024
Paroma Varma
,
Ali Arsanjani
Image
How Skill-it! enables faster, better LLM training
Humans learn tasks better when taught in a logical order. So do LLMs. Researchers developed a way to exploit this tendency called “Skill-it!”
March 12, 2024
Fred Sala
Image2
Fine-tuned representation models boost LLM systems. Here’s how
Fine-tuned representation models are often the most effective way to boost the performance of AI applications. Learn why.
March 5, 2024
Trung Nguyen
Image1
Enterprises must shift their focus from models to data in AI development
Snorkel AI CEO Alex Ratner explains his view on the importance of AI in data development and illustrates his position with two case studies.
February 9, 2024
Alex Ratner
Image1
Scaling human preferences in AI: Snorkel’s programmatic approach
We’ve developed new approaches to scale human preferences and align LLM output to enterprise users’ expectations by magnifying SME impact.
January 31, 2024
Hoang Tran
Image
Building better enterprise AI: incorporating expert feedback in system development
Enterprises that aim to build valuable GenAI applications must view them from a systems-level. LLMs are just one part of an ecosystem.
January 30, 2024
Chris Glaze
Image
“Fall in love with your data”—Snorkel AI’s Enterprise LLM Summit
Snorkel AI’s Jan. 25 Enterprise LLM Summit focused on one theme: AI data development drives enterprise AI success.
January 26, 2024
Snorkel Team
Image
New benchmark results demonstrate value of Snorkel AI approach to LLM alignment
Snorkel researchers’ state-of-the-art methods created a 7B LLM that ranked 2nd, behind only GPT-4 Turbo, on AlpacaEval 2.0 leaderboard.
January 24, 2024
Cate Lochead