Anish Shah
Weights & Biases
LEARN, CONNECT, BUILD
Microsoft Reactor
Join Microsoft Reactor and engage with developers, entrepreneurs, and startups live
Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!
LEARN, CONNECT, BUILD
Microsoft Reactor
Join Microsoft Reactor and engage with developers, entrepreneurs, and startups live
Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!
Go back
Building a LLM Judge with Weights & Biases
29 October, 2024 | 5:00 PM - 6:00 PM (UTC) Coordinated Universal Time
- Format:
Livestream
Topic: Intelligent Applications
Language: English
Evaluating LLM outputs accurately is critical to being able to iterate quickly on a LLM system. Human annotations can be slow and expensive and using LLMs instead promises to solve this. However, aligning a LLM Judge with human judgements is often hard with many implementation details to consider. In this workshop we will explore:
- Evaluating specialized LLMs using Weave
- Productionizing the latest LLM-as-a-judge research
- Improving on your existing judge
- Building annotation UIs
Speakers
Already registered and need to cancel? Cancel registration
This event is part of the Weights & Biases Series.
Click here to visit the Series Page where you could see all the upcoming and on-demand events.