Anish Shah
Weights & Biases
LEARN, CONNECT, BUILD
Microsoft Reactor
Join Microsoft Reactor and engage with developers live
Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!
LEARN, CONNECT, BUILD
Microsoft Reactor
Join Microsoft Reactor and engage with developers live
Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!
Go back
Building a LLM Judge with Weights & Biases
29 October, 2024 | 5:00 PM - 6:00 PM (UTC) Coordinated Universal Time
- Format:
Livestream
Topic: AI Applications
Language: English
Evaluating LLM outputs accurately is critical to being able to iterate quickly on a LLM system. Human annotations can be slow and expensive and using LLMs instead promises to solve this. However, aligning a LLM Judge with human judgements is often hard with many implementation details to consider. In this workshop we will explore:
- Evaluating specialized LLMs using Weave
- Productionizing the latest LLM-as-a-judge research
- Improving on your existing judge
- Building annotation UIs
Speakers
Related Events
The events below may be of interest to you as well. Be sure to visit our Reactor homepage to see all available events.
-
Securing Microsoft Foundry in the Enterprise: Lessons from the Field
Securing Microsoft Foundry in the Enterprise: Lessons from the Field
Format:
Livestream
Topic: AI Applications
Language: English
-
Getting Started with SQL + AI
Getting Started with SQL + AI
Format:
Livestream
Topic: AI Applications
Language: English
-
AI Dev Days Hackathon: Build the Future with AI Apps, Agents, and Secure DevOps
AI Dev Days Hackathon: Build the Future with AI Apps, Agents, and Secure DevOps
Format:
Livestream
Topic: AI Applications
Language: English
This event is part of the Weights & Biases Series.
Click here to visit the Series Page where you could see all the upcoming and on-demand events.