Skip to main content
megaphone icon

AI Dev Days Hackathon

Build production‑ready AI during our global hack using Microsoft’s latest AI, agent, and dev tools to solve real‑world problems and compete for prizes.

LEARN, CONNECT, BUILD

Microsoft Reactor

Join Microsoft Reactor and engage with developers live

Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!

LEARN, CONNECT, BUILD

Microsoft Reactor

Join Microsoft Reactor and engage with developers live

Ready to get started with AI and the latest technologies? Microsoft Reactor provides events, training, and community resources to help developers, entrepreneurs and startups build on AI technology and more. Join us!

Go back

Evaluating your RAG Chat App

12 September, 2024 | 8:00 PM - 9:00 PM (UTC) Coordinated Universal Time

  • Format:
  • alt##LivestreamLivestream

Topic: Intelligent Applications

Language: English

RAG (Retrieval Augmented Generation) is the most popular approach used to get LLMs to answer user questions grounded in a domain. How can you be sure that the answers are accurate, clear, and well formatted? Evaluation!
In this session, we'll show you how to use Azure AI Studio and the Promptflow SDK to generate synthetic data and run bulk evaluations on your RAG app. Learn about different GPT metrics like groundedness and fluency, and consider other ways you can measure the quality of your RAG app answers.

Presented by Pamela Fox, Python Advocate

** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

Prerequisites

  • Read the official rules and join the hack at https://aka.ms/raghack. No Purchase Necessary. Must be 18+ to enter. Contest ends 9/16/24.

  • Want more hands-on RAG training? Visit the Reactor series home page to see all the RAGHack 2024 sessions!

Speakers