4:30 PM - 5:30 PM (UTC)

An intro to RAGHack, a global hackathon to develop apps using LLMs and RAG. A large language model (LLM) like GPT-4 can be used for summarization, translation, entity extraction, and question-answering. Retrieval Augmented Generation (RAG) is an approach that sends context to the LLM so that it can provide grounded answers. RAG apps can be developed on Azure using a wide range of programming languages and retrievers (such as AI Search, Cosmos DB, PostgreSQL, and Azure SQL). Get an overview of RAG in this session before diving deep in our follow-up streams.

6:00 PM - 7:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Learn how to develop apps using RAG with .NET and Semantic Kernel. We'll walk through our .NET RAG solution, showing the process of data ingestion with Azure Document Intelligence and AI Search, then walking through the RAG steps of query rewriting, hybrid search, and question answering. You'll learn how to easily bring your own data into the RAG solution, and how to customize the prompts and Blazor UI for your domain. Presented by Jordan Matthiesen (PM in .NET), Luis Quintanilla (PM in .NET), Bruno Capuano (Advocate for .NET) ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

8:00 PM - 9:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Learn how to build a RAG-based custom copilot end-to-end using Azure AI Studio, code-first. We'll walk through "Contoso Chat", a retail copilot scenario with product and customer data. We'll explore prompt engineering using prompty assets, orchestration with promptflow flex-flows and automated provisioning and deployment with azd. You'll learn how to build & test your copilot locally (in VS Code), then deploy & test it in production on Azure. Presented by Leah Bar-On Simmons (Azure AI PM) and Nitya Narasimhan (Azure AI Advocate) ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack ** 📌 Check out the RAGHack 2024 series here!

10:00 PM - 11:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Learn how to develop apps using RAG with Python and the OpenAI SDK. We'll walk through our most popular RAG solution, showing the process of data ingestion with Azure Document Intelligence and AI Search, then walking through the RAG steps of query rewriting, hybrid search, and question answering. You'll learn how to easily bring your own data into the RAG solution, and how to customize the prompts and UI for your domain. Presented by Pamela Fox, Developer Advocate for Python ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

3:00 PM - 4:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Learn how to develop RAG apps with JavaScript and TypeScript, using both the OpenAI SDK and LangchainJS. We'll demonstrate multiple RAG starter apps with different architectures, including static web apps with serverless backends. You'll learn how to bring your own data into these RAG solutions and customize for your domain. Presented by Glaucia Lemos and Yohan Lasorsa, from the JavaScript Developer Advocacy team at Microsoft ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

3:00 PM - 4:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Langchain4J is a great way to use large language models from Java, and is modeled on the most popular Python orchestrator, Langchain. Learn how to use Langchain4J to build a RAG solution, connecting to different LLMs, embedding models, and vector stores. We'll share multiple open-source solutions so that you can get started with Langchain4J today. Presented by Julien Dubois, Principal Manager of Java Developer Relations at Microsoft ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

9:00 PM - 10:00 PM (UTC)

Join us to learn about building scalable RAG applications using Azure Cosmos DB for NoSQL! Learn foundational concepts, generate embeddings with Azure OpenAI, process, store, and search over document data in Azure Cosmos DB leveraging vector similarity search using DiskANN, a vector indexing method that enable fast and cost-efficient vector search at any scale! Presented by James Codella, Product Manager for Cosmos DB ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

3:00 PM - 4:00 PM (UTC)

Join us as we tackle the challenge of embedding ethical principles and diversity into AI conversational platforms! We'll explore Microsoft's cool tools and practices for building responsible AI, with examples straight from our toolkit on the Responsible AI Tools and Practices page. See live demos showcasing importance of "Responsible AI", including examples of models and use cases that violate the principles. You'll walk away with practical insights and tools to create AI solutions that boost brand trust and open up new markets. Presented by Rory Preddy, Java Developer Advocate ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

5:00 PM - 6:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Learn how to build a RAG app using vCore-based Azure Cosmos DB for MongoDB and its new vector search capabilities. We'll walk through a Python web app that uses the LangChain package to orchestrate a RAG flow in order to answer questions about a restaurant's data. Presented by Khelan Modi, Product Manager on Azure Cosmos DB team, and John Aziz, Software Developer and Microsoft MVP ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

7:00 PM - 8:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Azure AI Search is a powerful search engine, with many features designed specifically for RAG applications. We'll demonstrate optimal retrieval using hybrid search with the semantic ranker, show the new integrated vectorization feature for cloud-based data ingestion, and discuss vector storage optimization. Presented by Farzad Sunavala, Product Manager on Azure AI Search, and Pamela Fox, Developer Advocate for Python ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

9:00 PM - 10:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Discover the many ways you can build RAG applications on top of Azure Database for PostgreSQL Flexible Servers. We'll start by using the pgvector extension for vector similarity search. Then we'll explore the new azure_ai extension which provides built-in functions for embeddings, summarization, sentiment analysis, and more. Finally, we'll demo the new azure_local_ai extension to efficiently run pre-trained models on our database server, which can be a great fit for RAG applications that require custom embedding models. Presented by Joshua Johnson, Principal TPM on Azure PostgreSQL, and Pamela Fox, Developer Advocate for Python ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

11:00 PM - 12:00 AM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. How do you build a RAG solution on data already stored in SQL Server or Azure SQL? In this session you'll learn about existing and future options that you can start to use right tomorrow, leveraging Azure SQL as a vector store and taking advantage of its established performances, security and enterprise readiness! Presented by Davide Mauri, Principal Product Manager on Azure SQL DB ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

4:00 PM - 5:00 PM (UTC)

In this presentation, you'll gain an understanding of GraphRAG, a technique that enhances document analysis and question-and-answer performance by leveraging large language models (LLMs) to create knowledge graphs. We'll explore how GraphRAG builds upon Retrieval-Augmented Generation (RAG) by using knowledge graphs instead of vector similarity for retrieval. You'll learn how to set up the environment, prepare data, and implement GraphRAG using LangChain, with practical code examples. Additionally, we'll explore some advanced features and customization options available in LangChain to optimize and tailor GraphRAG to your specific needs. Presented by John Alexander, Content Developer and Apurva Mody, Principal Program Manager ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

6:00 PM - 7:00 PM (UTC)

In this session, we will explore how to enhance your Retrieval-Augmented Generation (RAG) applications by integrating various communication channels, including chat, voice, SMS, and WhatsApp, using Azure Communication Services. By connecting the intelligence of a RAG app with these channels, you can create more versatile and user-friendly AI solutions. We'll show you how to implement these integrations to improve user engagement by using their preferred mode of communication. Presented by Milan Kaur, Product Manager at Microsoft Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack

3:00 PM - 4:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Learn how to develop apps using RAG with Java and Semantic Kernel. We'll walk through our RAG solution, showing the process of data ingestion with Azure Document Intelligence and AI Search, then walking through the RAG steps of query rewriting, hybrid search, and question answering. You'll learn how to easily bring your own data into the RAG solution and deploy it to Azure. Presented by Bruno Borges (Product Manager, Java), Davide Antelmo (Cloud Solution Architect, Java), John Oliver (Software Engineer, Semantic Kernel) ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

5:00 PM - 6:00 PM (UTC)

Artificial Intelligence is an amazing thing, but it gets even smarter when you can point it at your data. In this session, you'll learn how easy it can be to tap into the wealth of domain knowledge locked up in your organization's documents using RAG (Retrieval Augmented Generation) with Java and Spring AI. You have the power! Presented by Mark Heckler, Java Cloud Advocate ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

8:00 PM - 9:00 PM (UTC)

RAG (Retrieval Augmented Generation) is a way to get LLMs to answer questions grounded in a particular knowledge base. What do you do when your knowledge base includes images, like graphs or photos? You first need to generate embeddings using a multimodal model, like the one available from Azure Computer Vision, search those embeddings using a powerful vector search like Azure AI Search, and then send any retrieved text and images to a multimodal LLM like GPT-4o. Learn how to get started quickly with a RAG on multimodal documents in this session. Presented by Pamela Fox, Python Advocate at Microsoft ** Part of RAGHack, a free global hackathon to developer RAG applications. Join at https://aka.ms/raghack **

11:00 PM - 12:00 AM (UTC)

Building a RAG app for a non-English audience? Fortunately, language models and embedding models is that they understand a wide range of languages. Unfortunately, they have a bias towards English, so you need to choose your approach carefully when deploying them in other languages. In this session, we'll dive into tokenization, optimal data chunking strategies, and other best practices for internationalization. Presented by Anthony Shaw, Python Cloud Advocate and Renee Noble, Regional Cloud advocate. ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

3:00 PM - 4:00 PM (UTC)

Have you used a GitHub Copilot chat agent, like the powerful @workspace? You can build your own agent like that, to answer questions about your own domain or functionality. In this session, we'll show how you can quickly create your own customized GitHub Copilot Chat Agent Extension through the GitHub Copilot Chat Agent API combined with the Phi-3 model. Presented by Kinfey Lo, Cloud Advocate ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

5:00 PM - 6:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. Learn how to use Langchain, the most popular Python package for LLM orchestration, to build a RAG application with Python and Azure OpenAI. Discover how to use agentic flows in Langchain to build more complex RAG workflows. Presented by Marlene Mhangami, Developer Advocate for Python ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

10:00 PM - 11:00 PM (UTC)

Discover how to build a Python code interpreter tool using Azure OpenAI for the code generation and Azure Container Apps Dynamic Sessions for sandboxed code execution. See how the popular Langchain package makes it easy to generate step-by-step code generation, and how the default Dynamic Sessions environments can call popular third-party libraries like pandas and numpy. Presented by Anthony Chu, Product Manager for Azure Container Apps ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

3:00 PM - 4:00 PM (UTC)

Dive into the essentials of connecting AI and ML solutions using Azure AI Studio. This session will guide you through setting up AI Studio with best practices for security and access management, highlighting connections to key services such as Azure Cognitive Services, Azure Search, and Azure Storage Accounts. Whether you're implementing RAG chatbots or deploying models, discover how to protect your resources and ensure compliance across your enterprise. This session will highlight solutions from the Microsoft AI-In-a-Box framework, which you can find at aka.ms/ai-in-a-box. Presented by Chris Ayers, Customer Engineer, and Marco Aurelio Cardoso, Customer Engineer ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

5:00 PM - 6:00 PM (UTC)

In this session we will explore some of AutoGen foundational concepts such as enhanced inference, code executors, and more advanced concepts such as Agents and Agent flows. The session will leverage code both in Jupyter Notebooks and the Autogen Studio code. Session objectives: Basic understanding of some of the AutoGen's foundational and intermediate concepts Basic understanding of the AutoGen Studio code Building applications with AutoGen Session Repo: https://github.com/microsoft/autogen/tree/main/samples/apps/autogen-studio Presented by Alex Morales, Customer Engineering Manager at Microsoft ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

8:00 PM - 9:00 PM (UTC)

If you're trying to get an LLM to accurately answer questions about your own documents, you need RAG: Retrieval Augmented Generation. With a RAG approach, the app first searches a knowledge base for relevant matches to a user's query, then sends the results to the LLM along with the original question. What if you have documents that should only be accessed by a subset of your users, like a group or a single user? Then you need data access controls to ensure that document visibility is respected during the RAG flow. In this session, we'll show an approach using Azure AI Search with data access controls to only search the documents that can be seen by the logged in user. We'll also demonstrate a feature for user-uploaded documents that uses data access controls along with Azure Data Lake Storage Gen2. Presented by Matt Gotteiner, Product Manager for Azure AI Search, and Pamela Fox, Developer Advocate for Python ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

10:00 PM - 11:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most common approach used to get LLMs to answer questions grounded in a particular domain's data. RAG is a very good domain adaptation technic but sometimes doesn't meet quality expectations. RAFT (Retrieval augmented fine-tuning) is a new hybrid approach to LLM domain adaptation that combines RAG and fine-tuning. In this session, you'll learn how to implement RAFT using Azure AI Studio and its fine tuning capabilities. Presented by Cedric Vidal, AI Advocate for Startups ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

4:00 PM - 5:00 PM (UTC)

Building RAG and trying to decide what model to use? There are an increasing number of high-quality large language models available, many of which are now available from Azure AI, like OpenAi, Mistral, Cohere, Llama, Phi-3, and more. Which one do you use, and how do you easily switch between them? In this talk, we'll show you how to use the Azure AI inference SDK as well as orchestration libraries like Llamaindex to run the same code with different models. We'll talk about what models work best for different stages of RAG, plus how you can evaluate your choice. Presented by Facundo Santiago, Azure AI Product Manager ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

8:00 PM - 9:00 PM (UTC)

RAG (Retrieval Augmented Generation) is the most popular approach used to get LLMs to answer user questions grounded in a domain. How can you be sure that the answers are accurate, clear, and well formatted? Evaluation! In this session, we'll show you how to use Azure AI Studio and the Promptflow SDK to generate synthetic data and run bulk evaluations on your RAG app. Learn about different GPT metrics like groundedness and fluency, and consider other ways you can measure the quality of your RAG app answers. Presented by Pamela Fox, Python Advocate ** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **