Skip to content

    Speculative RAG with Groq

    Created by
    MartinBowling
    MartinBowling
    Remixed from
    MartinBowling/MoA Chat with Groq

    Speculative Retrieval-Augmented Generation (RAG) Demo

    Dive into the future of AI-powered question answering with this Speculative RAG demo! šŸš€šŸ¤–

    This project showcases an innovative approach to handling complex queries using a dream team of AI models:

    šŸ¤” A quick-thinking Generalist to assess query complexity šŸ“š A knowledgeable Specialist to dive deep into documents šŸ‘Øā€āš–ļø A wise Judge to select the best answers

    Features:

    • Handles both simple and complex queries efficiently
    • Leverages multiple documents for context-aware responses
    • Balances speed and depth in AI interactions
    • Uses cutting-edge language models via the Groq API

    Try it out:

    1. Enter your query
    2. Upload up to two Markdown documents
    3. Watch as our AI team crafts the perfect response!

    Perfect for developers, researchers, and anyone curious about the latest in AI technology. Fork this Repl to start experimenting with Speculative RAG today!