RAGAs- A Framework for Evaluating RAG Applications

RAGAs- A Framework for Evaluating RAG Applications

Gao Dalie (高達烈)

5 месяцев назад

4,527 Просмотров

#langchain #rag #llm #chatbot #chatgpt #ai #machinelearning
Enter RAG pipelines combine retrieval and language generation modules to enhance natural language processing tasks. With RAGAS, you can assess the performance of RAG systems without relying on human annotations, making evaluation cycles faster and more efficient.

Timestamps:
0:00 - Intro
01:11 - What are RAGAs
01:43 - Evaluate the RAG pipeline
02:24 - Evaluation Metrics
02:37 - FAITHFULNESS
02:53 - ANSWER RELEVANCE
02:59 - CONTEXT RELEVANCE
03:13 - CONTEXT RECALL
03:23 - CONTEXT PRECISION
03:42 - Install
04:14 - OpenAI
04:45 - PDF
05:27 - Index, split, embeddings
06:41 -Create List ground_truths
07:32 - Convert dict to dataset
07:53 - Conclusion

FOLLOW ME :

Subscribe Newsletter for free: https://substack.com/@gaodalie
Follow me on Twitter: https://twitter.com/mr_tarik098
Follow me on Linkedin: https://shorturl.at/dnvEX
Follow me on Medium: https://medium.com/@mr.tarik098
More Ideas On My Page: https://quickaitutorial.com/
Buy me a Coffee: https://www.buymeacoffee.com/gaodalie98d

[Must Read]

LangGraph + Corrective RAG + Local LLM = Powerful Rag Chatbot : https://quickaitutorial.com/langgraph-corrective-rag-local-llm-powerful-rag-chatbot/
Five Technique : VLLM + Torch + Flash_Attention =Super Local LLM : https://quickaitutorial.com/five-technique-vllm-torch-flash_attention-super-local-llm/
[ollama libraries 🦙] Run Any Chatbot Free Locally on Your Computer: https://quickaitutorial.com/ollama-libraries-%f0%9f%a6%99-run-any-chatbot-free-locally-on-your-computer/


[Must Watch]

LangGraph + Corrective RAG + Local LLM = Powerful Rag Chatbot : https://www.youtube.com/watch?v=NBuKzZJ3jRU&t=345s
Five Techniques: How To Speed Your Local LLM Chatbot Performance - Here The Result: https://www.youtube.com/watch?v=_IfiAFiZssM
[Miqu-1–70b] Where does Miqu come from? : https://www.youtube.com/watch?v=LlU8VQVfXk8

[Link Used]

Blog: https://docs.ragas.io/
Github: https://github.com/explodinggradients/ragas
Code : https://github.com/weaviate/recipes/blob/main/evaluation/Ragas/RAGAs-RAG-langchain.ipynb

Additional Tags and Keywords:
#AI #Chatbot #langchain #RAG #RAGAs #SuperAI #python #Technology #Innovation #ArtificialIntelligence #MachineLearning #NaturalLanguageProcessing #VirtualAssistant #Automation #HumanComputerInteraction #ConversationalAI #DigitalTransformation #Tech #video #llmlingua #microsoftresearch
Ссылки и html тэги не поддерживаются


Комментарии: