Chat with CSV Streamlit Chatbot using Llama 2: All Open Source

I tried the same code and data file, but the results seems very inaccurate

sir can you tell us how we can make csv and excel file reader and also give predictions on any type of excel and csv file and after this we will able to extract the information in the form of pdf means value able pdf with information and save to local system if you said to do this project private i will pay to you also! all think look this video but with openai means with openapi key! with also spech to text. I will "pay" for it!
Thanks

sir can you tell us how we can make csv and excel file reader and also give predictions on any type of excel and csv file and after this we will able to extract the information in the form of pdf means value able pdf with information and save to local system if you said to do this project private i will pay to you also! all think look this video but with openai means with openapi key! with also spech to text. I will "pay" for it!
Thanks

ModuleNotFoundError: No module named 'streamlit_chat' i get this error please help me

Thanks for sharing!

If I ask this chat What commands from the pandas python library to know China's GDP does it provide me with this type of information or not?

Why we are not using CSV_Agent from the Langchain here , will it perform better than this

I used your code as refrence and used llama 2 13B model for my CSVs, all the results I got were nonsensical. Then I used your exact code from github, it looked preetier but all the results were non-sense. Any guidance on how to improve accuracy?

Too slow to be useable...nice idea.

Your videos are very informative. I have a doubt to clarify regarding training the data. I have dataset in csv format which contains car details like name, brand, model, speification about car. One car information in a row with multiple columns. How to train this data in order for LLM to answer my questions like number of cars manufactured by TATA? etc...I see lot of examples using OpenAI. But when i try to use Llama2, the answers are not great. In this example also, when you ask number of countries available in 2019.csv, it is not giviing enough information. Can you please provide help to understand how to make LLM to work for these kind of data?

Great video

very good video, you don't beat around the bush, which i like very much concise and to the point. All of your examples show cpu what if we have gpu and would like to use it. What changes or the imports you will make to make it run on gpu and make it run faster. Please point out those elements in your videos. I remember compiling your code and notices one or two modules without gpu support. Please love to hear back from you

Thank you so much for the video @aianytime! The app isn't running on my device tho. Its taking too much time to run

Hi this is an amazing project but when I ran the same i get an error message stating 'Your app is having trouble loading the streamlit_chat.streamlit_chat component.' and I'm not sure why. Can you please help ?

Hi, Thank you very much for this informative video and using an open source llm.
Could you please explain that how the LLM is retrieving the data from CSV. Does it have the knowledge of whole data uploaded by the user?

Is the csv loaded to streamlit safe , thank you for your video amazing work

1. Is there anything extra we need to do for running on GPU?
2. If I deploy my project, if 10 users search simultaneously. How the usage will be? will each user take up the entire RAM on cloud. How should I do for 1000s of users?

I'm having problems trying out this on MacOs m1 chip :( it stays stuck after getting the query/question :(

How can we show steps, like you showed in medical chatbot using chainlit

Very informative, thanks for sharing.
When I try to run the code I get this error for model = "llama-2-7b-chat.ggmlv3.q8_0.bin": Please make sure you specified the correct `repo_id` and `repo_type`.
If you are trying to access a private or gated repo, make sure you are authenticated... Do I miss something?

Hi, thanks for the video, very informative. I was thinking, can you show how you can do this exactly same thing but using Pandas Ai together with Llama2 instead of OpenAI? Thanks again

May I know why you didn't use an Agent? For example instead of CSVLoader, could we have used create_csv_agent(llm, path) ? Trying to understand the difference.

Also please make video on hosting this on Azure App service.....just a small 5 mins video

Hi , i am getting correct answers from 2019.csv i asked what is the GDP of china? Answer : The GDP of china is not reported as it is not one of the countries listed in the context provided . IS there something i am doing wrong here

I'm impressed with this video, and I want to thank you for your hard work. Have you thought about making a video about DemoGPT?

It is taking 10 mins or for every response and response also not accurate. Is it same for all??

Thank you for this video but i keep getting the error "You exceeded your current quota, please check your plan and billing details.... Why??

Where did you learn all this?

I am seeing streamlit Running but notseeing any response in even 10 to 15 mins as well.. The response
takes longer time?

In my case returns wrong answer 😛

Model: Llama 2 7B Chat
Question: Which actor made the movie with worse rating?
Answer: Based on the information provided, Michael Johnson made the movie with the worse rating, Movie C in 2018 with a rating of 6.8.
Correct Answer: Isabella Garcia,Movie L,2022,6.5

Data:
actor,movie,year,rating
John Doe,Movie A,2010,8.5
Jane Smith,Movie B,2015,7.9
Michael Johnson,Movie C,2018,6.8
Emily Brown,Movie D,2012,9.0
Robert Lee,Movie E,2019,8.2
Sophia Kim,Movie F,2014,7.3
William Chen,Movie G,2016,8.7
Olivia Wong,Movie H,2020,7.5
James Rodriguez,Movie I,2011,8.9
Ava Martinez,Movie J,2017,7.1
Liam Ramirez,Movie K,2013,9.2
Isabella Garcia,Movie L,2022,6.5
Ethan Nguyen,Movie M,2009,8.0
Mia Ali,Movie N,2013,7.6
Alexander Wilson,Movie O,2016,8.4
Sofia Anderson,Movie P,2018,7.8
Daniel Thomas,Movie Q,2021,8.3
Camila Hernandez,Movie R,2014,7.2
Joseph Scott,Movie S,2015,8.1
Victoria Lopez,Movie T,2019,7.4

Can't we use 7B model from Meta for this?

I ran the application on my machine. It worked perfectly =) Thank you.

Excellent..Thanks for sharing

Very nice and informative. If you can show how you deploy and create web versions that would be highly helpful.

This is so informative and useful. Can you make a video for the same if you have pdfs and you have to make mcq questions and the answer should be like both a b or b c or c d likewise. Thank you

you deserve more followers

Excellent explaination can u explain how to connect to postgress database

Thank you so much for information and tutorial ! you really help us all understand everything better.

I can notice few countries in example dataset having GDP less than Chad. For example row 124 and 130. So what is the best possible way to get correct answer in this case.

is much difficult to run it on GPU (if you have the required hardware)?

why i could do not get the right answer?

Why can't you fine tune llama2 and use

My script will run and display no errors, bu nothing appears when I upload my csv file. Why might this be? Great video by the way. Thank you very much!

Thanks for the information. I'm going to try it and I'll be telling you about it. Great job!

Thank you for this awesome tutorial but how i can make it understand another language and respond to this language example Greek or German or Hindi ?

Superrrr, thanks for your valuable content....

I create character ai bot prompts and have a great business idea. I just dont know how to build these back end or gui. Let me know if you are intetested. Ill dm you a sample of one of my bots or if you have a discord.

So what if I don't want to download the model and still reference it? Where do I need to deploy the model?

Thank you for the detailed information. CSV loader works fine in single csv file however if i have a multiple csv's i tried with directory loader and see the accuracy of the result is very poor. we observed few more things during chunking process, its chunking every row and its loosing the context with previous row or aggregate the rows together. It would be good if you explain the chunking/embedding in more details. choosing the right chunking and embedding are very much important to get the accurate result. Keep doing the good work!!!