Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Programmatically RAG: Running an enriched LLM query using augmented LLM
Added on April 19, 2024 1:27AM
Likes: 0
Replies: 2
areisdorf
Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 5 ✭✭✭
I have an issue with applying an augmented LLM after following this tutorial: https://developer.dataiku.com/latest/tutorials/machine-learning/genai/nlp/llm-mesh-rag/index.html
I am using Dataiku 12.6.
I have a knowledge bank and augmented LLM that I would like to use to utilize in a webapp, however I keep getting the following error:
DataikuException: java.lang.IllegalArgumentException: RAG query server init failed: {"errorType":"\u003cclass \u0027ModuleNotFoundError\u0027\u003e","message":"No module named \u0027langchain_community\u0027","traceback":[["/home/azureuser/dataiku-dss-12.6.0/python/dataiku/llm/rag/rag_query_server.py",44,"serve","import langchain_community"]],"type":"ERROR"}
I also have langchain_community installed into my env to try and correct the issue, but this didn't help.
Answers
-
Hello,
I just re-ran the tutorial, and it's working fine on my end. Are you running the tutorial's code, or did you add your own code?Please check your code environment and try to rebuild from scratch.
-
areisdorf Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 5 ✭✭✭
I was able to run it successfully using the provided pdf link in the training.
However it would fail when it was any other document. All the subsequent steps would run successfully, but I still get the same error message when running:
resp = chain({"input_documents":search_results, "question": query})
DataikuException: java.lang.IllegalArgumentException: RAG query server init failed: {"errorType":"\u003cclass \u0027ModuleNotFoundError\u0027\u003e","message":"No module named \u0027langchain_community\u0027","traceback":[["/home/azureuser/dataiku-dss-12.6.0/python/dataiku/llm/rag/rag_query_server.py",44,"serve","import langchain_community"]],"type":"ERROR"}
