Programmatically RAG: Running an enriched LLM query using augmented LLM

areisdorf
areisdorf Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 4 ✭✭✭
edited July 16 in Using Dataiku

I have an issue with applying an augmented LLM after following this tutorial: https://developer.dataiku.com/latest/tutorials/machine-learning/genai/nlp/llm-mesh-rag/index.html

I am using Dataiku 12.6.

I have a knowledge bank and augmented LLM that I would like to use to utilize in a webapp, however I keep getting the following error:

DataikuException: java.lang.IllegalArgumentException: RAG query server init failed: {"errorType":"\u003cclass \u0027ModuleNotFoundError\u0027\u003e","message":"No module named \u0027langchain_community\u0027","traceback":[["/home/azureuser/dataiku-dss-12.6.0/python/dataiku/llm/rag/rag_query_server.py",44,"serve","import langchain_community"]],"type":"ERROR"}

I also have langchain_community installed into my env to try and correct the issue, but this didn't help.

Answers

  • Mattsco
    Mattsco Dataiker, Registered Posts: 125 Dataiker

    Hello,


    I just re-ran the tutorial, and it's working fine on my end. Are you running the tutorial's code, or did you add your own code?

    Please check your code environment and try to rebuild from scratch.



    Screenshot 2024-04-19 at 12.02.04 PM.png

  • areisdorf
    areisdorf Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 4 ✭✭✭

    I was able to run it successfully using the provided pdf link in the training.

    However it would fail when it was any other document. All the subsequent steps would run successfully, but I still get the same error message when running:

    resp = chain({"input_documents":search_results, "question": query})

    DataikuException: java.lang.IllegalArgumentException: RAG query server init failed: {"errorType":"\u003cclass \u0027ModuleNotFoundError\u0027\u003e","message":"No module named \u0027langchain_community\u0027","traceback":[["/home/azureuser/dataiku-dss-12.6.0/python/dataiku/llm/rag/rag_query_server.py",44,"serve","import langchain_community"]],"type":"ERROR"}

Setup Info
    Tags
      Help me…