Retrieval Augmented Generations Tutorial Question

Gipple
Gipple Registered Posts: 11 ✭✭✭
edited November 26 in Setup & Configuration

In the tutorial

Tutorial | Use the Retrieval Augmented Generation (RAG) approach for question-answering

There is prerequisite section that says the following:

  • A compatible code environment for retrieval augmented models. This environment must be created beforehand by an administrator in the Administration panel > Settings > Misc. > Retrieval augmented generation code environment.

Can someone help me figure out where this is located? I am on the web hosted version and can't find anything like the above. If I go into Code Envs I can create a new python environment, but don't see anything for the retreival augmented generation code.

Answers

  • LucOBrien
    LucOBrien Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 12 ✭✭✭

    Hello,

    Full disclosure, I have not played with anything along these lines. However, I think you might be on the right track, based on this site:
    https://doc.dataiku.com/dss/latest/generative-ai/rag.html#on-dataiku-cloud

    Hope that helps!

  • Gipple
    Gipple Registered Posts: 11 ✭✭✭

    Thanks for your response. This is what I see. I am just completely lost on what I am supposed to do.

  • Gipple
    Gipple Registered Posts: 11 ✭✭✭

    This entire tutorial is a mess. It tells me to use the AI prepare button on the left. I don't see it so let's figure out how to install it.
    https://knowledge.dataiku.com/latest/data-preparation/prepare-recipe/concept-ai-prepare.html

    I have no idea where this menu is. Anywhere there is a settings menu, there is no AI Services.

    Is the documentation just really out of date? I don't feel like it should be this difficult.

  • LucOBrien
    LucOBrien Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 12 ✭✭✭
    edited November 26

    Are you in a trial instance, or a fully paid instance (maybe ran by your company)? I'm wondering if you need to be an instance administrator to activate the required settings/tools/plugins/etc.

    For example, I am at a company that has not yet released the RAG or other LLM tools for widespread general usage so we cannot see any of those plugins. Advanced LLM Mesh is disabled under the "License" tab of the DSS Settings screen.

    I am also not an admin of my instance, so I cannot see "deeper" administrator settings. I'll see if i can set up a trial account tomorrow to do this same course you are trying to do and get it to work properly.

    Edit:
    This is from another Dataiku site that discusses connections (AI / LLM in this case) that shows more "options" on the DSS Settings page than I have:

    It looks like you would need to go into "settings" shown in the above screenshot and then find "AI Services" based on the details that you shared above? The page I linked above does specify that Instance Administrators can configure connections to LLMs.

  • Gipple
    Gipple Registered Posts: 11 ✭✭✭

    Thanks for your response.

    I had contacted support about this, and for the AI services it was an extension that needs to be installed apparently. The support just created the code environment for me. I don't know if I am able to create these on my own or not.

    But the bigger issue is that all of the documentation for stuff like this is for the desktop version. This isn't the first time I was unable to follow the instructions because of the version I am on. If anyone at Dataiku reads these forums, please work on updating your documentation to accommodate people on different versions. This is a really frustrating/time wasting process, when I have to reach out to support to accomplish something that is incomplete in your documentation.

Setup Info
    Tags
      Help me…