Retrieval Augmented Generations Tutorial Question

Gipple

In the tutorial

Tutorial | Use the Retrieval Augmented Generation (RAG) approach for question-answering

There is prerequisite section that says the following:

• A compatible code environment for retrieval augmented models. This environment must be created beforehand by an administrator in the Administration panel > Settings > Misc. > Retrieval augmented generation code environment.

Can someone help me figure out where this is located? I am on the web hosted version and can't find anything like the above. If I go into Code Envs I can create a new python environment, but don't see anything for the retreival augmented generation code.

LucOBrien

Hello,

Full disclosure, I have not played with anything along these lines. However, I think you might be on the right track, based on this site:
https://doc.dataiku.com/dss/latest/generative-ai/rag.html#on-dataiku-cloud

Hope that helps!

Gipple

https://community.dataiku.com/discussion/comment/44965#Comment_44965

Thanks for your response. This is what I see. I am just completely lost on what I am supposed to do.

Gipple

This entire tutorial is a mess. It tells me to use the AI prepare button on the left. I don't see it so let's figure out how to install it.
https://knowledge.dataiku.com/latest/data-preparation/prepare-recipe/concept-ai-prepare.html

I have no idea where this menu is. Anywhere there is a settings menu, there is no AI Services.

Is the documentation just really out of date? I don't feel like it should be this difficult.

LucOBrien

Are you in a trial instance, or a fully paid instance (maybe ran by your company)? I'm wondering if you need to be an instance administrator to activate the required settings/tools/plugins/etc.

For example, I am at a company that has not yet released the RAG or other LLM tools for widespread general usage so we cannot see any of those plugins. Advanced LLM Mesh is disabled under the "License" tab of the DSS Settings screen.

I am also not an admin of my instance, so I cannot see "deeper" administrator settings. I'll see if i can set up a trial account tomorrow to do this same course you are trying to do and get it to work properly.

Edit:
This is from another Dataiku site that discusses connections (AI / LLM in this case) that shows more "options" on the DSS Settings page than I have:

It looks like you would need to go into "settings" shown in the above screenshot and then find "AI Services" based on the details that you shared above? The page I linked above does specify that Instance Administrators can configure connections to LLMs.