LLM Mesh with "Azure OpenAI" connection

btorb
btorb Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1

We have 12.3 and want to use the LLM Mesh capabilities. We have an Azure openAI backend up and running. In the administration section, I create a new LLM connection for Azure OpenAI. The connection is marked as "successfull" when pressing the "Test" button. This connection is saved.

When running the LLM Classify tutorial I can created the visual recipe for LLM classify. Step 1 is then to configure the connection and choose the connection via the dropdown list. Unfortunately, my Azure OpenAI connection does not show up.

I tested a few things and saw that only "OpenAI" connections (and, e.g., not the "azure openai") show up in the dropdown list. Is there a way to get the LLM visual recipes to work with an Azure openAI connection?

Answers

  • Antal
    Antal Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 91 Neuron

    Not the most helpful reply probably, but I can confirm that the visual recipes work with our Azure OpenAI connection. So, it's surely something with the configuration.

  • AgatheG
    AgatheG Dataiker, Registered Posts: 37 Dataiker

    Hi btorb,

    Did you add deployments to your Azure OpenAI connection?

    Agathe

Setup Info
    Tags
      Help me…