How to debug Dataiku libraries + Llama3 DKUChatLLM bind_tools NotImplementedError

MichaelKarpe

I am trying to reproduce the Text-to-SQL WebApp of the Dataiku Gallery on Dataiku 13+ with a Llama 3 connection and I am facing a NotImplementedError when executing DKUChatLLM().bind_tools(). Here is the code I am executing (after having set a proper LLM_ID), which you can find in the file web_apps/x9jctZd/backend.py here: Webapp | Dataiku

llm = DKUChatLLM(llm_id=LLM_ID, temperature=0)

llm = llm.bind_tools(tools, parallel_tool_calls=False)

If you have no idea on how to solve this, could you please at least guide me on how I could try to debug the code as in a proper IDE when we develop locally? I'd want to dig in in the dataiku library to understand where it fails exactly.

Also, can we find the code behind the Dataiku libraries online? For instance, I couldn't find anywhere on the internet the definition of the DKUChatLLM class.

Alexandru

Hi,
To find the code behind this webapp, you can download the project from :

https://downloads.dataiku.com/public/dss-samples/EX_LLM_STARTER_KIT/dss-13/dss-tutorial-EX_LLM_STARTER_KIT.zip
Note this information is in the wiki of the project on gallery.

Can you please open a support ticket with the full code you are trying to run ?
You can find a detailed example here : https://developer.dataiku.com/latest/concepts-and-examples/llm-mesh.html#using-tool-calls

As for the underlying code, it's not in the public repository, but given DSS installer is publically available, you can inspect the Python file in the INSTALL_DIR for the DKUChatLLM class.

Thanks