how can I use the LLM api hosted in dataiku?
we have some models running on dataiku. But currently I can only find the python client. Even I get the rest apis,
the response from these apis are so different from the officials api, like sonnet. This is not good if I want to integrate
the api to other tools. Like, I would like to initegrate the API to vscode plugin or some other IDE as code assistant.
do we have any way to do this?
Answers
-
Hi,
You may find useful information in:
Hope this helps.
Best
-
Thanks for your reply. But all your replies does not help here.
This is how the IDE extension can do and specifically VScode:
The VSCode extension for Dataiku DSS enables you to connect to a Dataiku instance from your VSCode desktop environment and edit the following items:
I really do not want to edit anything in dss project.
As I said above, I want to use the LLM deployed in my project in vscode or other IDE for code assistant.
Look at your rest api here: it is so raw, like it is not complete. Only three llm mesh api here, but look at the python client code, there are more. And the request data is missing. Whenver I call the api, if error, I would got a great chunk of Java Error. And I have to find the clue in this pile of crap.
Nowadays, everyone's API is either compatible with openai or anthropic. And I found a openai compatible
but the plugin is removed or not supported.
So the only option is to use your LLM Mesh API? I wonder can you make it compatible to openai api or claude api schema? Or anyother languages, like tytpescript sdk support?
-
when I call api of llm mesh, there is finish reason like: "finishReason": "unknown". That's really not good. I would expect a finish reaons making any sense.
