Dataiku LLM/ GPT Model

M1-Nick
M1-Nick Registered Posts: 11 ✭✭

LLM are all the hype these days in AI development. Having the ability to train and deploy a LLM on your own data without running into issues where the data is sent to a third party is a must have for many organizations.

Databricks introduced their own LLM called Dolly https://www.databricks.com/blog/2023/04/12/dolly-first-open-commercially-viable-instruction-tuned-llm

This idea is for Dataiku to develop a LLM and make it available to customers as a model you can tune for your use-case.

5
5 votes

Developing · Last Updated

Comments

  • Krishna
    Krishna Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Product Ideas Manager Posts: 18 Dataiker

    Hi @M1-Nick
    , we are looking into introducing LLM fine-tuning.

    Would you be able to share more insight into what you are looking to achieve in your use case? Have you explored existing approaches? Any challenges or observations to share?

    Best,

    Krishna

  • davide445
    davide445 Registered Posts: 1

    @Krishna
    there is any news regarding DSS being able to manage LLM fine tuning?

    As business users we are interested in this feature, due our focus is business process, data discovery, extraction and preparation.

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,601 Neuron

    @M1-Nick

    FYI, earlier this week there was an announcement from Dataiku or some forthcoming features related to LLMs.

    https://blog.dataiku.com/llm-mesh

Setup Info
    Tags
      Help me…