Community Conundrum 25: Feature Visualization is now live! Read More

BERT Model

Level 2
BERT Model

Dataiku published a natural language processing article which states different models that can be used including BERT. I really would like to use BERT inside the DSS to train on the datasets we have. 

Can you provide some guidance on how to load the BERT model inside DSS? Perhaps we can start with the models from TF Hub. 

Thanks, 

Vinh

1 Reply
Dataiker
Dataiker

Hi,

As of today, using BERT in DSS can be achieved with python code. You can use any library such as tensorflow-hub or huggingface, as you would do outside of DSS.

Optionally, you can use the dataiku API to store model files in a DSS managed folder.

Note that we plan to add transformers models such as BERT to the NLP Embedding plugin.

Best regards,

Alex