Reading compressed pickled files from managed folder using joblib

PARTEEK · March 2022

I have saved compressed pickle files in a managed folder. Normally, I read it as follows:

with open(pickle_file,'''rb') as f:

load(f)

How do I read it from a managed folder?

Sarina · March 2022

Hi @pkansal
,

You can read objects from managed folders, including pickle files like so:

import dataiku
folder = dataiku.Folder("folder_name")
with folder.get_download_stream(pickle_file) as f:
  model = f.read()

Let us know if you have any questions about this.

Thank you,
Sarina

PARTEEK · March 2022

The file is compressed with LZMA. How do I specify that compression here?

Answers