-
Import multiple files in a "managed folder" and create an "original dataset" column containing the f
Hello, It would be cool to have the possibility to import multiple files in a "managed folder" and create a vertically-stacked dataset, and choosing to have an "original dataset" column containing the imported file names. Best regards
-
Read CSVs from a folder
I have a folder with CSVs in it (by "folder" I mean the thing you get when you're doing +dataset -> Folder from the flow) . They are named "dataset_01", "dataset_02" and so on. I'm trying to read one of them in a Python recipe. What's the code ? I tried something like this, but it wants me to add "path_of_csv" to inputs,…
-
How to read file with Python from HDFS managed folder
Hello Could you give example how to read csv file with Python\panda from HDFS managed folder? Thanks Milko
-
Export to folder : different name each day
I'm using an "export to folder" recipe to create a CSV that can then be used by other components. I'd like the CSVs to be named depending on the day they are exported : - export_2017-01-25.csv - export_2017-01-26.csv - export_2017-01-27.csv How can I do so ?
-
Can I populate dataset by adding folder instead of files?
When I populate mnist dataset, I have to create each folder one by one, like creating folder 0, 1, 2, ...9, then upload files to each of these folders. I would like to know if there is easy way to populate dataset from the parent folder, which the sub folders have been well organized on my local disk.
-
Folder deleting uploaded files
I have created a series of folders to store uploaded files (.csv). This folder is connected to a python recipe that connects to the folder, and uses a read_csv loop to read in each file and append it to a dataframe. The dataframe then outputs to a dataset. This all works fine, but the folder is sporadically deleting all of…
-
How to move files between managed folders with Python
Dear Community, does somebody know how to move files between managed folders with Python? Is it possible? One idea is that the file can be read from one managed folder firstly and written into one another managed folder, after that then delete the file. But I can't find one method to delete files in managed folder. Could…
-
attach file in folder in scenario
we are using dataiku 5.0.4 during the first step of the scenario, we build a folder by "add folder to build" our second step is send message and we want to attach a file in the previous folder that we build. but in the attchment section, both file in folder and folder contents could not see the folder in the drop down…
-
Are Managed Folder ID's unique across projects?
I have obtained the ID of a Managed Folder and used it to obtain a handle on the Folder using the REST API. However, I am wondering if the ID is guaranteed to be unique across all projects in Dataiku - this will help determine if I need to call get_managed_folder() from the project rather than the top-level API client.
-
How to read files in shared managed folder?