Exception: Unable to instanciate a new dataset writer. There is already another active writer for th
rdagumampan
Registered Posts: 3 ✭
Exception: Unable to instanciate a new dataset writer. There is already another active writer for this dataset
Is there a way to allow many active writers to a data set? I have python call backs that can be called after each call from data source. When we parallelize the call to data source and write result to dataset as call back, we get this error and we have missing data in datasets. Even so, the job shows its sucessful.
[2024/08/08-12:20:58.381] [kubectl-stream-logs-out-75] [INFO] [dku.utils] - Exception: Unable to instanciate a new dataset writer. There is already another active writer for this dataset
Operating system used: Windows
Tagged: