Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Exception: Unable to instanciate a new dataset writer. There is already another active writer for th
Added on August 8, 2024 1:04PM
Likes: 0
Replies: 0
rdagumampan
Registered Posts: 3 ✭
Exception: Unable to instanciate a new dataset writer. There is already another active writer for this dataset
Is there a way to allow many active writers to a data set? I have python call backs that can be called after each call from data source. When we parallelize the call to data source and write result to dataset as call back, we get this error and we have missing data in datasets. Even so, the job shows its sucessful.
[2024/08/08-12:20:58.381] [kubectl-stream-logs-out-75] [INFO] [dku.utils] - Exception: Unable to instanciate a new dataset writer. There is already another active writer for this dataset
Operating system used: Windows