CSV file: Getting 'Connection broken: IncompleteRead' Error

mafatma
Level 1
CSV file: Getting 'Connection broken: IncompleteRead' Error
Hi,

I'm trying to read a 42MB csv file with a python recipe but I get the following error:
: Connection broken: IncompleteRead(0 bytes read, 2 more expected)

Can someone help please?

Thank you,

Fatma
0 Kudos
3 Replies
apichery
Dataiker
The error means that the connection was broken while Python was reading data. It could be a timing issue (your code takes too long to read the data and the server on the other end cut the connection because it has been established for too long).

If you are reading the csv file over http, are you able to read it with a wget command or a browser?

Could you share your code here?
0 Kudos
mafatma
Level 1
Author
I imported the csv file in dataiku datasets and tried to read it with dataiku.Dataset("df").get_dataframe()

If I try it in a flow of recipes where I make operations on other large datasets, I get the IncompleteRead Error, however, if it's done separately (outside the flow), it works.

But I need to do it in the flow.
0 Kudos
apichery
Dataiker
Does it work in a notebook in DSS? (When you edit a recipe, you have a button to edit it in a notebook).
Otherwise, the best way to solve your problem is to contact Dataiku support.
0 Kudos

Labels

?
Labels (3)
A banner prompting to get Dataiku