Join failed : stream closed

UserBird
UserBird Dataiker, Alpha Tester Posts: 535 Dataiker
Hi,

I am trying to do a join a 2 dataset and the job keep failing. I get the error :

IO Exception: "java.io.IOException: Stream Closed"; "/home/dataiku/dss/tmp/dataset-to-h2/kXsmfIEs/dataset.h2.db" [90031-176], caused by: IOException: Stream Closed

Type: org.h2.jdbc.JdbcSQLException

Is it because my dataset are too big ?

thanks

Answers

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker
    It's indeed very possibly caused by a "disk full" situation. The "DSS" engine of the join recipe pulls all data from all datasets to the local disk to perform the join. As much as possible, we strongly recommend that you perform joins either on Spark, Hadoop or a SQL database
Setup Info
    Tags
      Help me…