Export Python Dataset to Flow Error

Options
WayneKhan
WayneKhan Registered Posts: 7 ✭✭✭✭

Hi,

I have created a dataset using python. I followed the suggestion in the link below to export it to my flow.

https://community.dataiku.com/t5/Using-Dataiku-DSS/save-out-a-file-from-IPython-notebook/m-p/2039

However, upon exporting I am getting this error. My company is using vertica.

Exception caught while writingTraceback (most recent call last):File "/opt/dataiku-dss-6.0.3/python/dataiku/core/dataset_write.py", line 218, in runself.streaming_api.wait_write_session(self.session_id)File "/opt/dataiku-dss-6.0.3/python/dataiku/core/dataset_write.py", line 181, in wait_write_sessionraise Exception(u'An error occurred during dataset write (%s): %s' % (id, decoded_resp["message"]))Exception: An error occurred during dataset write (vFVTjq4t06): SQLSyntaxErrorException: [Vertica][VJDBC](4367) ROLLBACK: Permission denied for schema publicRemoteStreamWriter thread failedTraceback (most recent call last):File "/opt/dataiku-dss-6.0.3/python/dataiku/core/dataset_write.py", line 148, in runself.queue.task_done()File "/usr/lib/python3.5/queue.py", line 68, in task_doneraise ValueError('task_done() called too many times')
ValueError: task_done() called too many times

I also get this.

Exception: An error occurred during dataset write (vFVTjq4t06): SQLSyntaxErrorException: [Vertica][VJDBC](4367) ROLLBACK: Permission denied for schema public

Answers

  • Ludovic_Pénet
    Ludovic_Pénet Dataiker Posts: 7 Dataiker
    Options

    Hi.

    According to the error, you do not seem to have the right to write in the target schema of the database:

    Exception: An error occurred during dataset write (vFVTjq4t06): SQLSyntaxErrorException: [Vertica][VJDBC](4367) ROLLBACK: Permission denied for schema public

    Can you please check this with your DBA ?

  • WayneKhan
    WayneKhan Registered Posts: 7 ✭✭✭✭
    Options

    Thanks for the reply, I fixed the issue and now I am getting this error.

    An error occurred during dataset write (jehiYpcsAB): BatchUpdateException: [Vertica][VJDBC](100172) One or more rows were rejected by the server.
  • WayneKhan
    WayneKhan Registered Posts: 7 ✭✭✭✭
    Options

    Thanks for the reply, I fixed the issue and now I am getting this error.

    An error occurred during dataset write (jehiYpcsAB): BatchUpdateException: [Vertica][V
  • Ludovic_Pénet
    Ludovic_Pénet Dataiker Posts: 7 Dataiker
    Options

    Can you please copy the following lines of the error ?

  • WayneKhan
    WayneKhan Registered Posts: 7 ✭✭✭✭
    Options

    Hi,

    I noticed when i shrink the dataframe from 200K lines to 15K lines it works, but ideally i'd like the 200K one. This is a copy of the error message pop up

    """Oops: an unexpected error occurred

    Unable to create directory /mnt/marketing/FGG/PCAN

    Please see our options for getting help

    """HTTP code: 500, type: java.io.IOException"""

  • Ludovic_Pénet
    Ludovic_Pénet Dataiker Posts: 7 Dataiker
    Options

    It looks like a permission error...

    Can you please copy/paste more lines of the error ? Do not be afraid to put too many of them.

  • WayneKhan
    WayneKhan Registered Posts: 7 ✭✭✭✭
    Options

    I don't know how to get more lines of the error, when I view the Jobs the error isn't in there.

    When my dataframe has run i type it all in and click export

    WayneKhan_0-1584122693103.png

    Then I do this.

    WayneKhan_1-1584122733121.png

    and then i get this error

    WayneKhan_3-1584122803207.png

Setup Info
    Tags
      Help me…