Export Python Dataset to Flow Error

WayneKhan

Hi,

I have created a dataset using python. I followed the suggestion in the link below to export it to my flow.

https://community.dataiku.com/t5/Using-Dataiku-DSS/save-out-a-file-from-IPython-notebook/m-p/2039

However, upon exporting I am getting this error. My company is using vertica.

Exception caught while writing
Traceback (most recent call last):
  File "/opt/dataiku-dss-6.0.3/python/dataiku/core/dataset_write.py", line 218, in run
    self.streaming_api.wait_write_session(self.session_id)
  File "/opt/dataiku-dss-6.0.3/python/dataiku/core/dataset_write.py", line 181, in wait_write_session
    raise Exception(u'An error occurred during dataset write (%s): %s' % (id, decoded_resp["message"]))
Exception: An error occurred during dataset write (vFVTjq4t06): SQLSyntaxErrorException: [Vertica][VJDBC](4367) ROLLBACK: Permission denied for schema public
RemoteStreamWriter thread failed
Traceback (most recent call last):
  File "/opt/dataiku-dss-6.0.3/python/dataiku/core/dataset_write.py", line 148, in run
    self.queue.task_done()
  File "/usr/lib/python3.5/queue.py", line 68, in task_done
    raise ValueError('task_done() called too many times')

ValueError: task_done() called too many times

I also get this.

Exception: An error occurred during dataset write (vFVTjq4t06): SQLSyntaxErrorException: [Vertica][VJDBC](4367) ROLLBACK: Permission denied for schema public

Ludovic_Pénet

Hi.

According to the error, you do not seem to have the right to write in the target schema of the database:

Exception: An error occurred during dataset write (vFVTjq4t06): SQLSyntaxErrorException: [Vertica][VJDBC](4367) ROLLBACK: Permission denied for schema public

Can you please check this with your DBA ?

WayneKhan

Thanks for the reply, I fixed the issue and now I am getting this error.

An error occurred during dataset write (jehiYpcsAB): BatchUpdateException: [Vertica][VJDBC](100172) One or more rows were rejected by the server.

WayneKhan

Thanks for the reply, I fixed the issue and now I am getting this error.

An error occurred during dataset write (jehiYpcsAB): BatchUpdateException: [Vertica][V

Ludovic_Pénet

Can you please copy the following lines of the error ?

WayneKhan

Hi,

I noticed when i shrink the dataframe from 200K lines to 15K lines it works, but ideally i'd like the 200K one. This is a copy of the error message pop up

"""Oops: an unexpected error occurred

Unable to create directory /mnt/marketing/FGG/PCAN

Please see our options for getting help

"""HTTP code: 500, type: java.io.IOException"""

Ludovic_Pénet

It looks like a permission error...

Can you please copy/paste more lines of the error ? Do not be afraid to put too many of them.

WayneKhan

I don't know how to get more lines of the error, when I view the Jobs the error isn't in there.

When my dataframe has run i type it all in and click export

Then I do this.

and then i get this error