Tried running manual scenario but fails at AssertionError

casper Registered Posts: 42 ✭✭✭✭

I have no idea how to solve this.

I've got two projects that share some datasets. For simplicity my summarized problem:

I have a small pipeline in project A, call it Teams. I've shared this dataset, the default CSV/Dataiku file based dataset, with project B, call it Projects.

I've created a manual scenario that first asks project A to forced recursive build the 'teams_available' dataset so that next I can build the dataset "projects_assigned" in project B using the shared dataset.

This fails as easy with 2 steps for no apparent reason but an assertion error.


With the relevant log only being:

[2019/02/14-15:14:52.425] [qtp1914740115-24] [ERROR] [] - Call failed<BR />java.lang.AssertionError<BR /> at com.dataiku.dip.dataflow.JobComputer.compute(<BR /> at com.dataiku.dip.dataflow.kernel.slave.KernelSession.resolve(<BR /> at com.dataiku.dip.dataflow.kernel.slave.KernelServlet.service(<BR /> at javax.servlet.http.HttpServlet.service(<BR /> at org.eclipse.jetty.servlet.ServletHolder.handle(<BR /> at org.eclipse.jetty.servlet.ServletHandler.doHandle(<BR /> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(<BR /> at org.eclipse.jetty.servlet.ServletHandler.doScope(<BR /> at org.eclipse.jetty.server.handler.ContextHandler.doScope(<BR /> at org.eclipse.jetty.server.handler.ScopedHandler.handle(<BR /> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(<BR /> at org.eclipse.jetty.server.Server.handle(<BR /> at org.eclipse.jetty.server.HttpChannel.handle(<BR /> at org.eclipse.jetty.server.HttpConnection.onFillable(<BR /> at$<BR /> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(<BR /> at org.eclipse.jetty.util.thread.QueuedThreadPool$<BR /> at<BR />[2019/02/14-15:14:52.440] [qtp1914740115-24] [DEBUG] [] - Command /pintercom/resolve_job processed in 314ms<BR />2019-02-14T15:14:52.447: Unexpected ERROR waiting for job to complete<BR />com.dataiku.common.server.APIError$SerializedErrorException: Internal error, caused by: AssertionError: null<BR /> at com.dataiku.dip.dataflow.kernel.master.JobExecutionKernelHandle.executeCommand(<BR /> at com.dataiku.dip.dataflow.kernel.master.JobExecutionKernelHandle.executeCommand(<BR /> at com.dataiku.dip.dataflow.kernel.master.BuildService$

Leaving me no hints or whatsoever. What could cause this problem?


Best Answer


  • casper
    casper Registered Posts: 42 ✭✭✭✭
    That was fast! Thanks for coming back to me this fast!

    I am not sure what you mean because I am never asked for a proejct key at all. I just use the GUI and add scenario steps, "Build / Train", Add Dataset and select the correct dataset from the correct project. There is no mistaking that it is there. But I am never asked for any sort of project key. Am I missing something?
  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer Posts: 753 Dataiker
    It is not really possible/supported through the UI to trigger builds in other projects. I can't reproduce an issue similar to yours though
  • casper
    casper Registered Posts: 42 ✭✭✭✭
    Ah you are right, you confused me with jobs and projects.

    I found the problem. It is indeed that you have to create build jobs inside the project they reside. You can do those in a scenario inside that project, and share the scenario to another project so it builds the shared dataset for you.

    Thanks for the quick reply!
Setup Info
      Help me…