Advanced Designer Learning Path is now live! Read More

Tried running manual scenario but fails at AssertionError

Level 2
Tried running manual scenario but fails at AssertionError

I have no idea how to solve this.


I've got two projects that share some datasets. For simplicity my summarized problem:


I have a small pipeline in project A, call it Teams. I've shared this dataset, the default CSV/Dataiku file based dataset, with project B, call it Projects.


I've created a manual scenario that first asks project A to forced recursive build the 'teams_available' dataset so that next I can build the dataset "projects_assigned" in project B using the shared dataset.

This fails as easy with 2 steps for no apparent reason but an assertion error.



With the relevant log only being:

[2019/02/14-15:14:52.425] [qtp1914740115-24] [ERROR] [] - Call failed
at com.dataiku.dip.dataflow.JobComputer.compute(
at com.dataiku.dip.dataflow.kernel.slave.KernelSession.resolve(
at com.dataiku.dip.dataflow.kernel.slave.KernelServlet.service(
at javax.servlet.http.HttpServlet.service(
at org.eclipse.jetty.servlet.ServletHolder.handle(
at org.eclipse.jetty.servlet.ServletHandler.doHandle(
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(
at org.eclipse.jetty.servlet.ServletHandler.doScope(
at org.eclipse.jetty.server.handler.ContextHandler.doScope(
at org.eclipse.jetty.server.handler.ScopedHandler.handle(
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(
at org.eclipse.jetty.server.Server.handle(
at org.eclipse.jetty.server.HttpChannel.handle(
at org.eclipse.jetty.server.HttpConnection.onFillable(
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
at org.eclipse.jetty.util.thread.QueuedThreadPool$
[2019/02/14-15:14:52.440] [qtp1914740115-24] [DEBUG] [] - Command /pintercom/resolve_job processed in 314ms
2019-02-14T15:14:52.447: Unexpected ERROR waiting for job to complete
com.dataiku.common.server.APIError$SerializedErrorException: Internal error, caused by: AssertionError: null
at com.dataiku.dip.dataflow.kernel.master.JobExecutionKernelHandle.executeCommand(
at com.dataiku.dip.dataflow.kernel.master.JobExecutionKernelHandle.executeCommand(
at com.dataiku.dip.dataflow.kernel.master.BuildService$


Leaving me no hints or whatsoever. What could cause this problem?

0 Kudos
4 Replies

This error means that the project the job is requested in doesn't exist. Could you check if the project key you're using is correct?
0 Kudos
Level 2
That was fast! Thanks for coming back to me this fast!

I am not sure what you mean because I am never asked for a proejct key at all. I just use the GUI and add scenario steps, "Build / Train", Add Dataset and select the correct dataset from the correct project. There is no mistaking that it is there. But I am never asked for any sort of project key. Am I missing something?
0 Kudos
It is not really possible/supported through the UI to trigger builds in other projects. I can't reproduce an issue similar to yours though
0 Kudos
Level 2
Ah you are right, you confused me with jobs and projects.

I found the problem. It is indeed that you have to create build jobs inside the project they reside. You can do those in a scenario inside that project, and share the scenario to another project so it builds the shared dataset for you.

Thanks for the quick reply!
0 Kudos
Labels (1)
A banner prompting to get Dataiku DSS