DSS Event server setup - Destination
I cannot logging to the destination folder in DSS event server.
Something can be wrong in my setting and I cannot find detail in DSS document.
Operating system used: centos
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,226 Dataiker
Hi,
The root path of the folder and the "path within connection" folder overlap.
You don't need /home/dkuevent/even_folder in the path within connection as it's already defined as the root path for the filesystem connection. You can only include test in the "path within connection"
Also, is DSS running on port 16000? By default, it's usually 11000 not sure if that could perhaps be a typo.
Also, have you enabled the event server?
If you checked the above steps and still can't get this working you can look at the DATADIR/run/eventserver.log for more information.
-
boksu Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Frontrunner 2022 Participant Posts: 6 Partner
Thanks for your answer.
Yes. I installed DSS using the port and I enabled event server.
This time, I changed the setting as the attached image and I got the following message in eventserver log.
Thanks.
[2022/03/08-06:34:54.304] [qtp1599556802-15] [ERROR] [dku.eventserver.configuration] - Additional exception while sending error
java.lang.NullPointerException
at com.dataiku.dip.DKUApp.hideErrorStacks(DKUApp.java:207)
at com.dataiku.dip.server.controllers.DIPInternalControllerBase.sendError(DIPInternalControllerBase.java:72)
at com.dataiku.dip.eventserver.ConfigurationServlet.doPost(ConfigurationServlet.java:36)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:569)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:501)
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
at java.lang.Thread.run(Thread.java:748) -
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,226 Dataiker
Hi,
Does the actual path exist on disk can you check with ls -ltr /path/define/in/you/fs-like/connection?
Also can you please add the dss user in the "Write as user" field and see if you see the same exception in the logs.
-
boksu Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Frontrunner 2022 Participant Posts: 6 Partner
Hi,
There is the folder.
[dkuevent@osboxes event_folder]$ pwd
/home/dkuevent/event_folderAnd I changed the setting as the attached image and I got the following message this time.
Thanks.
[2022/03/08-07:05:00.552] [qtp1599556802-15] [ERROR] [dku.eventserver.configuration] - Additional exception while sending error
java.lang.NullPointerException
at com.dataiku.dip.DKUApp.hideErrorStacks(DKUApp.java:207)
at com.dataiku.dip.server.controllers.DIPInternalControllerBase.sendError(DIPInternalControllerBase.java:72)
at com.dataiku.dip.eventserver.ConfigurationServlet.doPost(ConfigurationServlet.java:36)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:569)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:501)
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
at java.lang.Thread.run(Thread.java:748)
[2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Performing periodic flush
[2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Flush complete
[2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Performing periodic flush
[2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Flush complete -
boksu Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Frontrunner 2022 Participant Posts: 6 Partner
I attached the wrong image.
see this image.
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,226 Dataiker
The last entries :
[2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Performing periodic flush
[2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Flush complete
[2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Performing periodic flush
[2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Flush completeLook normal are you not seeing any events published?