Discover this year's submissions to the Dataiku Frontrunner Awards and give kudos to your favorite use cases and success stories!READ MORE

DSS Event server setup - Destination

Boksu_Oh
Level 2
Level 2
DSS Event server setup - Destination

I cannot logging to the destination folder in DSS event server.

Something can be wrong in my setting and I cannot find detail in DSS document.

 

Event_server_destination_connection.JPG

 

Event_server_destination.JPG

 

Event_source.JPG


Operating system used: centos

0 Kudos
6 Replies
AlexT
Dataiker
Dataiker

Hi,

The root path of the folder and the "path within connection" folder overlap. 

You don't need /home/dkuevent/even_folder in the path within connection as it's already defined as the root path for the filesystem connection. You can only include test in the "path within connection"

Also, is DSS running on port 16000? By default, it's usually 11000 not sure if that could perhaps be a typo.

Also, have you enabled the event server? 

https://doc.dataiku.com/dss/latest/operations/audit-trail/eventserver.html#installing-the-event-serv...

If you checked the above steps and still can't get this working you can look at the DATADIR/run/eventserver.log for more information.

0 Kudos
Boksu_Oh
Level 2
Level 2
Author

Thanks for your answer.

Yes. I installed DSS using the port and I enabled event server. 

This time, I changed the setting as the attached image and I got the following message in eventserver log.

Thanks.

 

Event_server_destination1.JPG

[2022/03/08-06:34:54.304] [qtp1599556802-15] [ERROR] [dku.eventserver.configuration] - Additional exception while sending error
java.lang.NullPointerException
at com.dataiku.dip.DKUApp.hideErrorStacks(DKUApp.java:207)
at com.dataiku.dip.server.controllers.DIPInternalControllerBase.sendError(DIPInternalControllerBase.java:72)
at com.dataiku.dip.eventserver.ConfigurationServlet.doPost(ConfigurationServlet.java:36)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:569)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:501)
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
at java.lang.Thread.run(Thread.java:748)

0 Kudos
AlexT
Dataiker
Dataiker

Hi,

Does the actual path exist on disk can you check with ls -ltr /path/define/in/you/fs-like/connection?

Also can you please add the dss user in the "Write as user" field and see if you see the same exception in the logs.  

0 Kudos
Boksu_Oh
Level 2
Level 2
Author

Hi,

There is the folder.

[dkuevent@osboxes event_folder]$ pwd
/home/dkuevent/event_folder

And I changed the setting as the attached image and I got the following message this time.

Thanks.

 

Event_server_destination2.JPG

 

[2022/03/08-07:05:00.552] [qtp1599556802-15] [ERROR] [dku.eventserver.configuration] - Additional exception while sending error
java.lang.NullPointerException
at com.dataiku.dip.DKUApp.hideErrorStacks(DKUApp.java:207)
at com.dataiku.dip.server.controllers.DIPInternalControllerBase.sendError(DIPInternalControllerBase.java:72)
at com.dataiku.dip.eventserver.ConfigurationServlet.doPost(ConfigurationServlet.java:36)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:569)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:501)
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
at java.lang.Thread.run(Thread.java:748)
[2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Performing periodic flush
[2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Flush complete
[2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Performing periodic flush
[2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Flush complete

 

0 Kudos
Boksu_Oh
Level 2
Level 2
Author

I attached the wrong image.

see this image.

 

Event_server_destination3.JPG

0 Kudos
AlexT
Dataiker
Dataiker

The last entries :

[2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Performing periodic flush
[2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Flush complete
[2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Performing periodic flush
[2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Flush complete

 

Look normal are you not seeing any events published? 

0 Kudos