DSS Event server setup - Destination

Options
boksu
boksu Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Frontrunner 2022 Participant Posts: 6 Partner

I cannot logging to the destination folder in DSS event server.

Something can be wrong in my setting and I cannot find detail in DSS document.

Event_server_destination_connection.JPG

Event_server_destination.JPG

Event_source.JPG


Operating system used: centos

Tagged:

Answers

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 Dataiker
    Options

    Hi,

    The root path of the folder and the "path within connection" folder overlap.

    You don't need /home/dkuevent/even_folder in the path within connection as it's already defined as the root path for the filesystem connection. You can only include test in the "path within connection"

    Also, is DSS running on port 16000? By default, it's usually 11000 not sure if that could perhaps be a typo.

    Also, have you enabled the event server?

    https://doc.dataiku.com/dss/latest/operations/audit-trail/eventserver.html#installing-the-event-server

    If you checked the above steps and still can't get this working you can look at the DATADIR/run/eventserver.log for more information.

  • boksu
    boksu Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Frontrunner 2022 Participant Posts: 6 Partner
    Options

    Thanks for your answer.

    Yes. I installed DSS using the port and I enabled event server.

    This time, I changed the setting as the attached image and I got the following message in eventserver log.

    Thanks.

    Event_server_destination1.JPG

    [2022/03/08-06:34:54.304] [qtp1599556802-15] [ERROR] [dku.eventserver.configuration] - Additional exception while sending error
    java.lang.NullPointerException
    at com.dataiku.dip.DKUApp.hideErrorStacks(DKUApp.java:207)
    at com.dataiku.dip.server.controllers.DIPInternalControllerBase.sendError(DIPInternalControllerBase.java:72)
    at com.dataiku.dip.eventserver.ConfigurationServlet.doPost(ConfigurationServlet.java:36)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
    at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:569)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
    at org.eclipse.jetty.server.Server.handle(Server.java:501)
    at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
    at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
    at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
    at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
    at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
    at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
    at java.lang.Thread.run(Thread.java:748)

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 Dataiker
    Options

    Hi,

    Does the actual path exist on disk can you check with ls -ltr /path/define/in/you/fs-like/connection?

    Also can you please add the dss user in the "Write as user" field and see if you see the same exception in the logs.

  • boksu
    boksu Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Frontrunner 2022 Participant Posts: 6 Partner
    Options

    Hi,

    There is the folder.

    [dkuevent@osboxes event_folder]$ pwd
    /home/dkuevent/event_folder

    And I changed the setting as the attached image and I got the following message this time.

    Thanks.

    Event_server_destination2.JPG

    [2022/03/08-07:05:00.552] [qtp1599556802-15] [ERROR] [dku.eventserver.configuration] - Additional exception while sending error
    java.lang.NullPointerException
    at com.dataiku.dip.DKUApp.hideErrorStacks(DKUApp.java:207)
    at com.dataiku.dip.server.controllers.DIPInternalControllerBase.sendError(DIPInternalControllerBase.java:72)
    at com.dataiku.dip.eventserver.ConfigurationServlet.doPost(ConfigurationServlet.java:36)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
    at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:569)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
    at org.eclipse.jetty.server.Server.handle(Server.java:501)
    at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
    at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
    at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
    at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
    at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
    at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
    at java.lang.Thread.run(Thread.java:748)
    [2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Performing periodic flush
    [2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Flush complete
    [2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Performing periodic flush
    [2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Flush complete

  • boksu
    boksu Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Frontrunner 2022 Participant Posts: 6 Partner
    Options

    I attached the wrong image.

    see this image.

    Event_server_destination3.JPG

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 Dataiker
    Options

    The last entries :

    [2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Performing periodic flush
    [2022/03/08-07:06:23.028] [pool-19-thread-1] [INFO] [dku.event] - Flush complete
    [2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Performing periodic flush
    [2022/03/08-07:06:54.341] [pool-20-thread-1] [INFO] [dku.event] - Flush complete

    Look normal are you not seeing any events published?

Setup Info
    Tags
      Help me…