Real-Time Training Graph - API?
deeplearnyogi
Registered Posts: 9 ✭✭✭✭
When I am building a deep learning model, I'm having a hard-time getting real-time plots of the training metrics. I have tried loading tensorboard during the training, but I have to press the refresh button each time.
One of my favorite features of DSS is that it provides a real-time plot of the training. Do you have tutorials on how to create those plots so we can view the training in real-time? Or is there an DSS API we can use to implement in our code to utilize those features in our notebook.
Answers
-
Hi,
If you train tensorflow models in code, I recommend using tensorboard with the custom "--reload_interval SECONDS" setting. By default this setting is at 30 seconds, you can lower it to get near real-time.
Best regards,
Alex