How to rate limit number of records processed per second
Manish_V
Registered Posts: 3 ✭
Hello,
I'm new to dataiku and I have a scenario where I have to send emails. Now I am using send_emails plugin to send emails, but my smtp server has a limit that it can process only 40 mails/second and I want to ensure that only 30 mails are being sent per second. Is there anything that can limit only 30 records being processed in a second much like throttle tool in alteryx
Operating system used: linux
Tagged:
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,088 Neuron
I would move away from using the send_emails plugin and use the channel.send() API to send emails directly from Python. Once you are in Python you can implement a sleep or even retries and back off if your SMTP server is grumpy.