How to rate limit number of records processed per second

Manish_V
Manish_V Registered Posts: 3

Hello,

I'm new to dataiku and I have a scenario where I have to send emails. Now I am using send_emails plugin to send emails, but my smtp server has a limit that it can process only 40 mails/second and I want to ensure that only 30 mails are being sent per second. Is there anything that can limit only 30 records being processed in a second much like throttle tool in alteryx

Operating system used: linux

Answers

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,160 Neuron

    I would move away from using the send_emails plugin and use the channel.send() API to send emails directly from Python. Once you are in Python you can implement a sleep or even retries and back off if your SMTP server is grumpy.

Setup Info
    Tags
      Help me…