• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

Amazon SES and max emails per second

#1
Is anyone using Amazon SES for email? My current send rate is 5 emails per second (max 10k). The max per 24 hours is 10k which is fine for now.

The 5 email per second has me concerned. Two scenarios:

1) A thread that is heavily subscribed to gets a reply. XF sends out notices to 50 subscribers of new post. If sending all at once will breach the 5 emails per second.

2) Newsletter mailing to all members. No delay will likely blow past 5 emails per second.

Questions:

1) Does anyone have a higher send rate than 5 per second?

2) How many emails is XF likely to attempt to send per second all out speed?

3) Is there any simple way to "throttle" the send?

4) I think I read that Amazon SES dumps any emails exceeding the send rate instead of queuing them. Stupid IMHO but if this is the case no choice but to increase send rate per second or devise a send throttle mod

thanks
 

WSWD

Well-known member
#2
I obviously haven't looked at the XF code, but any decent script is going to throttle emails. Somebody from XF is going to have to answer your questions specifically, but I would be shocked if XF just blasts out all the emails at once.
 

trizz

Active member
#3
Sending Quota: send 100000 emails per 24 hour period
Quota Used: 2% as of 2013-09-21 05:58 UTC-4
Max Send Rate: 28 emails/second

if you ask for a higher quota, they will give it to you.
 

Floren

Well-known member
#4
Is anyone using Amazon SES for email? My current send rate is 5 emails per second (max 10k). The max per 24 hours is 10k which is fine for now.
Did you checked how many emails you send every day? logwatch will do that for you automatically, if you want a detailed report you can look at qshape. IMO, Amazon SES is used for sending large amounts of emails, (i.e. 1 million emails/day). Postfix can handle a HUGE amount of emails with its fairness and no thundering herd features.
 
#5
Sending Quota: send 100000 emails per 24 hour period
Quota Used: 2% as of 2013-09-21 05:58 UTC-4
Max Send Rate: 28 emails/second

if you ask for a higher quota, they will give it to you.

Ok I asked and got up to 14 messages per second. However xenforo tries to send 30 or so per batch per second so half get dumped.

Can any of the xenforo coders give me the script where to insert a sleep function that delays the next batch (I think it is 30 per batch default on xenforo). Might be something where a counter is used and ever 10 emails the script waits 1.5 seconds until the next 10 are sent using modulus function to see if multiple of 10 if I recall
 

trizz

Active member
#6
Ok I asked and got up to 14 messages per second. However xenforo tries to send 30 or so per batch per second so half get dumped.

Can any of the xenforo coders give me the script where to insert a sleep function that delays the next batch (I think it is 30 per batch default on xenforo). Might be something where a counter is used and ever 10 emails the script waits 1.5 seconds until the next 10 are sent using modulus function to see if multiple of 10 if I recall
im not pushing xF email thru SES yet, and likely wont. i migrated to mandrill a few weeks ago for deeper analytics for delivery, click thru, etc and couldnt be happier. now i can find out which specific user(s) have click the spam button and ask whats up.

i had no idea xF batches email in blocks of 30. youd think that would be a configureable option....

ill likely be pushing xF email thru mandrill in a few weeks
 

Jim Boy

Well-known member
#7
Amazon SES is not well suited to large Xenforo installations. We normally clock up about 10000 emails a day without blinking and we were booted from there withing a couple of days because our bounce rate was too high. I'm glad we hadn't sent out one of our regular newsletters which can number around 100,000 in a day.

While it is cheap it is pretty much their worst service and I think they only do it cos 'they have to'

A better solution is to send email out from your xenforo installation, or another box within your VPC - which is what we do. Very important thought to get sending restrictions lifted. AWS will choke outgoing SMTP traffic by default as a protection against spammers. To get it lifted, go to https://portal.aws.amazon.com/gp/aws/html-forms-controller/contactus/ec2-email-limit-rdns-request and fill in the details.
 
#8
My limit is 50k daily but that only comes with 14 emails/sec. Doing a newsletter seems to send well more than this number per second. At least 2x if not more. Amazon does not queue anything over the send rate.

I'm going to have to setup and maintain postfix or sendmail smtp on my server. Was hoping to avoid this and use SES.