Weird issue since last automatic update of Hestia email email aliases

andrewnewby · June 19, 2022, 7:03am

Hi,

Since the update on the 16th, we have a weird issue with alias deliveries. If you send externally to an alias email account it works fine . However, when we send from a local sendmail request, the email never arrives. We’ve tried setting the email to the primary email address (which the aliases are linked to), and it arrives fine - but isn’t really a solution.

I’ve taken a look over exim4.template.conf to see if I can spot anything, but can’t see anything. Is anyone else having this issue? Is it a known problem?

Thanks!

Andy

eris · June 19, 2022, 9:45am

Add in /etc/exim4/domains/{domain}/limits:

[email protected]:200 and it will work. There is currently in the relay script When you have a different from adress then the actual account login in…

andrewnewby · June 19, 2022, 11:29am

Thanks - I’ve added that in. Will that be fixed up in future versions, where aliases are also added to the limits file automatically?

BrandCom · June 19, 2022, 1:07pm

I think I have the same problem. Till now I could send emails from a not exists email address, if it was NOT added as an alias it worked too. Maybe from Hestia 1.6 it doesn’t, I got “SMTP hiba (550): ...... Email account XXX is sending too many emails - rate overlimit”. After I added the not exists and not alias e-mail to /etc/exim4/domains/{domain}/limits file I could send.

Felix · June 19, 2022, 2:03pm

I can confirm that the solution from @eris works for me as well. But I have the same question as @andrewnewby about fixing that issue in future versions of Hestia. I believe quite a few people who are using Hestia CP do rely on email aliases.

eris · June 20, 2022, 8:52am

I agree this should change:

See [Bug] Email account is sending too many emails - rate overlimit · Issue #2666 · hestiacp/hestiacp · GitHub

andrewnewby · June 27, 2022, 7:42am

FYI, I just updated in the admin interface the limits for a domain:

https://org2022.mysite.org:9183/edit/mail/?domain=mysite.org&token=xxxx

When updating, it doesn’t also update the limits file (still shows 200, even though I set it to 10000)

Cheers

Andy

eris · June 27, 2022, 7:52am

/etc/exim/limits is always kept at 200. It is always kept as a fallback

It should update the file in /etc/exim4/domains/{domain}/limits

andrewnewby · June 27, 2022, 8:15am

haha ok definatly something funky going on

If I edit the email account itself (not the mail domain), it works fine and updates right away in /home/chambres/conf/mail/foo.org

However, when I edit the mail domain - it seems to be “1 step out”. So, I set it to 10000 and then update. It doesn’t change to 10000, it set the limits files to whatever the last setting was. Change it to 11000, and then when saved it changes the limits file to 10000

Almost like its taking the OLD value and updating the limits file, and then updating the file? (not too sure how it works in the code)

ALSO - it still won’t send over the limits , no matter what I send it to We still get:

eris · June 27, 2022, 10:44am

Limits for php scrips are still set in

github.com

hestiacp/hestiacp/blob/62d7a82830295e418b5602e64e8470a1e95b4f10/install/deb/exim/exim4.conf.template#L100-L101

      
        
            deny    message       = Website of user $authenticated_id is sending too many emails - rate overlimit = $sender_rate / $sender_rate_period
            ratelimit             = 200 / 1h / $authenticated_id

eris · June 27, 2022, 10:53am

Rebuild mail domain before updating value will not help imo will change it

andrewnewby · June 27, 2022, 12:02pm

Ahhh that was it. I didn’t realise PHP (or in my case, Perl) scripts had a different setting! Thats working now

andrewnewby · June 29, 2022, 8:17am

Seeing some weird errors again since last nights update. Not sure if its related:

[Wed Jun 29 05:18:11 2022] [error] [pid 1519828] Apache2__Log.h(331): [client [Wed Jun 29 05:18:11 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 1.0 / 1h\n
[Wed Jun 29 05:25:19 2022] [error] [pid 1519487] Apache2__Log.h(331): [client [Wed Jun 29 05:25:19 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 1.8 / 1h\n
[Wed Jun 29 05:25:52 2022] [error] [pid 1583176] Apache2__Log.h(331): [client [Wed Jun 29 05:25:52 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 2.8 / 1h\n
[Wed Jun 29 05:26:00 2022] [error] [pid 1519487] Apache2__Log.h(331): [client [Wed Jun 29 05:26:00 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 3.8 / 1h\n
[Wed Jun 29 06:41:54 2022] [error] [pid 1519828] Apache2__Log.h(331): [client [Wed Jun 29 06:41:54 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 1.6 / 1h\n
[Wed Jun 29 06:45:59 2022] [error] [pid 1519479] Apache2__Log.h(331): [client [Wed Jun 29 06:45:59 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 2.5 / 1h\n
[Wed Jun 29 06:50:15 2022] [error] [pid 1519479] Apache2__Log.h(331): [client [Wed Jun 29 06:50:15 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 3.3 / 1h\n
[Wed Jun 29 07:12:22 2022] [error] [pid 1583176] Apache2__Log.h(331): [client [Wed Jun 29 07:12:22 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 3.1 / 1h\n
[Wed Jun 29 07:17:42 2022] [error] [pid 1519479] Apache2__Log.h(331): [client [Wed Jun 29 07:17:42 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 3.8 / 1h\n
[Wed Jun 29 07:30:36 2022] [error] [pid 1519476] Apache2__Log.h(331): [client [Wed Jun 29 07:30:36 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 4.0 / 1h\n
[Wed Jun 29 07:31:14 2022] [error] [pid 1526950] Apache2__Log.h(331): [client [Wed Jun 29 07:31:14 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 4.9 / 1h\n
[Wed Jun 29 07:43:37 2022] [error] [pid 1519492] Apache2__Log.h(331): [client [Wed Jun 29 07:43:37 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 4.9 / 1h\n
[Wed Jun 29 07:52:21 2022] [error] [pid 1583192] Apache2__Log.h(331): [client [Wed Jun 29 07:52:21 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 5.2 / 1h\n
[Wed Jun 29 07:54:19 2022] [error] [pid 1519482] Apache2__Log.h(331): [client [Wed Jun 29 07:54:19 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 6.0 / 1h\n
[Wed Jun 29 07:54:20 2022] [error] [pid 1519479] Apache2__Log.h(331): [client [Wed Jun 29 07:54:20 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 7.0 / 1h\n
[Wed Jun 29 07:57:10 2022] [error] [pid 1583176] Apache2__Log.h(331): [client [Wed Jun 29 07:57:10 2022] -e: Unable to send message: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 7.6 / 1h\n
[Wed Jun 29 08:01:09 2022] [error] [pid 2173033] Apache2__Log.h(331): [client [Wed Jun 29 08:01:09 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 8.1 / 1h\n
[Wed Jun 29 08:01:09 2022] [error] [pid 1519482] Apache2__Log.h(331): [client [Wed Jun 29 08:01:09 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 9.1 / 1h\n
[Wed Jun 29 08:01:28 2022] [error] [pid 1583192] Apache2__Log.h(331): [client [Wed Jun 29 08:01:28 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 10.1 / 1h\n
[Wed Jun 29 08:01:33 2022] [error] [pid 1526950] Apache2__Log.h(331): [client [Wed Jun 29 08:01:33 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 11.1 / 1h\n
[Wed Jun 29 08:02:24 2022] [error] [pid 1519479] Apache2__Log.h(331): [client [Wed Jun 29 08:02:24 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 11.9 / 1h\n
[Wed Jun 29 08:02:50 2022] [error] [pid 1519828] Apache2__Log.h(331): [client [Wed Jun 29 08:02:50 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 12.8 / 1h\n
[Wed Jun 29 08:02:59 2022] [error] [pid 1526950] Apache2__Log.h(331): [client [Wed Jun 29 08:02:59 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 13.8 / 1h\n
[Wed Jun 29 08:03:10 2022] [error] [pid 1526950] Apache2__Log.h(331): [client [Wed Jun 29 08:03:10 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 14.7 / 1h\n
[Wed Jun 29 08:03:15 2022] [error] [pid 1519482] Apache2__Log.h(331): [client [Wed Jun 29 08:03:15 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 15.7 / 1h\n
[Wed Jun 29 08:03:20 2022] [error] [pid 2173040] Apache2__Log.h(331): [client [Wed Jun 29 08:03:20 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 16.7 / 1h\n
[Wed Jun 29 08:03:23 2022] [error] [pid 1583192] Apache2__Log.h(331): [client [Wed Jun 29 08:03:23 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 17.7 / 1h\n
[Wed Jun 29 08:03:25 2022] [error] [pid 1519492] Apache2__Log.h(331): [client [Wed Jun 29 08:03:25 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 18.7 / 1h\n
[Wed Jun 29 08:03:26 2022] [error] [pid 2173040] Apache2__Log.h(331): [client [Wed Jun 29 08:03:26 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 19.7 / 1h\n
[Wed Jun 29 08:03:29 2022] [error] [pid 1519479] Apache2__Log.h(331): [client [Wed Jun 29 08:03:29 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 20.6 / 1h\n
[Wed Jun 29 08:03:31 2022] [error] [pid 1583192] Apache2__Log.h(331): [client [Wed Jun 29 08:03:31 2022] -e: Unable to send mail: Unable to send email: SMTP: Local user '[email protected]' unknown on host 'localhost'. Server said: 550 Email account  is sending too many emails - rate overlimit = 21.6 / 1h\n

I have this set for the scripts in exim4:

acl_not_smtp:
  deny    message       = Website of user $authenticated_id is sending too many emails - rate overlimit = $sender_rate / $sender_rate_period
  ratelimit             = 10000 / 1h / $authenticated_id

eris · June 29, 2022, 8:22am

How do you send the email via mail function?

According the warning you authenticate?

Email account is sending too many emails - rate overlimit

andrewnewby · June 29, 2022, 8:39am

Just goes out via sendmail using piping in Perl

According the warning you authenticate?

Nah - just basic sendmail:

sendmail($email->as_string, { to => \@to });

Is it possible to just comment this out for now?

acl_not_smtp:
  deny    message       = Website of user $authenticated_id is sending too many emails - rate overlimit = $sender_rate / $sender_rate_period
  ratelimit             = 10000 / 1h / $authenticated_id

Some of our scripts are failing due to cutting off after the email send, so its breaking the site atm

eris · June 29, 2022, 8:43am

Probably you need to comment out both:

Both blocks for authenticated and for the users

github.com

hestiacp/hestiacp/blob/0c80559f127f64ea0ebe7275392c99bd5cad82f0/install/deb/exim/exim4.conf.4.94.template#L95-L129

      
        
            acl_not_smtp:
              deny    message       = Website of user $authenticated_id is sending too many emails - rate overlimit = $sender_rate / $sender_rate_period
              ratelimit             = 200 / 1h / $authenticated_id
            
            
  warn    ratelimit     = 100 / 1h / strict / $authenticated_id
              log_message           = Sender rate [limitlog]: log / account / $authenticated_id / $sender_rate / $sender_rate_period
            
            
  accept
            
            
acl_check_spammers:
              accept  hosts         = +whitelist
            
            
  drop    message       = Your host in blacklist on this server.
                      log_message   = Host in blacklist
                      hosts         = +spammers
            
            
  accept
            
            

            
acl_check_mail:

This file has been truncated. show original

andrewnewby · June 29, 2022, 8:50am

Thanks. So just to be sure, comment out all of the above in exim4.conf.template:

#acl_not_smtp:
#  deny    message       = Website of user $authenticated_id is sending too many emails - rate overlimit = $sender_rate / $sender_rate_period
#  ratelimit             = 10000 / 1h / $authenticated_id
#
#  warn    ratelimit     = 100 / 1h / strict / $authenticated_id
#  log_message           = Sender rate [limitlog]: log / account / $authenticated_id / $sender_rate / $sender_rate_period
#
#  accept
#
#acl_check_spammers:
#  accept  hosts         = +whitelist
#
#  drop    message       = Your host in blacklist on this server.
#          log_message   = Host in blacklist
#          hosts         = +spammers
#
#  accept

eris · June 29, 2022, 8:55am

Yes …

andrewnewby · June 29, 2022, 8:58am

Thanks. I’ve made that change and will keep an eye on the apache error log to see if it comes up again It would be interesting to know why its doing it though (apart from the initial email issues we had when the limits were introduced, it had sorted itself out until last nights update)

eris · June 29, 2022, 9:00am

We made some small changes and it seems in some edge cases it still breaks. Mainly when the authenticated id is different as the sending domain.

In your cause I have no idea why it didn’t work as it was send with out autentication

How ever this should solve it: