bounce server stuck in Cron-running

A

AHK

Active Member
Hello,

my bounce server keep stuck in Cron-running for long long time, after i goto mysql and check there is no sql activity.
then i goto Emergency actions and
Change the status of stuck bounce servers from cron-running to active!
again after cron run , bounce server again stuck. I have around 100k emails in inbox and want to process them.
how can i do that?
one thing, bounce server is able to login and its using pop3 and i am processing 1000 emails , i also change to 200 but still same.

thanks
 
@twisted1919 as addressed by @AHK I'm facing the same issue. Using IMAP / POP3 tried reducing even to 500/200/100/50 Emails in one process! looking for your help. Thanks :)
 
AHK said:
Hello,

my bounce server keep stuck in Cron-running for long long time, after i goto mysql and check there is no sql activity.
then i goto Emergency actions and
Change the status of stuck bounce servers from cron-running to active!
again after cron run , bounce server again stuck. I have around 100k emails in inbox and want to process them.
how can i do that?
one thing, bounce server is able to login and its using pop3 and i am processing 1000 emails , i also change to 200 but still same.

thanks
Click to expand...
Osjtya said:
@twisted1919 as addressed by @AHK I'm facing the same issue. Using IMAP / POP3 tried reducing even to 500/200/100/50 Emails in one process! looking for your help. Thanks :)
Click to expand...
# try with imap
# rebuild mbx/imap/dovecot index
# try til fixed with one thread/no pcntl and see if mwz accesses it
# sometimes a malformated email can hang the process, then move some to a tmp folder, then see, then move them back
# worst case, create another bounce box and move them by imap/thunderbird or on server as file to new location, a few to start with
 
frm.mwz said:
# try with imap
# rebuild mbx/imap/dovecot index
# try til fixed with one thread/no pcntl and see if mwz accesses it
# sometimes a malformated email can hang the process, then move some to a tmp folder, then see, then move them back
# worst case, create another bounce box and move them by imap/thunderbird or on server as file to new location, a few to start with
Click to expand...
Thanks for your reply! I tried all :D
 
frm.mwz said:
Did you find the particular problem in your case?
Click to expand...
Nothing as such! But when I run in SSH command "/usr/bin/php -q /var/www/html/apps/console/console.php bounce-handler --verbose=1" then it process the emails... So this thing get stuck randomly :D
 
Osjtya said:
Nothing as such! But when I run in SSH command "/usr/bin/php -q /var/www/html/apps/console/console.php bounce-handler --verbose=1" then it process the emails... So this thing get stuck randomly :D
Click to expand...
Yes, randomly, oft when the index breaks due to odd access.
 
Hello,
I tried all too before posting, but nothing working. even i try in SSH same as @Osjtya
It was working fine before and it started when I update to 1.4.9.
 
Can you try making it run in a loop from command line and watch it till it shows any error?
Here's how to do it, just paste this in command line ( change /the/absolute/path/to/apps/console/console.php with your actual path ):
Code: 
while [ true ]; do sleep 2 && /usr/bin/php /the/absolute/path/to/apps/console/console.php bounce-handler --verbose=1; done
 
Hello @twisted1919,
Thanks for update and run above command and got bellow result, what i feel strange is
1. I have 2 POP3 bounce servers and when i run command only one bounce server show Cron-running while other shows active.
But it shows Opening the IMAP connection and IMAP connection closed?

here is output
[2017-11-17 11:43:27] - Starting...
[2017-11-17 11:43:27] - The lock has been acquired!
[2017-11-17 11:43:27] - Starting processing...
[2017-11-17 11:43:27] - Found 2 servers for processing...
[2017-11-17 11:43:27] - Started processing server ID 49.
[2017-11-17 11:43:27] - Started processing server ID 50.
[2017-11-17 11:43:27] - Fetching the results...
[2017-11-17 11:43:27] - Opening the IMAP connection.
[2017-11-17 11:43:27] - Fetching the results...
[2017-11-17 11:43:27] - Opening the IMAP connection.
[2017-11-17 11:43:27] - Connection opened successfully!
[2017-11-17 11:43:27] - Searching using following search string: UNDELETED SINCE "18-Sep-2017"
[2017-11-17 11:43:27] - Found 0 search results.
[2017-11-17 11:43:27] - Closing the IMAP connection.
[2017-11-17 11:43:27] - IMAP connection closed.
[2017-11-17 11:43:27] - Found 0 results.
[2017-11-17 11:43:27] - Finished processing server ID 50.
[2017-11-17 11:43:28] - Connection opened successfully!
[2017-11-17 11:43:28] - Searching using following search string: UNDELETED SINCE "18-Sep-2017"
[2017-11-17 11:52:53] - Search result error: Array
(
[0] => Unexpected characters at end of address: <>
[1] => Missing or invalid host name after @
[2] => Invalid mailbox list: <>
[3] => Invalid mailbox list: <<np345j23j26f9_sj949cw27j791@domain.com.com>>
[4] => Invalid mailbox list: <<bk866qgjz1caa_oj238tp01d2c7@domain.com.com>>
[5] => Invalid mailbox list: <<ee096y1l14974_no73498eddfd0@domain.com.com>>
[6] => Invalid mailbox list: <<np345j23j26f9_ms314pedfv6a7@domain.com.com>>
[7] => Invalid mailbox list: <<je926arvc2519_ov29432dd4925@domain.com.com>>
[8] => Invalid mailbox list: <<je926arvc2519_je462yy6vp175@domain.com.com>>
[9] => Invalid mailbox list: <<np345j23j26f9_sr7352lve9d37@domain.com.com>>
[10] => Invalid mailbox list: <<np345j23j26f9_hc8337wx38fec@domain.com.com>>
[11] => Invalid mailbox list: <>
[12] => Invalid mailbox list: <<vd309hort546a_fm247jt3s58c8@domain.com.com>>
[13] => Invalid mailbox list: <<je926arvc2519_bq717w7g6rc65@domain.com.com>>
[14] => Invalid mailbox list: <<ee096y1l14974_oj238tp01d2c7@domain.com.com>>
[15] => Invalid mailbox list: <>
[16] => Invalid mailbox list: <<zx846vn7rt114_dy664bvqded15@domain.com.com>>
[17] => Invalid mailbox list: <<cn031b4z5m18e_fm247jt3s58c8@domain.com.com>>
)


[2017-11-17 11:52:53] - Found 36288 search results.
[2017-11-17 11:52:53] - Scanning message ID: 434
[2017-11-17 11:52:53] - Done scanning message ID: 434
.....
[2017-11-17 11:52:57] - Scanning message ID: 602
....
[2017-11-17 11:53:05] - Scanning message ID: 966
.....
[2017-11-17 11:53:14] - Closing the IMAP connection.
[2017-11-17 11:53:31] - IMAP connection closed.
[2017-11-17 11:53:31] - Found 1000 results.
[2017-11-17 11:53:31] - Processing campaign uid: ha9481m9xp187 and subscriber uid nq549qg7es553.
[2017-11-17 11:53:31] - Subscriber uid: nq549qg7es553 is internal bounced with the message: smtp;550 5.4.1 [KQAyLB@MICROSOFT.COM]: Recipient address rejected: .ccess denied [BL2NAM06FT005.Eop-nam06.prod.protection.outlook.com]
[2017-11-17 11:53:31] - Processing campaign uid: ha9481m9xp187 and subscriber uid yd527b69cp80e.
....
....
[2017-11-17 12:30:36] - Finished processing server ID 49.
[2017-11-17 12:30:37] - Processing finished.
[2017-11-17 12:30:39] - Starting...
[2017-11-17 12:30:39] - The lock has been acquired!
[2017-11-17 12:30:39] - Starting processing...
[2017-11-17 12:30:39] - Found 2 servers for processing...
[2017-11-17 12:30:39] - Started processing server ID 49.
[2017-11-17 12:30:39] - Started processing server ID 50.
[2017-11-17 12:30:39] - Fetching the results...
[2017-11-17 12:30:39] - Opening the IMAP connection.
[2017-11-17 12:30:39] - Fetching the results...
[2017-11-17 12:30:39] - Opening the IMAP connection.
[2017-11-17 12:30:39] - Connection opened successfully!
[2017-11-17 12:30:39] - Searching using following search string: UNDELETED SINCE "18-Sep-2017"
[2017-11-17 12:30:39] - Found 0 search results.
[2017-11-17 12:30:39] - Closing the IMAP connection.
[2017-11-17 12:30:39] - IMAP connection closed.
[2017-11-17 12:30:39] - Found 0 results.
[2017-11-17 12:30:39] - Finished processing server ID 50.
[2017-11-17 12:30:40] - Connection opened successfully!
[2017-11-17 12:30:40] - Searching using following search string: UNDELETED SINCE "18-Sep-2017"
and here it stuck for long time and continue as before
[2017-11-17 12:40:47] - Processing campaign uid: ha9481m9xp187 and subscriber uid pp201of3d77e6.

and after that bellow keep on repeating

[2017-11-17 12:43:32] - Finished processing server ID 49.
[2017-11-17 12:43:33] - Processing finished.
[2017-11-17 12:43:35] - Starting...
[2017-11-17 12:43:35] - The lock has been acquired!
[2017-11-17 12:43:35] - Starting processing...
[2017-11-17 12:43:35] - Found 1 servers for processing...
[2017-11-17 12:43:35] - Started processing server ID 50.
[2017-11-17 12:43:35] - Fetching the results...
[2017-11-17 12:43:35] - Opening the IMAP connection.
[2017-11-17 12:43:36] - Connection opened successfully!
[2017-11-17 12:43:36] - Searching using following search string: UNDELETED SINCE "18-Sep-2017"
[2017-11-17 12:43:36] - Found 0 search results.
[2017-11-17 12:43:36] - Closing the IMAP connection.
[2017-11-17 12:43:36] - IMAP connection closed.
[2017-11-17 12:43:36] - Found 0 results.
[2017-11-17 12:43:36] - Finished processing server ID 50.
[2017-11-17 12:43:37] - Processing finished.
[2017-11-17 12:43:40] - Starting...
[2017-11-17 12:43:40] - The lock has been acquired!
[2017-11-17 12:43:40] - Starting processing...
[2017-11-17 12:43:40] - Found 1 servers for processing...
[2017-11-17 12:43:40] - Started processing server ID 50.
[2017-11-17 12:43:40] - Fetching the results...
[2017-11-17 12:43:40] - Opening the IMAP connection.
[2017-11-17 12:43:40] - Connection opened successfully!
[2017-11-17 12:43:40] - Searching using following search string: UNDELETED SINCE "18-Sep-2017"
[2017-11-17 12:43:40] - Found 0 search results.

Till now its continue repeating from almost 1 hour and its only repeating server ID 50, where server ID.49 still show Cron-running

Thanks
 
Yea, I have been facing same issue too. The new updated version of Mailwizz doesn't process bounces as that of before.
I have tried so many trick. Increased and decreased. All these all that....

I tried Imap/POP3 and still the same thing.

My server SPEC are very high and I don't think my server SPEC is the problem at all because other commands like sending of campaigns works very fine. Only the bounce server is having issue. Always keep stucking and sometimes if you do the emergency thingy it would take hours for it to start processing again.

Before the new versions, the older versions that works fine do process 100k+ within 2 hours on my server but now. Even to process 1k bounces takes 48 hours.

So generally, there's something phishing somewhere in the app.

Thank you!!!
 
@AHK - As far as i can see, your inbox contains badly formatted emails (see Search result error: above) and because of this php chokes and cannot continue.
Try to delete those emails manually from your bounce box, and then see how it goes. Unfortunately we cannot do a thing related to these things, you can just instruct your smtp server to not accept emails that are not properly formatted.
Also, before doing this, kill the command line command, reset the server statuses and just then run it again.

@Kollydaton - the version update has nothing to do with this, the bounce is affected by bad emails, by the number of emails and the size of the email. Let's see where the above takes us and if there's something we can do about it. You can run same checks like @AHK does.
 
@twisted1919 , So I just ran the command line via SSH. It took the application/server 3 minutes to scan 1,000 bounces and that's pretty cool and fast.

But processing it right now takes a lot of time and as far as I can see here
1 minutes per bounce.

It should be more faster than this since it could scan a whole 1,000 within 3 minutes ?
Processing should also be more faster.

Thanks
 
Kollydaton said:
But processing it right now takes a lot of time and as far as I can see here
1 minutes per bounce.
Click to expand...
This really depends on the message size and how many resources you have available for processing now, but overall is a slow process when the email has certain size.
 
twisted1919 said:
This really depends on the message size and how many resources you have available for processing now, but overall is a slow process when the email has certain size.
Click to expand...

If it is about resources, I have more than enough resources. My server is 24cpu and still have 20CPU left, the RAM is 65GB and still have 50GB left as I write.
====
But as far as I can see in regards to the messages size. Most of the messages size is between 8-10kb of size

Is that too much then?
 
@twisted1919
there is no bad emails, actually i am using X-Force-Return-Path for bounce server so return address is fine then why its saying ?
[3] => Invalid mailbox list: <<np345j23j26f9_sj949cw27j791@domain.com.com>>
[4] => Invalid mailbox list: <<bk866qgjz1caa_oj238tp01d2c7@domain.com.com>>
[5] => Invalid mailbox list: <<ee096y1l14974_no73498eddfd0@domain.com.com>>
[6] => Invalid mailbox list: <<np345j23j26f9_ms314pedfv6a7@domain.com.com>>
[7] => Invalid mailbox list: <<je926arvc2519_ov29432dd4925@domain.com.com>>
[8] => Invalid mailbox list: <<je926arvc2519_je462yy6vp175@domain.com.com>>
[9] => Invalid mailbox list: <<np345j23j26f9_sr7352lve9d37@domain.com.com>>
[10] => Invalid mailbox list: <<np345j23j26f9_hc8337wx38fec@domain.com.com>>
domain.com.com is my domain, i just change it.

My server is Intel Xeon E5-1650V2, 1TB SSD, 256GB RAM and today its only processing bounces, as today I am not sending any campaign.
and In all day it did't process 2000 emails from inbox.
 
Last edited:
hello @twisted1919
Process is still running and my both bounce servers are still showing Cron-running
and in SSH out put as bellow
[2017-11-17 15:53:42] - Starting...
[2017-11-17 15:53:42] - The lock has been acquired!
[2017-11-17 15:53:42] - Starting processing...
[2017-11-17 15:53:42] - Found 0 servers for processing...
[2017-11-17 15:53:42] - Processing finished.
[2017-11-17 15:53:44] - Starting...
[2017-11-17 15:53:44] - The lock has been acquired!
[2017-11-17 15:53:44] - Starting processing...
[2017-11-17 15:53:44] - Found 0 servers for processing...
[2017-11-17 15:53:44] - Processing finished.
[2017-11-17 15:53:46] - Starting...
[2017-11-17 15:53:46] - The lock has been acquired!
[2017-11-17 15:53:46] - Starting processing...
[2017-11-17 15:53:46] - Found 0 servers for processing...
[2017-11-17 15:53:46] - Processing finished.
[2017-11-17 15:53:49] - Starting...
[2017-11-17 15:53:49] - The lock has been acquired!
[2017-11-17 15:53:49] - Starting processing...
[2017-11-17 15:53:49] - Found 0 servers for processing...
[2017-11-17 15:53:49] - Processing finished.
[2017-11-17 15:53:51] - Starting...
 
Mine is still in processing mails..... very very slow...

Like I said earlier, the new release had to do with this issue. This is same app I have been using for years and it process bounce mails very fast. Why is it that the new version is very slow in processing mails....?

This new version has bounce bugs and am not the only one complaining here.

I have never complained about bounce bugs like these until the new release which is bringing issue.

As at 20th of October 2017., v1.4.8. The updated version was still cool. This same old version 1.4.8 at the aforementioned date process over 60k mails within an hour. (There is nothing like bad email because most of them are INTERNAL/SOFT bounces.

I even opened support ticket and I told you that the new version 1.4.8 stuck bounce server and processing was okay.

Take a look at screen shot via https://gyazo.com/ee7f41a428222eddfdc92007f6281184
And our conversation screen shot via https://gyazo.com/52170fa0b1ad279325ef700330f80d17
52170fa0b1ad279325ef700330f80d17


Why would the new version 1.4.9 can't even process 1k bounces in 24 hours?

So, as I am saying the issue is occurring in your new version now then you should believe me.

@twisted1919 , you need to take a look into this very well and fix. We are the one using your app and we know when issue occurs.

Thank you!!!
 
Last edited:
You must log in or register to reply here.
Back
Top