On one of our servers, a Dual Xeon E2670 with 128 GB RAM, 1 GBps NIC, SSD etc we are down to 3.32 ms per sendout. It's fast, it's blaszng fast. We use Redis and PCNTL. The HW makes a diff too of course.
And yet, we have loads of plugins that slows it down.