On one of our servers, a dedicated Dual Xeon E2670 with 128 GB RAM, 1 Gbps NIC, SSD etc we are down to 3.32 ms per sendout. It's fast, it's blazing fast. We use Redis and PCNTL. The HW makes a diff too of course.
And yet, we have loads of plugins that slows it down.