This is not the case with the unsubscribe button we set for the email client, once you press that, a request is sent on your server and the subscriber unsubscribed.
The regular unsubscribe button, which is a different thing, that works as you described.