This is one of the issues that was discovered in the Watergate scandal -- deleted email was not 'erased' but only freed and disconnected from the email reader.
There are two forms of client email readers:
1) the inbox is a single file with all the messages stacked one upon the other and
2) where the inbox is a folder and each message is in its own file.
When we compress our inboxes for (1), the messages in the middle get erase by moving those at the bottom up and removing those deleted.
The old messages at the bottom however just join the HD freespace and could be recovered.
Deleting from (2) is the same as any other 'file delete'... you can't find or see it, but it has joined the freespace per the above.
Anyone using Domain environment with Exchange server has the bigger issue that the server has a copy AND --- the admin will be taking backups.
Ergo: We've all lost privacy.