I use Outlook.com accounts with Windows Live Mail.
The protocol used by Windows Live Mail and Outlook.com means that they are kept synchronised. Any change made in the local client or using web mail will be reflected in the other. There is a feature to recover deleted emails even after the deleted items folder has been cleared.