WordPress E-mail notifications not working

I installed WordPress with my own domain on a self hosted server on Mediatemple (dv), and sadly none of my e-mail notifications, or e-mail using plug-ins worked - No notifications on new comments, no notification whenever someone uses Contact From 7, WP DB Backups not being sent, nothing. I searched all WordPress forums for hours (and spilled some of my own blood during the process), but finally I managed to find what was my problem and what's the solution. Here it is:

The Problem

My domain was maintained on GoDaddy. I had my e-mail with my domain (e.g. myname@mydomain.com) pointing to Google Apps instead of using my hosting company's mail server. However, when you create a new domain with Plesk, it automatically enables your e-mail address on your hosting company. So that caused e-mails being sent from my WordPress PHP Mail to fail.

The Solution

Disable your local mail for your domain. Media Temple KB has this article on how to do it, though it should be similar on any Plesk environment.

Credits
The post which finally directed me to the right answer (after hours of searching) can be found here: http://picketstudio.com/post/10230298607/media-temple-mail-quirks

Did this solution for problems with WordPress E-mail notifications work for you? Let me know in the comment section.