WordPress is one of the most popular places for podcasters to host their podcast, since it already has many of the necessary tools built-in, plus some great plugins that make it so easy.
Next you need to install a podcasting plugin to manage your podcast. I prefer the BluBrry PowerPress Plugin, which allows you to publish your podcast on your website and iTunes.
Personally, I like to podcast from my iPhone or iPad and find it frustrating to log into my computer and transfer files and publish new podcast episodes. I use my Mobile Podcaster to do this.