One of the best ways to get started with podcasts is to take a quick survey of what other podcasts are out there and what tools and training are available for the beginner.
The good people at NPR host dozens of individual podcasts, as well as having the NPR Student Podcast Challenge. They have provided a plethora of resources to help folks get started with their own podcasts.
Want to Start a Podcast? Read this first. A quick run-down of the considerations one should go into a podcast endeavor asking themselves.
Starting Your Podcast: A Guide for Students - a very helpful page with information and resources ranging from recording hardware, content/idea development, audio production techniques, interview tips, and audio editing.
NPR Training: Audio 101 - a collection of brief articles and tutorials to help answer specific questions when producing a podcast.
Of course, NPR isn't the only game in town when it comes to developing and producing quality podcast content. Check out these other sources for tips and advice on getting started with your podcast: