It's not explicitly for toddlers - but S absolutely loves this application that Z recently discovered. It's been instrumental lately in calming down a fidgety girl while waiting for dinner at a restaurant. S calls out "birdies, birdies!" and clearly it means she wants to explore this app.
Chirp! Bird Songs USA Lite
Best of all - it's free.