I'd agree that voices are hard to identify. Even if they sound distinctive or familiar (e.g. in animated films with big name film stars doing the voices), I find it difficult to figure out who they are. The chances of someone I know IRL listening to one of my few podfics (why?) and identifying me (how?) are slim.

It was a little strange to see my fan name on last.fm, but I actually had to search for it, and it doesn't reveal anything that isn't already on the Audiofic Archive. I'll be sure not to put identifying information into the metadata on podfic files....