I like it! There are lots of established podficcers who have English as a second or other language. Individuals can be picky about accents - lots of people won't listen to me reading for American fandoms, and I can't argue with that, but then other people are happy enough to ignore my British accent. Some people will find your accent distracting, others won't mind, others will actively love it.