...while audiobooks/podfic of prose fiction can be done amazingly and add a lot of art to an existing story, a work that is written primarily to be performed as audio ought to be written differently than one intended to be text, ought to be written such that anybody just reading the written text will realize they're reading something that's not in its intended format, because a good audio text has different strengths than a written one.

This is what I was thinking, basically. Something made primarily to be an audio art form would, I would expect, be more like a radio play than like a story being read aloud. Different format.

And it would only be polite and good practice to offer the alternative of a script or script analogue to those people who can't/won't listen. Having scripts available doesn't stop people watching movies and having scores available doesn't stop people going to concerts. They are transcriptions of the art form rather than the art form itself.