I am in the other camp, I like the immersion.

I also have a tendency to not bother with VA, though, and to just click through the second I finish reading the dialogue, except for lines in particularly dramatic parts of the story. Sometimes not even then.