An also-effective approach is just to take the improv classes without ever performing on stage. That's all I did, but the lessons have stuck with me.

These days there seem to be more improv classes that are friendly to that, just people who like playing with one another. So if people are scared even by the classes, I'd suggest asking the instructor for something that's very beginner-friendly and not totally oriented on performance.