It seems likely that the entirety of Zork (world state and the possible actions to transform it) is already learned by the model. Which means that there is a grue in there, too. Not good. I’m starting to re-think the doomer argument...