This is going to sound odd, but I think the QR code still carries the same level of 'unrecognizable' that a long string of alphanumeric text does. My brain can't really parse or recognize a QR code from memory. As such, I have a sense of unease. However, I am able to roughly recite my credit card number because it is 4 sets of 4 digit numbers.
But you're right that you can offload addresses to browser or app memory just like with credit cards and get rid of some of the trepidation that way.