It turns out that signing up for a new bank account is something that people commonly do at the same time as they're moving to a new place and change their address and phone number.
"As has been pointed out on HN before, "identity theft" is a made-up concept to make it seem as if you had something stolen from you, when the real problem is banks and other service providers do an absolute shit job of identity verification. They're the ones at fault, and they try to shift the onus onto you to fix things when they screw up."