I'm Norwegian. For my first few years living in the UK people regularly asked if I was Polish when they heard my accent. It seems a lot of people just try to map an accent to one of a very few stereotypes whether or not it fits, and if it doesn't they assume [nationality they've recently read about]. It changed to Romanian - which notably sounds nothing like Polish - after the papers moved on to worrying about Romanian immigrants.