On average, stealing a phone number is much more difficult than stealing someone's password, because of the frequency of password reuse and data breaches.

If someone were to do that, it would be blocked by registration lock (which it prompts you to do). If they were to guess that, all your contacts would be notified that your identity has changed.