As someone who's relatives did this full time: n'ah.
You will live a comfortable life (except for all the hard work and heavy lifting, of course) but you'll never save up a million. Not unless you're in the real estate speculation side of the equation and you get lucky.
The biggest benefit house building skill gives you is that you don't have to pay someone else to fix your own house.