Nobody said it isn't debt. The difference is that it is debt that makes sense: you can't realistically buy land without it, and houses tend to appreciate so the interest costs are less of a problem - they just represent the time value of money.
Most other debts people incur personally are to buy things they could save for, which go down in value. Like cars.
