Of course it always depends what borders you draw.
I started with steam railways. Of course horse driven railways existed before, but they were of a completely different load class.
I don't know what clinker from salt mines looks like. But I guess it's significantly different from sharp, crushed rocks the NZ article describes. Also the Scottish article says that just some sentences later that ballast had completely different properties those days.
Some ballast has been used for centuries. But not the kind consisting of sharp, crushed relatively coarse rock pieces we know today.
GP suggested that "ballast hasn't been used on railway tracks for centuries" (incorrect) because "railways haven't even existed for 2 centuries" (incorrect).
"At Whitley in 1704, when the word first occurs in a railway context, clinker from the salt-pans was used 'for the ballast of the waggonway'"[1]
By my reckoning, 2023 - 1704 = 319 which I think comfortably fits into "centuries"?
[1] https://www.railscot.co.uk/articles/A_brief_history_of_railw...