Elements of both: by their nature world heritage sites are deemed of value to everyone and demolishing it would (mildly) hurt everyone. On the other hand: on the international level there is a treaty that legally protects world heritage sites but it carries no penalties if a state neglects to do so and UNESCO does not have any means to force a sovereign state to perform or cease any action.
So unless you can somehow move the worlds' nations to enact sanctions or invade, each state is free to mine what they want.
Well, I don't know. When Europe razes her cities and returns her farms to the Earth, then maybe she may judge. Until then, if Brazil asks, you pay. Or don't. It's just business.
