Visa/MC take very little. The bulk of the fees go to card issuers who would hate to see them dwindle. And this fee revenue now mainly goes to support rewards programs which cardholders love. At least, in the USA.