[TenFour]

I can't find a way to remove payment details.

As of April 8 you can use Apple Pay or Google Pay and you could then just remove the payment method for one of those I suppose. But, have you tried "Change payment method?"