There is no bypass. If you want to use the App Store you may be required to add a credit card. You will not be charged to download free apps, but most of those apps will have in-app purchases that if you do choose one of those, then it will be charged to your card.

If you can’t download or update apps on your iPhone or iPad - Apple Support

Apple does not own the apps in the App Store, and the developers spend their own time and money to make them, offer support, and continue to update them. If there was never a chance for them to make any money, you would not have any apps to download anyway.

PanacheFab wrote:

it gives me the option to 'remove payment method' which I have selected but I just keep getting the circle of doom...

But thank you very much for replying so quick - have a great day!

Do you have a previous purchase amount displayed in red or noted as Pending in your Purchase History? If that is the case it will need to be paid first:

View your purchase history for the App Store and other Apple media services - Apple Support

If you have subscriptions that have not expired, you will not be able to remove your payment method. When you cancel a subscription it just prevents it from being renewed, but remains active until the expiration date. You can contact Apple directly if you want them removed immediately, then try to remove the payment method.

In your original post, you did not say you had a payment method currently on file that you are now looking to remove. So, do you already have a payment method on file that you cannot remove or are you looking to download an app without adding a payment method? The problem would be much clearer if it is due to the current payment method you have on file, and the reason why it cannot be removed.

PanacheFab wrote:

I think I will have to request apple support because it wont accept my card.

Here you go:

Contact Apple Support - Apple Support

Do you see the Nothing option when the payment details entry window appears?

If this option appears, you can skip this step.

This is better. Good luck to you, my friend.