Yes, I have now confirmed that the language is set automatically based on the browser's locale.
To test this I have downloaded and set my Firefox language to German and initiated a Stripe payment:
View attachment 247685
As you can see it picks up the browser language and adjusts the language accordingly.
In other words, if your browser or maybe even OS system locale is set to English then Stripe will render in English too.