I learned whatever English I learned by talking with Germans Italians Swedish and other non English people VP. I can understand even half English spoken by Italians...
Not everybody lived in England, in fact I ve been in England only a few times for a couple of hours during transit flights.
So I suggest when you don't fully understand something, just use your imagination.