We do sometimes get sunshine here. It isn't raining all the time - it just seems that way sometimes. There's also the possibility that while you were outside soaking up the sun you'd miss your heat. But that couldn't happen to a well-organized swimmer.
I must keep my eye open for opportunities to test the theory.