I would like to address your issue from an emergency medical response point of view. Coach Suzanne makes very valid points in referencing the correlation between swimming and driving restrictions. Anyone who has witnessed or lived with epilepsy understands how scary seizures are to those not familiar, even though for the most they part non life threatening. The question which needs to be asked is, are the life guards at the pool able to deal with such an event when in the water? If and when you should continue to swim it would prudent to speak with the pool director and guards about your issues. I am sure you are not the only one with epilepsy who is swimming, I applaud you for taking others and your safety into consideration.
I wish you well and have admired your courage and fortitude through following your post.
All my best in your journey forward.