I think everyone has those weird thoughts when they are on higher buildings. Or is it just me? I think the trick is to not look down and you’ll be fine.
I’m sorry you had a bad experience at the pool. Now that you are older maybe you could give it a try again. You’d be surprised at how good it will turn out.