Technically, yes.
But when I went to Typhoon Lagoon last summer, a Cast Member told me to not leave it on while inside the park. She said they have a way of coming undone while you are swimming, and the cast members find a ton of them at the bottom of the pools.