Infinity Swimming Pools

I've noticed recently when they show pool parties on American news a lot of the pools look like there's a waterfall at the far end. Having spent my whole life in built-up, urban environments, this is alien to me. Looking online, I think they are called infinity pools.

I was wondering what's at the edge? If you swim over do you fall off a cliff?

Thanks.