Getting lost is an age old suggestion but a good one. Put away your cell phone or your A-Z and just wander around. I still do this regularly even though Ive lived here for nearly 10 years. London is a big city and it drip feeds you its secrets sometimes. You will come across things you wouldn't usually, in amongst the Starbucks and pret a mange there are some amazing sights. Just 'being' somewhere is a great experience and one no guide book can help you find.
This is an amazing place for the summer when the water gets pretty warm or the winter if you are very brave. The only downside is that it can get very crowded in the Mixed pool but the men’s pool is normally quiet and it has a diving board.