Opened in 1870 the gardens stretch parallel with the Victoria Embankment.   Statues located down the centre line of the garden are of William Tynedale, Sir Henry Bartle Frere and General Sir James Outram.
In 2000 the gardens won a Millennium Award to carry out works to improve the shrubs within the gardens.