Sydney Gardens Share Situated behind the Holburne Museum at the end of Great Pulteney Street, Sydney Gardens is the oldest park in the city of Bath.