Jayne, in a comment to my earlier post on Michael Wood, which included reference to Auckland's Cremorne Gardens in Herne Bay, pointed out a post she had made previously on a Cremorne Gardens in Melbourne. Perth had one as well.
But the first appears to have been in London, Lord Cremorne's Gardens from 1845-1877. Like the Auckland gardens (which don't appear to have lasted all that long, ending around 1871), the English original is remembered by a street name. London's Cremorne gardens came off as second best to the more famous Vauxhall Gardens -- here, our Cremorne has faded into footnote before the much more well known Vauxhall of the North Shore, and Robert Graham's Ellerslie Gardens.
A map of Herne Bay's Cremorne Gardens can be found here.