It was declared a National Monument under old NMC legislation on 18 December 1970.
The Breakwater Prison was constructed in 1860 to house British convicts working on the breakwater, which eventually allowed the harbour to be buildt. Since 1991 the remaining building houses the Breakwater Lodge and the University of Cape Town Graduate School of Business in what is now called the Victoria & Alfred Waterfront.
The building we see today is called the Industrial Breakwater Prison. It's design with the four castellated turrets and an enclosed courtyard was based on the Millbank and Pentonville prisons in England. In 1891 the white prisoners were moved into this building. It was the first site to racially segregate black and white convicts. Before segregation the sleeping arrangements were that a white convict had to sleep between two black convicts. The rationale was, with the language and cultural barrier, less plotting and dissent would take place.
Stories will have it that the Breakwater Prison was one of the most feared prisons in the world. It is also said there was at least one representative of each nationality of the known world present at this prison.
The Industrial Breakwater Prison was only a prison for 10 years. It then became a juvenile offenders institution and from 1926 until 1989 a hostel for black dock workers.