Astonishingly this prime site has lain mostly fallow since the 1960s despite, or maybe because of, its proximity to Parliament Hill.