Once it was a small, obscure reminder of the Confederacy sitting on the downtown waterfront. Now it's gone.