Taney is at Baltimore too, yes. Last survivor of the raid on Pearl Harbor and all that.
New Jersey is technically across the river in Camden, NJ, but you can see the other ships from where she's moored, and vice versa. Olympia and New Jersey are literally on opposite sides of the river, with United States at the docks just to the south. You can see it from the Interstate, and there's the mothballed ships further downriver, also visable from I-95; notably, most of the Ticonderogas seem to be there, among other things.
Norfolk is a three hour drive in the other direction (from DC), but I don't think you can get on base as easily as I did a decade or two ago.
SS United States keeps changing hands. Norweigian Cruise Lines was supposedly going to restore and modernize her for a Hawaiian route, but that seems to have fallen through. Conservation groups are trying to aquire her, but since she's been stripped of all her fittings, that may be a pipedream.