Not the gold one. This granite fort on the Penobscot narrows was begun in 1844 to keep the British out of the river, built from Mount Waldo granite, and never saw a shot fired. What it has instead is the best fort architecture in New England: spiral granite staircases, black powder magazines, and long unlit casemates and counterscarp galleries you walk through with a torch. It has a solid reputation for footsteps and voices, and it runs public paranormal nights. PUBLIC state historic site, Prospect.
Prospect, Penobscot River (Waldo County, Maine)
See it on the map
Other places on the map within a couple of hours.