Within an couple hours' drive of NYC, you can find lots of sleepy seaside towns. Not only can you get your soft ice cream and salt water taffy on, but you can still spot cool, hand-lettered signs and other relics of a past generation's amusements.
Occasionally I'll look at the Manhattan skyline and wonder what it was like in 1931 when people around the world were saying, "Holy shit, did you hear what they just built in New York?" Just get up there and trip out about humanity. And be sure to keep an eye out for the unmarked locked door guarding a set of stairs leading to a hidden terrace that was originally designed as a fucking docking station for zeppelins.