Within an couple hours' drive of NYC, you can find lots of sleepy seaside towns. Not only can you get your soft ice cream and salt water taffy on, but you can still spot cool, hand-lettered signs and other relics of a past generation's amusements.
I am definitely a creature of habit, some good, some bad, and some worse. This is one of my better ones. Pretty much stop here every day on my way to the studio for caffeine. They brew up stumptown and always see someone I know from the neighborhood. When I get to the front of the line there is already a large coffee ready for me.
The best way to enjoy Manhattan is from Brooklyn. Transmitter Park offers views without the crowds, and you can pick up coffee-to-go and treats from nearby Ovenly. The India St/Greenpoint Ferry is a 5 minute walk and will take you all the way to the Rockaways in the Summertime.