Grand Central is big and beautiful and it also periodically hosts free cultural events - poets at typewriters custom-composing poems on demand - or Alvin Ailey dancers performing in Artist, Nick Cave's horse suits!
Within an couple hours' drive of NYC, you can find lots of sleepy seaside towns. Not only can you get your soft ice cream and salt water taffy on, but you can still spot cool, hand-lettered signs and other relics of a past generation's amusements.
The Future Perfect is my favorite place to shop for furniture / interiors, or pick up a small gift for a friend. They have a perfect mix of beautiful and strange objects, some of my favorites include the Animal Butt Magnets, Shrigley Salt & Petter Shakers, and the Bank in the form of a Pig.