The New York Earth Room is an interior sculpture by the artist Walter de Maria that has been installed in a loft at 141 Wooster Street since 1977. Go see!
The naked baby dolls piled up in the front window of SEARCH & DESTROY is a good preview for what you’re in for. If you’re looking for something weird, this East Village shop is a good starting point. In addition to vintage clothing with a seriously punk rock lean, they also sell everything from sex toys to Manic Panic hair dye.