Erie Basin is a really wonderful little shop full of old, creepy and beautiful things, such as Victorian mourning jewelry (some with hair in it), Freemason masks from the 1900's, tiny children's rings from the 1700's, and all kinds of other treasures. It is really as much a museum as it is a store, and all of the items have a haunting and unique aura.
The Brooklyn Flea is another treasure trove of odd finds, cool artifacts, and handmade goodness. If you're looking for inspiration or just something cool to hang on your wall, you can probably find something here. And if all that treasure hunting leaves you hungry, you are in luck--there's a delicious assortment of local food vendors and artisans there too.
The best place to see a dramatic sunset is right by Valentino Pier in my neighborhood of Red Hook, Brooklyn. This was right after a storm. It's wild and brilliant and peaceful all at once.
Paris in Brooklyn, etc. I have to try hard not to say 'Garçon.' But either way, 'monsieur' would be more appropriate; proper French waitstaff, proper French food.