My personal favourite Australian artist Ken Done has his gallery in the middle of The Rocks, near Circular Quay. Its constantly updated with his new and old works and well worth a visit!
Underground food court in China Town with cheap eats and a mirror ceiling! It's in no way fancy, but incredibly charming. With about 12 different restaurants and a bar, its one of the best places in China town to get a meal.