Qobustan
From Baku, you can make a day trip to Qobustan. It is known for its ancient and well-preserved cave paintings.