If the Phanoy Lookout Point doesn't cut it and you're up for a little challenge, you can ascend the limestone mountain immediately south of Muang Ngoi. There will be a villager collecting the entrance fee right at the gate. The first hour is a steep, slippery climb, with plenty of roots serving as steps, and there are ropes for assistance. You'll come out at an average lookout point with limited views over Muang Ngoi; from here, a more difficult path (taking about another hour) ascends to the peak of the mountain. This part is even steeper in places, more slippery with less holds and no ropes to hold onto save for a few near the peak. Wear shoes with good grip, go slow and make extensive use of the bamboo, trees and stones to avoid falling. Do not go alone unless you have experience with this kind of environment. The effort is rewarded by a magnificent view over the valley behind the mountain, with the Nam Ou river slowly disappearing in the foggy mountains in the distance. A few metres to the right when reaching the peak, you can climb to a flag which provides another fine view over Muang Ngoi.
These caves were bomb shelters during the Vietnam War. North of town, about 50 min by foot and can be found without a guide. There is a 10,000 kip toll to enter, to see the village, or to walk past the village. It is claimed this money is for a bridge but if you demand a ticket you will see it is for the cave only and can refuse to pay if you wish. Continue past the caves for about 45 min to reach Ban Na village for lunch, though options are limited.