This isn't the inside of Milarepa's cave because it was locked and there was no one around. But this is one nearby and his probably looks similar. They've knocked down the old gompa and are just finishing building a new one.
The outside of Milarepa's cave. At the bottom left you can see the top of the 3 person outhouse that they're building right under the cave, showing that someone is missing the point of the place.