The shrine is called "Gupteswar" which means the "Hidden God". It is so named because it was lying hidden in the cave for a very long period.
One can reach it by climbing the 200 steps flanked with rows of champak trees. The entrance of the cave is about 3 m wide and 2 m in height.
