Some say that the ruler of these villages pounded the Paliwals with heavy taxes and treated them very inhumanly; the ruler was unethical and forceful to them.
They had no alternative, but to vacate all the 84 villages overnight and just disappear from the vision and reach of the ruler.