A view of the site where Kamayani Express and Janata Express trains derailed within minutes of each other while crossing a small bridge at Harda in Madhya Pradesh.
A Kamayani Express passenger said the first few coaches of the train crossed the river but those after the fourth coach plunged into the water.
"Many of us had to swim out of the coach," said the visibly rattled man.
The tracks were badly twisted in the disaster. The coaches landed in awkward angles, making the search operation difficult for divers looking for bodies in the river.
The Madhya Pradesh government said the river was in spate and there was soil erosion.
Railway Minister Suresh Prabhu told parliament that monsoon floods, which caused soil erosion, may have caused the accident -- by weakening the bridge over the river.
Prime Minister Narendra Modi called the deaths "deeply distressing", and said he was deeply pained over the loss of lives.
"My prayers with the injured. Authorities are doing everything possible on the ground."
Suresh Prabhu ordered an inquiry into the derailment and announced compensation to the families of the victims.
Madhya Pradesh Chief Minister Shivraj Singh Chouhan inspect the accident site of Kamayani Express and Janata Express trains were derailed within minutes of each other while crossing a small bridge, in Madhya Pradesh on Wednesday.
He said villagers were assisting in the rescue efforts. He said "everything that's necessary and possible (was) being done" and he was in constant touch with Madhya Pradesh authorities.
The disaster made the CPI-M appeal to the government to give priority to railway safety over plans to run bullet trains.