Yadav was expelled from Congress on August 19 after he failed to reply to a show cause served to him by the party.
He had caused embarrassment to the Congress by singing paeans about the BJP strongman and making light of the party's Vice-president Rahul Gandhi.
Another Congressman Dasai Chaudhary, who had accompanied Yadav, had also been shown the door by the party.
Yadav had unsuccessfully contested on Congress ticket from Bettiah Lok Sabha seat in 2009.