"Petty statements by those claiming to be BJP's well wishers are deviating the campaign from the issues of development & good governance," he wrote without naming the leaders.
Togadia, who reportedly said Muslims should be thrown out of Hindu areas, had Monday triggered a controversy.
Party leader Giriraj Singh, during an election rally in Deogarh, Jharkhand, had last week said those opposing Modi are looking at Pakistan, and such people will have no place in India but in Pakistan.