The MP, who was the Saradha Media Group CEO, had earlier threatened revelations if he was arrested in the chitfund case.
Ghosh was suspended from the party on September 28 for anti-party activities.
The scam, in which lakhs of investors were duped, came to light in April when group chairman Sudipta Sen was arrested along with two others from Sonmarg in Jammu and Kashmir in the same month.