The doctor's brother Jamil Afridi said the lawyer had not informed him about the departure, saying the family has a panel of attorneys and would have to choose another lead attorney if it is confirmed.
Pakistani officials were outraged by the bin Laden operation, which led to international suspicion that they had been harboring al-Qaida's founder.
In their eyes, Afridi was a traitor who had collaborated with a foreign spy agency in an illegal operation on Pakistani soil.
But the doctor—who is being held in a prison pending retrial on a separate allegation—was never charged by Pakistan of helping the CIA, and U.S. officials have demanded his release.
The case has caused friction between Pakistan and the U.S., complicating a relationship that Washington views as vital for fighting the Taliban and al-Qaida, as well as negotiating an end to the war in neighboring Afghanistan.
Initially, the doctor was convicted of “conspiring against the state” in May 2012 and sentenced to 33 years in prison. His conviction was related to allegations that he gave money and provided medical treatment to Islamic militants in Khyber.
The doctor's family and the militants denied the allegations.
His conviction was later overturned by a judicial official.
Now the doctor faces a murder charge, which stems from a complaint over a teenage boy who died after the doctor performed surgery on him for appendicitis in 2006.
The complaint, filed by the deceased teenage boy's mother, Nasib Gula, says Afridi was not authorized to operate on her son because he was a physician, not a surgeon.