The Ukrainian parliament accepted Chief Prosecutor Viktor Shokin's resignation on Tuesday as the official is seen as an obstacle to fighting corruption.
The United States has urged the reconstruction of the general prosecutor’s office several times, as anti-graft campaigners say that the office permits corruption.
Shokin’s resignation received 289 votes in favour though only 226 were required.
The prosecutor officially resigned on February at the insistence of President Petro Poroshenko but resumed his duties as his resignation needed parliamentary confirmation.
Shokin was criticised by lawmakers as well as activists for not carrying out certain judicial reforms.
In February the office was accused of being a "hotbed of corruption" by one of its own deputies.