The Deputy Chief Justice had earlier been arrested at the Supreme Court
The top prosecutor said corruption will no longer derail the country's development agenda