Even if not bound to administration by the title of an ecclesiastical office, administrators cannot relinquish their function on their own initiative; if the Church is harmed from an arbitrary withdrawal, moreover, they are bound to restitution.
Source: Code of Canon Law (Vatican.va)