Every person subject to this Act under clauses (a) to (c) of section 2 shall remain so subject until duly retired, discharged, released, removed, dismissed or cashiered from the service.