The District Magistrate may, by an order permit any person in respect of whom an order has been made under clause (a) of sub-section (3) of Section 3 to enter or return, for a temporary period, into or to the area from which he was directed to remove himself, subject to such conditions as the District Magistrate may specify and may at any time rescind any such permission.