Regulations Governing Immigration Inspection and Data Collection and Utilization Article 18

Visitor(s) who carry entry/exit permits other than a valid passport, travel documents, multiple entry permit or renewable entry permit, shall provide an entry/exit permit application receipt when NIA does an entry or exit inspection.
中文原文 入出國查驗及資料蒐集利用辦法第18條
持用護照、旅行證件、多次入出國許可證或逐次加簽證以外之其他入出國許可證件入出國者,移民署於入出國查驗時,得分別收繳其入、出國許可證聯。

English translation for reference only; the Chinese text prevails. Not legal advice.