This is to avoid potential conflicts between the template and
the add_special_tokens logic.