Chat template is not consistent with documentation?

#34

by ejschwartz - opened Nov 8, 2024

Nov 8, 2024

The chat template in the tokenizer is quite different than the format described here. In particular, the tokenizer version instructs the model to always make a tool call, even when it doesn't make sense. Is this an oversight?

matthen

Nov 13, 2024

This conversation is relevant: https://github.com/meta-llama/llama-stack-apps/issues/36

matthen

Nov 13, 2024

And https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct/discussions/90

ejschwartz

Nov 13, 2024

Thanks @matthen I'm glad I'm not the only one getting confused with some of these details!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment