Remove invalid head_dim entry

#2
by CISCai - opened

Setting this to 0 is wrong and breaks sane parsing of the config, in particular the conversion script for llama.cpp.

inclusionAI org
edited 3 days ago

Nice, catch! We have open the PR to fix the problem we should fix in opensource model files.
Please check https://huggingface.co/inclusionAI/Ling-lite-base/discussions/3

Ready to merge
This branch is ready to get merged automatically.
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment