Manojb

/

Qwen3-4b-toolcall-gguf-llamacpp-codex

like 4

Using python scripts (and run_model.sh):
Assistant: [{"name": "get_pricing", "arguments": {"country": "CA", "product_id": 24680}}, {"name": "get_pricing", "arguments": {"country": "CA", "product_id": 13579}}]

🔧 Tool Calls (2):

1. get_pricing
   Arguments: {'country': 'CA', 'product_id': 24680}
2. get_pricing
   Arguments: {'country': 'CA', 'product_id': 13579}

You: get the latest news about AI

Assistant: [{"name": "search_news", "arguments": {"q": "AI", "gl": "us", "lr": "lang_en"}}]

In LMStudio, with included jinja:
User: show me a list of tools available to you and functions you can call
qwen3-4b-toolcalling-codex
[{"name": "list_all_tools", "arguments": {"category": "all"}}, {"name": "get_functions", "arguments": {}}

With manual template changes as noted in the HF model card:
qwen3-4b-toolcalling-codex
[{"name": "list_all_tools", "arguments": {"category": "all"}}, {"name": "get_functions", "arguments": {}}

*Additional characters are being added to the tool calls.