From 5c9c95b259768f49c5b7b87bf939aca7e7cd2c94 Mon Sep 17 00:00:00 2001 From: Hust_YangXian Date: Fri, 3 Jan 2025 10:41:13 +0800 Subject: [PATCH] Update tool_calling.md update tool_chat_template_llama3_json.jinja to tool_chat_template_llama3.1_json.jinja --- docs/source/usage/tool_calling.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/usage/tool_calling.md b/docs/source/usage/tool_calling.md index 34b26647a959..062f2021eb62 100644 --- a/docs/source/usage/tool_calling.md +++ b/docs/source/usage/tool_calling.md @@ -10,7 +10,7 @@ Start the server with tool calling enabled. This example uses Meta's Llama 3.1 8 vllm serve meta-llama/Llama-3.1-8B-Instruct \ --enable-auto-tool-choice \ --tool-call-parser llama3_json \ - --chat-template examples/tool_chat_template_llama3_json.jinja + --chat-template examples/tool_chat_template_llama3.1_json.jinja ``` Next, make a request to the model that should result in it using the available tools: