Skip to content

chatml-function-callling not adding tool description to the prompt. #1869

New issue
New issue
Open
superlinear-ai/raglite
#71
#1884
Open
chatml-function-callling not adding tool description to the prompt.#1869
superlinear-ai/raglite
#71
#1884
@undo76

Description

@undo76
undo76
opened on Dec 16, 2024

Tool description is missing in chatml-funcion-calling prompt format.

llama-cpp-python/llama_cpp/llama_chat_format.py

Lines 3417 to 3421 in 803924b

"\n\nYou have access to the following functions:\n"
"{% for tool in tools %}"
"\nfunctions.{{ tool.function.name }}:\n"
"{{ tool.function.parameters | tojson }}"
"\n{% endfor %}"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions