Skip to content

Tool Calling

Define Tools

To define tools or function we can use decorator Tool() in each funcion/tools. Tool() is imported from: 

1
from llmfy import Tool

example: 

1
2
3
@Tool()
def get_current_weather(location: str, unit: str = "celsius") -> str:
    return f"The weather in {location} is 22 degrees {unit}"

Below is the guide:

Define LLMfy

 7
 8
 9
10
11
12
llm = OpenAIModel(
    model="gpt-4o-mini",  
    config=OpenAIConfig(temperature=0.7),
)

llmfy = LLMfy(llm, system_message="You are helpful assistant.")

Define tools

 7
 8
 9
10
11
12
13
14
15
@Tool()
def get_current_weather(location: str, unit: str = "celsius") -> str:
    return f"The weather in {location} is 22 degrees {unit}"

@Tool()
def get_current_time(location: str) -> str:
    return f"The time in {location} is 09:00 AM"

tools = [get_current_weather, get_current_time]

Register tools

7
llmfy.register_tool(tools)

Invoke LLMfy

 7
 8
 9
10
11
12
13
14
15
16
# Example conversation with tool use
messages = [
    Message(
        role=Role.USER,
        content="what time and weather in London?",
    )
]

response = llmfy.chat_with_tools(messages)
print(f"\n>> {response.result.content}\n")

output: 

>> The weather in London is 22 degrees celcius and time is is 09:00 AM