Skip to content

LLMfy

llmfy llmfy llmfy python

LLMfy is a flexible and developer-friendly framework designed to streamline the creation of applications powered by large language models (LLMs). It provides essential tools and abstractions that simplify the integration, orchestration, and management of LLMs across various use cases, enabling developers to focus on building intelligent, context-aware solutions without getting bogged down in low-level model handling. With support for modular components, prompt engineering, and extensibility, LLMfy accelerates the development of AI-driven applications from prototyping to production.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
def example():
    info = """
    LLMfy is framework for integrating LLM-powered applications.
    """

    SYSTEM_PROMPT = """
    Answer any user questions based on the data:
    {{info}}
    Answer only relevant questions, otherwise, say I don't know."""

    llm = BedrockModel(model="amazon.nova-lite-v1:0", config=BedrockConfig(temperature=0.7))
    framework = LLMfy(llm, system_message=SYSTEM_PROMPT, input_variables=["info"])
    content = "What is LLMfy?"
    response = framework.invoke(content, info=info)
    print(f">> {response.result.content}\n")