将 LLM 作为独立模块使用

您可以将我们的 LLM 模块单独使用。

文本补全示例

from llama_index.llms.openai import OpenAI

# 非流式处理
completion = OpenAI().complete("Paul Graham is ")
print(completion)

# 使用流式端点
from llama_index.llms.openai import OpenAI

llm = OpenAI()
completions = llm.stream_complete("Paul Graham is ")
for completion in completions:
    print(completion.delta, end="")

聊天示例

from llama_index.core.llms import ChatMessage
from llama_index.llms.openai import OpenAI

messages = [
    ChatMessage(
        role="system", content="You are a pirate with a colorful personality"
    ),
    ChatMessage(role="user", content="What is your name"),
]
resp = OpenAI().chat(messages)
print(resp)

查看我们的模块章节了解每个 LLM 的使用指南。