1 LLMProvider
shaotao edited this page 2026-06-12 09:09:29 +08:00

LLM Provider

统一接口

class LLMProvider(ABC):
    async def chat(self, messages, tools=None, **kwargs) -> LLMResponse: ...
    async def count_tokens(self, messages) -> int: ...

OpenAI

from bixiweave.llm import OpenAIProvider

llm = OpenAIProvider(model="gpt-4o", api_key="sk-xxx")
response = await llm.chat(
    messages=[{"role": "user", "content": "Hello"}],
    tools=[{"type": "function", "function": {"name": "get_weather", ...}}],
)

DeepSeek

from bixiweave.llm import DeepSeekProvider

llm = DeepSeekProvider(model="deepseek-chat", api_key="sk-xxx")
# 与 OpenAI 用法一致

Anthropic

from bixiweave.llm import AnthropicProvider

llm = AnthropicProvider(model="claude-sonnet-4-20250514", api_key="sk-ant-xxx")