> GitHub: langchain-ai/langsmith
LangChain官方可观测性和评估平台,全链路追踪LLM应用
---
LangChain开发者、生产级LLM应用团队、需要全链路追踪的AI工程师
LLM应用缺乏有效的调试和监控手段,Prompt版本管理混乱,性能问题难以定位
非LangChain生态的简单项目、不需要追踪和监控的原型、预算受限的个人项目
全链路追踪、Prompt版本管理、性能分析、回归测试、团队协作、生产级监控
---
``bash
pip install langsmith
`
`python
import os
os.environ["LANGCHAIN_API_KEY"] = "your-key"
from langsmith import traceable
@traceable
def my_agent(input):
return llm.invoke(input)
`
---
`bash
pip install langsmith
pip install "langsmith[all]"
`
`bash
export OPENAI_API_KEY="your-openai-key"
`
---
`python
from langsmith import Client, traceable
from langchain import OpenAI
client = Client()
@traceable(run_type="chain")
def research_agent(query):
llm = OpenAI()
search_result = search_tool.run(query)
analysis = llm.invoke(f"分析: {search_result}")
return analysis
result = research_agent("AI趋势")
`
`python
from langsmith import Client
client = Client()
dataset = client.create_dataset("qa-tests")
results = client.run_on_dataset(
dataset_name="qa-tests",
llm_or_chain=my_agent
)
``
---
> 更多详情请参考 GitHub 官方文档