Providers¶
Shepherd supports multiple observability providers. Switch between them or use provider-specific commands.
Supported Providers¶
Provider |
Sessions |
Traces |
Search |
Diff |
|---|---|---|---|---|
AIOBS |
✅ |
❌ |
✅ |
✅ |
Langfuse |
✅ |
✅ |
✅ |
❌ |
Switching Providers¶
# Set default provider
shepherd config set provider langfuse
shepherd config set provider aiobs
# Check current provider
shepherd config get provider
AIOBS¶
AIOBS is an open-source observability SDK.
Setup¶
Install AIOBS:
pip install aiobs
Instrument your code:
import aiobs
aiobs.init(api_key="aiobs_sk_xxx")
# LLM calls are now traced automatically
Configure Shepherd:
shepherd config init
View sessions:
shepherd sessions list
Configuration¶
[default]
provider = "aiobs"
[providers.aiobs]
api_key = "aiobs_sk_xxxx"
endpoint = "https://shepherd-api-48963996968.us-central1.run.app"
For self-hosted:
[providers.aiobs]
endpoint = "https://your-server.com"
Explicit Commands¶
Always use AIOBS regardless of default provider:
shepherd aiobs sessions list
shepherd aiobs sessions search --has-errors
shepherd aiobs sessions diff session1 session2
Langfuse¶
Langfuse is an open-source LLM observability platform.
Setup¶
Get your API keys from Langfuse Cloud or your self-hosted instance.
Configure Shepherd:
shepherd config set langfuse.public_key pk-lf-xxxxx
shepherd config set langfuse.secret_key sk-lf-xxxxx
shepherd config set provider langfuse
Or set environment variables:
export LANGFUSE_PUBLIC_KEY=pk-lf-xxxxx
export LANGFUSE_SECRET_KEY=sk-lf-xxxxx
View traces:
shepherd traces list
shepherd sessions list
Configuration¶
[default]
provider = "langfuse"
[providers.langfuse]
public_key = "pk-lf-xxxxx"
secret_key = "sk-lf-xxxxx"
host = "https://cloud.langfuse.com" # Optional, defaults to cloud
For self-hosted Langfuse:
[providers.langfuse]
host = "https://your-langfuse.com"
Explicit Commands¶
Always use Langfuse regardless of default provider:
shepherd langfuse traces list
shepherd langfuse traces search --tag production
shepherd langfuse sessions list
shepherd langfuse sessions search --user-id alice
Future Providers¶
Planned support for:
LangSmith
OpenTelemetry