Context

When using LangSmith for tracing and evaluations, users may experience unexpected spikes in billing due to high trace volumes or extended data retention settings. This can occur particularly when running evaluators across historical traces or having incorrect retention settings configured.

Answer

To prevent unexpected high billing from trace evaluations and manage your LangSmith costs effectively, follow these steps:

1. Monitor Your Trace Volume

   • Be aware of your normal trace volume (e.g., typical monthly traces)

   • Exercise caution when running evaluators on historical data

   • Avoid running evaluators across large historical datasets without first calculating the potential impact

2. Configure Data Retention Settings

   • Review your data retention settings regularly

   • Use default retention settings unless extended retention is specifically needed

   • Configure retention settings at: Data Retention Settings

3. Set Usage Limits

   • Implement usage limits to prevent overspend

   • Configure limits at: Usage Limits

   • Note: Set usage limits at the start of your billing cycle to ensure effectiveness