LangSmith Engine v2 enhances agent development with new features. It now includes red teaming, which finds bugs and issues before they affect users. Red teaming analyzes production traces and agent repositories to identify weaknesses.
Engine also detects harder-to-spot issues like inefficiencies, error trends, latency, and costs. It groups related traces into issues, providing all necessary information for fixing problems.
A key update is automatic validation of proposed fixes. Engine reproduces failures, tests fixes against the same inputs, and confirms their effectiveness before review. This speeds up deployment and reduces risks.
Since launching in May, Engine has analyzed over 70 million traces and diagnosed tens of thousands of issues. The v2 update improves detection by more than two times and makes fixes 25% more effective.
For teams with strict data policies, a future release will support bring-your-own-key (BYOK) for self-hosted environments. Engine v2 is available now for SaaS plans, with support for self-hosted coming soon.
You can enable Engine v2 easily if you are on a Plus plan, or contact your account team if on an Enterprise plan. Regular improvements continue to boost performance.
Why it matters
This update helps you find and fix issues faster, saving time and reducing costs in your agent development.
What to do
Apply for the private beta of red teaming and test the new automatic fix validation features.
Source: https://www.langchain.com/blog/langsmith-engine-v2-redteam
