@srirangan · srirangan.net · LangChain Ambassador NL
Non-compliance: up to €15,000,000 or 3% of worldwide annual turnover, whichever is higher.
No runnable code. Conceptual diagrams and crosswalks only.
You're high-risk if your agent makes or materially supports decisions in:
If you're unsure, assume high-risk and downgrade with legal counsel.
| Agent | Risk tier |
|---|---|
| Finance copilot that approves loans | High-risk |
| HR agent that screens CVs | High-risk |
| Clinical triage assistant | High-risk |
| Customer support chatbot | Limited risk — transparency only |
| Internal documentation search | Minimal risk |
A living risk management system across the development lifecycle — not a one-time document.
Requires: identify, analyze, evaluate, and mitigate risks — continuously updated.
LangChain v1: - Online evaluators scoring production traffic against custom thresholds - Custom evaluators for domain-specific risks — financial accuracy, clinical safety - Webhook → PagerDuty alerts when thresholds breach - Risk register kept in sync with evaluator outputs
Data quality, representativeness, and explicit bias examination across protected characteristics.
Requires: documented data provenance, bias examination across race, gender, age, religion, nationality, disability, sexual orientation — and documented mitigations.
LangChain v1: - Bias and fairness evaluators — LangSmith ships templates per protected characteristic - PII Middleware — prevents leakage of protected attributes in inputs and outputs - Trace dataset documentation for evaluation provenance
Logs spanning the full system lifecycle — sufficient for deployer oversight and regulatory inspection.
Requires: inputs, outputs, timestamps, agent context, sufficient detail for audit.
| Tier | Retention |
|---|---|
| Base traces | 14 days |
| Extended traces | 400 days |
| Bulk export | Long-term archival |
Outputs must be interpretable enough that deployers can use the system appropriately.
Requires: clear instructions, documented capabilities and limitations, interpretable outputs.
LangChain v1: - LangSmith Studio — visual execution graph showing state transitions, tool calls, decisions - Full reasoning traces — every step inspectable - Documented agent specs — inputs, outputs, tool registry, system prompt
Humans must understand, intervene on, override, and interrupt the system. Not theatrical — measurable.
Requires: oversight designed into the architecture, humans able to intervene at decision points, auditable trail.
Declared accuracy levels and demonstrable protection against common attack surfaces.
Requires: stated accuracy metrics, adversarial resilience, consistency over system lifetime.
LangChain v1: - Correctness, exact match, plan adherence, task completion evaluators - Prompt injection and jailbreaking evaluators — LangSmith templates - API leakage, code injection evaluators for tool-calling agents - Adversarial evaluation suites — run before every release
Continuous monitoring of production behavior with incident reporting to authorities.
Requires: continuous monitoring, drift detection, incident reporting to national supervisory authorities.
LangChain v1: - Online evaluators with custom thresholds - Drift detection dashboards - Webhooks → incident response system - Audit dashboards for compliance and regulator-facing reporting
Most LangChain users are downstream developers — not GPAI providers. Fine-tuning and redistributing can shift you into the provider role. Get legal advice if you're close to that line.
| Option | Best for |
|---|---|
| Managed Cloud (US) | General use, non-EU workloads |
| LangSmith EU SaaS | High-risk EU systems — most common choice |
| BYOC | Regulated industries: finance, healthcare |
| Self-hosted | Maximum control: government, defense |
If you're in scope and your customers are EU-based, default to LangSmith EU SaaS or BYOC. The audit story is dramatically simpler when traces never leave the jurisdiction.
PIIMiddleware on inputs and outputsinterrupt on every state-changing tool callDocumentation burden is real — budget engineering time, not just legal time.
is the same audit trail that helps your team ship faster.
Sri Rang · srirangan.net · @srirangan