LLM Eval Framework
SR 11-7 & EU AI Act compliant LLM validation suite for financial services
A local-first auditing suite that automates Model Risk Management artifacts regulators require — converting raw LLM outputs into compliant evidence. Built on experience validating LLMs at financial institutions. Features adversarial red-teaming (50+ templates), SHAP/LIME token attribution, Financial-F1 accuracy scoring, and a YAML-based regulatory mapping registry.