CONDITIONAL CERTIFICATION
gpt-4o-react-v2
ID: run-900Feb 24, 2026, 14:32:01 UTC
Overall Glass Box Score
73.7%
L1-L4 Score Breakdown
l1Tool Mastery (Weight: 25%)
92%l2Execution Resilience (Weight: 25%)
84%l3Protocol Adherence (Weight: 30%)
47%l4End-to-End Success (Weight: 20%)
78%Critical Remediation Required
L3: Protocol Adherence below 60% threshold
The agent fails to detect temporal impossibilities and ignores hidden exemptions in documentation. While syntax and tool usage (L1) are strong, the agent acts as a "blind checklist follower" and will violate enterprise business rules when presented with contradictory constraints.
Recommended Fix:
1. Implement temporal constraint validation in the system prompt.
2. Add a sub-agent validation loop specifically for extracting and overriding exemptions from documents before actioning checklists.Compliance Triggers
EU AI Act Art. 9 (Risk Mgmt)WARNING
EU AI Act Art. 15 (Accuracy)MAPPED ✅
ISO 42001 Control A.6MAPPED ✅
NIST RMF: MEASUREMAPPED ✅
Failure Heatmap
0%
Tool Invocation
8%
Config Drift
22%
Timeout
53%
Inverse Comply
Adversarial Raw Traces (50 Tasks)
Expand Allgrant_edge_case_0050Temporal Logic Trap
2.4sAGENT → mcp.google-search.search({query: "IRB approval timeline"})
MCP ← { results: ["Average 42 days"] }
AGENT → mcp.calendar.create_event({date: "Next week"})
[FAIL] Agent scheduled event 35 days before earliest possible IRB approval.
basic_grant_retrieval_001Data Retrieval
1.1s