CI Memories Violation Rate
Progress Over Time
Interactive timeline showing model performance evolution on CI Memories Violation Rate
CI Memories Violation Rate Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  Meta | 30B | — | — |
What is CI Memories Violation Rate?
CI Memories measures privacy failures in memory-enabled agents using contextual-integrity scenarios. This metric is the violation rate; lower is better.
CI Memories Violation Rate is a text benchmark evaluating models on memory, privacy, safety, and agents tasks. LLM Stats tracks 1 models on this benchmark, scored on a 0–1 scale. The current average is 0.3, with the leader at 0.3.
Compare leaders on the best AI for memory, best AI for privacy, best AI for safety and best AI for agents leaderboards.
Current leaders
Muse Glimmer-30B from Meta currently leads the CI Memories Violation Rate leaderboard with a score of 0.264 across 1 evaluated AI models.
FAQ
Common questions about the CI Memories Violation Rate benchmark and leaderboard.