Framework
Three Layers of AI Safety Testing
A staged approach to validating whether a model is safe: first studying its internal alignment and mechanistic interpretability, then testing it against synthetic scenarios in controlled evaluations, and finally observing its behavior in real-world deployment, since a model can pass the first two layers yet still reveal problems only once used broadly by real users.
Three Layers of AI Safety Testing
1 visible of 1 connections
Related Concepts11
Related Practices6
Ask about this framework
Transcript mentions
The second layer is evals. And this is essentially a laboratory setting.
Framework
Three Layers of AI Safety Testing
A staged approach to validating whether a model is safe: first studying its internal alignment and mechanistic interpretability, then testing it against synthetic scenarios in controlled evaluations, and finally observing its behavior in real-world deployment, since a model can pass the first two layers yet still reveal problems only once used broadly by real users.
Related Concepts11
Related Practices6
Ask about this framework
Transcript mentions
The second layer is evals. And this is essentially a laboratory setting.