Practice
Use binary pass/fail judgments instead of rating scales
Avoid 1-5 or 1-7 scales in favor of clear yes/no decisions for eval metrics
Preparing graph…
100%
Practice
Use binary pass/fail judgments instead of rating scales
1 visible of 1 connections
11 nodes · 10 connectionsConceptEpisodeFrameworkPersonPracticeLarger = more connections+ Expand · − Collapse (double-click)Drag a node to pull its neighbors along
Context
management
Related Concepts16
Related Frameworks1
Transcript mentions
I love how Shreya really teed it up for me, so thank you so much. So what we have is a LLM as a judge prompt for this one specific failure.
🔧
Practice
Use binary pass/fail judgments instead of rating scales
Avoid 1-5 or 1-7 scales in favor of clear yes/no decisions for eval metrics
Context
management
Related Concepts16
Related Frameworks1
Transcript mentions
I love how Shreya really teed it up for me, so thank you so much. So what we have is a LLM as a judge prompt for this one specific failure.