Concept
Test Time Compute
The allocation of computational resources during the inference stage of a model to enhance performance.
Test Time Compute
2 visible of 2 connections
Related Concepts1
Related Frameworks1
Related Practices2
Ask about this concept
Transcript mentions
… el about discussion of should I spend more compute on pre-training or fine-training or inference because inference and people thought I was just like test time compute. So spending more compute on inference is like calling test time…
Concept
Test Time Compute
The allocation of computational resources during the inference stage of a model to enhance performance.
Related Concepts1
Related Frameworks1
Related Practices2
Ask about this concept
Transcript mentions
… el about discussion of should I spend more compute on pre-training or fine-training or inference because inference and people thought I was just like test time compute. So spending more compute on inference is like calling test time…