Concept
Supervised Fine-Tuning (SFT)
Training method like mimicking a master and copying what they do
Supervised Fine-Tuning (SFT)
4 visible of 4 connections
Related Concepts2
Related Practices10
Ask about this concept
Transcript mentions
… So we train them using human data, and there's a lot of different products that we have, like SFT, RHF, rubrics, verifiers, RL environments, and so on and so on, and then we also measure how well they're progressing. So essentially we're…
… SFT data is a prompt and a response, and obviously the labs are very focused on these thinking or reasoning models. So, in order to improve a reasoning model you need to actually have the step-by-step instructions, of which when you…
Yes, and we're doing all of the above. We don't do the auto eval, we produce rubrics which are used auto evals.
Concept
Supervised Fine-Tuning (SFT)
Training method like mimicking a master and copying what they do
Related Concepts2
Related Practices10
Ask about this concept
Transcript mentions
… So we train them using human data, and there's a lot of different products that we have, like SFT, RHF, rubrics, verifiers, RL environments, and so on and so on, and then we also measure how well they're progressing. So essentially we're…
… SFT data is a prompt and a response, and obviously the labs are very focused on these thinking or reasoning models. So, in order to improve a reasoning model you need to actually have the step-by-step instructions, of which when you…
Yes, and we're doing all of the above. We don't do the auto eval, we produce rubrics which are used auto evals.