Concept
Post-Training
The process of fine-tuning AI models post-deployment to optimize performance rather than building them from scratch.
Post-Training
7 visible of 8 connections
Related Concepts5
Related Frameworks1
Related Practices7
Ask about this concept
Transcript mentions
I think why we're seeing the rise of post-training happen is just that the models themselves are so powerful. As of this year, Nathan Lambert did this study that I thought was pretty interesting of all the top leader boards and it showed…
… I believe we will see just as much money spent on post-training as we will on pre-training and in the future, more on post-training. We talked a little bit about Nathan Lambert's study where his review was that when a model hits 30…
The way that I think about it is to create a foundation model, it requires a tremendous amount of compute, a tremendous amount of science. Expertise as we're seeing which the cost for scientists or the average value is raising dramatically…
… There's a pre-training and a post-training process in training a model, and for a long time these AI providers, or LLMs, or Frontier Labs we're focused on basically sucking up more and more information on the pre-training side of the…
And what post-training is, is it's augmenting and improving the data they have across every discipline or capability area that they care about. So take coding, or mathematics, or law or finance, they are focused on collecting high quality…
Concept
Post-Training
The process of fine-tuning AI models post-deployment to optimize performance rather than building them from scratch.
Related Concepts5
Related Frameworks1
Related Practices7
Ask about this concept
Transcript mentions
I think why we're seeing the rise of post-training happen is just that the models themselves are so powerful. As of this year, Nathan Lambert did this study that I thought was pretty interesting of all the top leader boards and it showed…
… I believe we will see just as much money spent on post-training as we will on pre-training and in the future, more on post-training. We talked a little bit about Nathan Lambert's study where his review was that when a model hits 30…
The way that I think about it is to create a foundation model, it requires a tremendous amount of compute, a tremendous amount of science. Expertise as we're seeing which the cost for scientists or the average value is raising dramatically…
… There's a pre-training and a post-training process in training a model, and for a long time these AI providers, or LLMs, or Frontier Labs we're focused on basically sucking up more and more information on the pre-training side of the…
And what post-training is, is it's augmenting and improving the data they have across every discipline or capability area that they care about. So take coding, or mathematics, or law or finance, they are focused on collecting high quality…