Concept
Pre-training
Training models on the entire corpus of written human knowledge and internet data
Pre-training
2 visible of 3 connections
Related Concepts1
Related Practices5
Ask about this concept
Transcript mentions
… There's a pre-training and a post-training process in training a model, and for a long time these AI providers, or LLMs, or Frontier Labs we're focused on basically sucking up more and more information on the pre-training side of the…
I mean, yes and no because take for example trajectories, or you want to be able to do, people use flight search or an accounting end-to-end process, or you want to be able to conduct biological experiments, you need actual trajectory…
Concept
Pre-training
Training models on the entire corpus of written human knowledge and internet data
Related Concepts1
Related Practices5
Ask about this concept
Transcript mentions
… There's a pre-training and a post-training process in training a model, and for a long time these AI providers, or LLMs, or Frontier Labs we're focused on basically sucking up more and more information on the pre-training side of the…
I mean, yes and no because take for example trajectories, or you want to be able to do, people use flight search or an accounting end-to-end process, or you want to be able to conduct biological experiments, you need actual trajectory…