Concept
The Bitter Lesson
The observation that general-purpose methods which leverage more computation and data ultimately outperform hand-crafted, domain-specific approaches, so it is usually better to bet on a more general, more capable model than to build narrow scaffolding around a weaker one.
The Bitter Lesson
6 visible of 6 connections
Related Frameworks3
Related Practices17
Ask about this concept
Transcript mentions
… I think a second one is um maybe actually like a a more even more general version of this principle is just the bitter lesson. Uh and I actually for the Quadko team we have a you know, hopefully hopefully um listeners have have read…
Yeah, there's literally a version of the bitter lesson applied to like building with AI where you know we were trying to architect all this stuff around and turns out the models are just kind of you know eat it all away
Well, first of all, there are many bitter lessons, but the bitter lessons everybody refers to is a paper written by Richard Sutton who won the Turing Award recently, and he does a lot of reinforcement learning. And Richard has said, if you…
… Another part of the bitter lesson of robotics I think we should be so realistic about is again, compared to language models or even spatial models, robots are physical systems. So robots are closer to self-driving cars than a large…
Concept
The Bitter Lesson
The observation that general-purpose methods which leverage more computation and data ultimately outperform hand-crafted, domain-specific approaches, so it is usually better to bet on a more general, more capable model than to build narrow scaffolding around a weaker one.
Related Frameworks3
Related Practices17
Ask about this concept
Transcript mentions
… I think a second one is um maybe actually like a a more even more general version of this principle is just the bitter lesson. Uh and I actually for the Quadko team we have a you know, hopefully hopefully um listeners have have read…
Yeah, there's literally a version of the bitter lesson applied to like building with AI where you know we were trying to architect all this stuff around and turns out the models are just kind of you know eat it all away
Well, first of all, there are many bitter lessons, but the bitter lessons everybody refers to is a paper written by Richard Sutton who won the Turing Award recently, and he does a lot of reinforcement learning. And Richard has said, if you…
… Another part of the bitter lesson of robotics I think we should be so realistic about is again, compared to language models or even spatial models, robots are physical systems. So robots are closer to self-driving cars than a large…