I see a ton of young people patting themselves on the back regurgitating what at this point is clear misinformation about stochastic parrots and remixing content that they picked up from similarly poorly informed tech writers with skin in the game, oblivious to the emerging picture in ongoing research.
It is moving too quickly.
Just today I was reading a paper on using CoT prompting (research from 2022) to efficiently transfer domain knowledge from a larger model to a much smaller model which then outperforms the original.
What that’s going to mean for Meta’s open sourced models, for the market for synthetic data, for the practical limitations on the impact of IP cases - is wild.
And that’s just this week’s news.
It’s way too much too quickly.
Keep in mind that the average practicing doctor is on average 17 years out of touch with the most recent research.
To expect a politician of any age to have a solid grasp on this stuff isn’t practical.
There are a number of trends in the research that can be reasonably predicted, but I’ve never seen a field moving this fast.
The very idea of trying to predict the situation even five years out is ludicrous. By the time legislation proposed today is being passed, it’s going to be obsolete.
That’s really not the differentiating factor.
Easily 80% of young people loudly commenting on the topic online have no idea about nuances as centrally relevant to where the tech is going as “Do Large Language Models learn world models or just surface statistics?”.
I see a ton of young people patting themselves on the back regurgitating what at this point is clear misinformation about stochastic parrots and remixing content that they picked up from similarly poorly informed tech writers with skin in the game, oblivious to the emerging picture in ongoing research.
It is moving too quickly.
Just today I was reading a paper on using CoT prompting (research from 2022) to efficiently transfer domain knowledge from a larger model to a much smaller model which then outperforms the original.
What that’s going to mean for Meta’s open sourced models, for the market for synthetic data, for the practical limitations on the impact of IP cases - is wild.
And that’s just this week’s news.
It’s way too much too quickly.
Keep in mind that the average practicing doctor is on average 17 years out of touch with the most recent research.
To expect a politician of any age to have a solid grasp on this stuff isn’t practical.
There are a number of trends in the research that can be reasonably predicted, but I’ve never seen a field moving this fast.
The very idea of trying to predict the situation even five years out is ludicrous. By the time legislation proposed today is being passed, it’s going to be obsolete.
Regulators are screwed.