Stadia.
…Is he gonna hire Phil Spencer?
Stadia.
…Is he gonna hire Phil Spencer?
Will it go as well as X AI?
Grok is the laughing stock of the LLM world, and he also completely lied about his promise to make them open source. The latest Qwen release from Alibaba (open, locally runnable weights, tiny, Apache, freaking smart) has rendered his obscene hoard of H100s basically obsolete, with a miniscule fraction of the money.
It’s even simpler than that, it’s people being told what to think.
I think “people” speaking very generally used to not read a ton of news, heard stuff from the grapevine, and so on. “Elites” and news junkies had somewhat more monolithic sources.
And that’s not true anymore. Nearly every “average” person’s life is now dominated by a personalized feed, a podcast, TV, radio, chatroom, whatever, and it’s having an outsized influence compared to their observations of reality now.
It’s my belief that there’s basically nothing Biden could have done to alter this (other than regulating algorithms, and it’s far too late) and ultimately it’s the DNC’s fault for “taking the high road” and not playing the propaganda game.
I do absolutely agree.
It’s like “don’t feed the trolls,” the most important internet wisdom ever, has been long forgotten and is tearing down society.
I don’t know how to fix it. We should have regulated social media algorithms years ago, but now it’s way too late, and people’s information hygiene is not getting better. Any kind of news outlet is basically compelled to cover it for financial reasons less they fade into obscurity, and algorithms love it and aren’t going to change.
Unfortunately we basically voted him into office.
It’s the “Trump problem” now. Now he has the power to act on these insane opinions and threats, so ultimately they are newsworthy even if I largely agree with you.
That’s the strange thing, it’s completely open with tons of news outlets constantly calling it out, not an “taboo secret” like of like old facist governments. And in all liklihood, it will stay that way.
The filter bubble and American apathy is just that powerful, I guess?
That is an American pasttime
The plan is to have a disturbing deficit, and interest payments are getting really big now.
This is like climate change, it’s not apparently hurting anyone tomorrow so… no one cares anymore.
Llama 3.1 is not even a “true” distillation either, but its kinda complicated, like you said.
Yeah Qwen undoubtedly has synthetic data lol. It’s even in the base model, which isn’t really their “fault” as its presumably part of the web scrape.
And… this curbs immigration? By making the country less desirable to live in or something?
How useful would the training data be
Open datasets are getting much better (Tulu for an instruct database/recipe is a great example), but its clear the giants still have “secret sauce” that gives them at least a small edge over open datasets.
There actually seems to be some vindication of using massively multilingual datasets as well, as the hybrid chinese/english models are turning out very good.
You can use larger “open” models through free or dirt-cheap APIs though.
TBH local LLMs are still kinda “meh” unless you have a high vram GPU. I agree that 8b is kinda underwhelming, but the step up to like Qwen 14B is enormous.
It turns out these clusters are being used very inefficiently, seeing how Qwen 2.5 was trained with a fraction of the GPUs and is clobbering models from much larger clusters.
One could say Facebook, OpenAI, X and such are “hoarding” H100s but are not pressured to utilize them efficiently since they are so GPU unconstrained.
Google is an interesting case, as Gemini is getting better quickly, but they presumably use much more efficient/cheap TPUs to train.
That’s because ollama’s default max ctx is 2048, as far as I know.
I don’t think Qwen was trained with distillation, was it?
It would be awesome if it was.
Also you should try Supernova Medius, which is Qwen 14B with some “distillation” from some other models.
My sister just got sick as stink visiting family who didn’t bother to tell her they were sick! She’s coughing up blood!
I know a nurse who’s an anti-vaxxer.
…Yeah, I guess pandemic-conscious hygiene is not on people’s minds.
All the other brands went along
(My 2020 G14 has 3 A ports and ethernet, but still…)
You are spouting assertions about what sounds right while ignoring bodies of scientific evidence contradicting your viewpoint. Just because Lemmy users are unwilling to spend 20-30 minutes digging through arixv to refute you doesn’t make you right.
You don’t want to go and look up and analyze evidence that floride in the water supply is beneficial, you want to just assert the hypothesis you’ve formed as likely truth without evidence and research into related work, and I can confidently say this because experts who spend their lives reading papers and writing them on this very topic are qualified to make these assertions.
…This “sounds right” line of thinking has been the bane of civilization for eons. You aren’t breaking up some scientific fallacy like the church believing the Earth is the center of the universe, you are perpetuating one.
You better fucking subscribe to The Onion
I love everything about this.
NFT artists kind of hide behind the oldschool art world to justify it…
I think it shows how stupid that world is.
The point of art is to move people, to make them think and feel something by conveying the artist’s thoughts, not be a store of value. And while I’ve been to museums with gorgeous pieces, if you’re paying millions for a painting, at some point most of that value is the gratification of hoarding it. That same money could buy you an incredible experience in today’s art landscape, but it’s not about the experience, is it? And NFTs are like the perfect deconstruction of that.
That being said, OP I am downvoting your post because eyeballs are exactly what crypto bros want, no offense :P