|
Are large language models really AI?
Garuda.Chanti
Server: Garuda
Game: FFXI
Posts: 11692
By Garuda.Chanti 2025-04-25 17:27:22
a large part of why I started this thread. I actually think the large part of why you started this thread is simply because you like the convo. That part too.
Asura.Saevel
Server: Asura
Game: FFXI
Posts: 10111
By Asura.Saevel 2025-04-25 18:35:15
Now please tell me what IQ tests measure OTHER than your ability to take IQ tests.
If we're talking the official ones, it was originally the ability to mentally process information. They later ... tweaked it to include stuff that has nothing to do with mental processing, but that's a different discussion. The entire thing is timed and attempts to see how quickly and accurately the person can find patterns, infer information and extrapolate on those patterns and information. Basically how fast can you solve mental puzzles.
Having said that, as I mentioned earlier "AI" is nothing remotely close to "intelligent", "sentient" or "learning". Nothing but statistics expressed through the English language. It's a google search on steroids.
We as humans have this tendency to project our anthropic identity onto anything that even remotely resembles us. We do it to animals, planets and even natural phenomena. Right now people are merely projecting their human identity onto a mathematical construct.
Kyle Hill did an extremely good breakdown on what Chat-GPT and "AI" in general is without using pseudo-magic click bait words.
YouTube Video Placeholder
[+]
By Godfry 2025-04-25 19:32:37
Having said that, as I mentioned earlier "AI" is nothing remotely close to "intelligent", "sentient" or "learning". Nothing but statistics expressed through the English language. It's a google search on steroids.
What's your comment on it being able to reason about math? I also wonder if our brain is actually pretty close to a statistical model, just like LLMs.
[+]
Asura.Saevel
Server: Asura
Game: FFXI
Posts: 10111
By Asura.Saevel 2025-04-26 04:56:53
Having said that, as I mentioned earlier "AI" is nothing remotely close to "intelligent", "sentient" or "learning". Nothing but statistics expressed through the English language. It's a google search on steroids.
What's your comment on it being able to reason about math? I also wonder if our brain is actually pretty close to a statistical model, just like LLMs.
Our brain is very very different, nothing remotely like that.
LLM's are stochastic parrots, they are just repeating back what was fed into them. You put in an input string, it breaks that string into indexed phrases and then integrates through the array to find the most probably match for what follows. The framework they use was designed to predict patterns in very large sets of unstructured data. The only thing that makes "AI" different is the dataset being all the public and not-so-public works available off the internet. It's simply finding patterns in the human language and repeating those back to you.
The only part that is even remotely "human like" is that the training algorithms were based on an old theory (since disproven) of how humans learn. The math's and theory for these models have been around for decades, there simply wasn't a feasible way to crunch the quantity of raw data that is required to train the model. It would of taken a super computer a very long time to do previously, then CUDA was made and someone figured out a way to adapt the algorithms to work with that instead.
Everything else with "AI" is just buzzwords and smoke and mirrors used to hype something and make people rich.
[+]
By RadialArcana 2025-04-26 05:36:46
Thing that annoys me is the sheer amount of gaslighting going on (mainly from S Altman), to try push up stock prices. Everything from blatant fear mongering to embellishment.
AI is going to move into two camps going forward, bad AI that is made for all the most negative reasons for shareholder/investor benefit (aka replacing workers etc) and governments (watching everything you do) and open source AI that is made to improve the tech.
Most of the advancement will be in the open source camp (which seems to be heavily skewed to China sadly), the public companies are just going to chase all the things the evil things billionaires want it for.
By K123 2025-04-26 06:43:41
Wechsler-Bellevue and Stanford-Binet. Wechsler-Bellevue stopped being used in 1955. I know you're old but you can't be that old. It requires reading. Standford-Binet requires reading and writing too.
There are non verbal IQ tests out there ... You don't have to talk in any I know of. You're being extremely pedantic here - not that I was even saying reading=high IQ, but if you can't read in a developed economy there is an extremely high correlation to having a low IQ.
By K123 2025-04-26 06:46:10
Most of the advancement will be in the open source camp (which seems to be heavily skewed to China sadly), the public companies are just going to chase all the things the evil things billionaires want it for. I think the interesting thing here is that nothing anyone is doing can not be copied by competitors - you can't patent training methods or prove how a model has been trained, and Deepseek are open sourcing all their advancements which make them better than OpenAI and all other western companies in a way - and Microsoft released a CCP propaganda free version of Deepseek already.
Qwen are the best company out there at the moment, and I have huge respect for Mistral. It's Zuckerberg that we need to watch out for the most, that man is the biggest danger to humanity since hitler.
Garuda.Chanti
Server: Garuda
Game: FFXI
Posts: 11692
By Garuda.Chanti 2025-04-26 11:17:33
I know you're old but you can't be that old. I just turned 81.
Yes, THAT old. 1944 model. I was 11 in 1955. And despite my cancer I expect to get LOTS older. My favorite great aunt, who was born in the 1880s, made it to 104.
Quote: you can't patent training methods or prove how a model has been trained You can slap pat. pending on anything even if you have yet to file for a patent. Also some authors have proven that some LLMs have been trained on their copyrighted materials.
Quote: Microsoft released a CCP propaganda free version of Deepseek already. !!!
Quote: It's Zuckerberg that we need to watch out for the most, that man is the biggest danger to humanity since hitler. I can think of a few other candidates that are right up there with Zuck.
Bahamut.Senaki
Server: Bahamut
Game: FFXI
Posts: 205
By Bahamut.Senaki 2025-04-26 11:39:40
Am I crazy or did the title change?
Edit: Yes
Garuda.Chanti
Server: Garuda
Game: FFXI
Posts: 11692
By Garuda.Chanti 2025-04-26 11:51:05
I didn't change it.
By Godfry 2025-04-26 12:42:28
By Pantafernando 2025-04-26 12:45:07
Am I crazy or did the title change?
Edit: Yes
Yes, you are crazy.
No.
Not because of title change
By Pantafernando 2025-04-26 13:21:14
If you look at it upside down, then you are barely legal!
By K123 2025-04-26 13:42:56
You can slap pat. pending on anything even if you have yet to file for a patent. Also some authors have proven that some LLMs have been trained on their copyrighted materials. I'm not talking about materials but methods.
Garuda.Chanti
Server: Garuda
Game: FFXI
Posts: 11692
By Garuda.Chanti 2025-04-26 14:40:46
I'm not talking about materials but methods. People HAVE patented methodology.
The patent office got really wonky in the 1990s. People were patenting weird things. Not items, ideas, even common algorithms currently in use, got patented.
Pretty much if you can describe something you can file for a patentent on it and in the '90s they did and got the patents.
The patent office did get better. I think.
By K123 2025-04-26 16:16:33
I'm not talking about materials but methods. People HAVE patented methodology.
The patent office got really wonky in the 1990s. People were patenting weird things. Not items, ideas, even common algorithms currently in use, got patented.
Pretty much if you can describe something you can file for a patentent on it and in the '90s they did and got the patents.
The patent office did get better. I think. I don't think any training methods can be patented, at least it isn't happening. This might just be the nature of the beast, that things are moving faster than even patent pending would be granted but I'm not sure. Either way, thus far, nothing stops everyone stealing everyone's approaches to pre and post training of models. MoE is becoming standard when Mistral were first to demonstrate it, reasoning approaches are standard for all models going forwards, etc.
Garuda.Chanti
Server: Garuda
Game: FFXI
Posts: 11692
By Garuda.Chanti 2025-04-26 18:06:02
I don't think any training methods can be patented, at least it isn't happening. They did. It was.
I don't know how old you are but in the '90s news had many stories on how many totally ridiculous things were getting patented.
The blame was placed on people patenting algorithms. This was a brand new and explosively broad field for the PO. Suddenly things long considered unpatentable were getting through.
At the time I was saying Costco should patent its membership store model. They could have gotten away with it.
[+]
Bahamut.Senaki
Server: Bahamut
Game: FFXI
Posts: 205
By Bahamut.Senaki 2025-04-26 18:27:25
Am I crazy or did the title change?
Edit: Yes
Not because of title change
Wait... does that mean the title DID change?
Because I swear it just said LLM models. Now it's spelled out.
Am I crazy or did the title change?
Edit: Yes
Yes, you are crazy. I cannot confirm nor deny.
Is it a red flag to think I’m always the sane on in relationships ?
By K123 2025-04-27 06:12:41
x post
Will be interesting to see how R2 compares to this when launched.
By Dodik 2025-04-27 06:14:27
Is it a red flag to think I’m always the sane on in relationships ?
Yes.
By RadialArcana 2025-04-30 10:28:31
It's strange to think that google has been mining all websites for the past 5-6+ years for data to feed into its (previously secret) AI training. The amount of censorship they demand for providing ads makes a lot more sense when you view it as them wanting to censor the data they use to train corporate AI.
Reddit also signed a deal with google in 2025 after going public, to sell all users written data in and industrial manner too (twitter and every other site also does the same obv). The problem with reddit though, is that due to the rating system it makes people afraid to speak their mind and it's also politically biased. So it's very stunted and controlled form of written data, much less valuable for training.
Even youtube now transcribes everything in every video posted to text, so not only can they sell all the video content and music to AI training but also the written text.
Discord is the untapped gold mine. As a closed off platform of masses of written data, companies like google, open ai and microsoft want to get hold of it really badly (which is why they want to go public soon). Not only does it have mass amounts of very valuable written data (including very technical data not available anywhere else on the internet), but unlike reddit the data is far higher quality and more open because people are not afraid of rate downs in the same way. If you have posted detailed technical data on discord they are in effect going to take it and feed into into ai. They are in effect mining every kind of knowledge for corporate use (technical, artistic or even human sounding text).
So if you have ever written anything on the internet, the companies are buying and selling it all off enmasse. If you have ever posted images or photos, they have taken them and are buying and selling it all off, same for videos or music. Literally everything you have ever shared in any way is like gold trapped in a mine and they are mining this resource and selling it off.
AI is also starting to become more and more embraced by governments, in the past the amount of data the government could track on us all was of little use becasue they simply did not have the manpower to sort though it all to keep a good eye on you (they had to actually put you on a watch list and track all your online activity). Now (or soon) they can make use of all that mass surveillance and they can watch literally everyone at all times.
So not only are the corporations buying and selling everything you ever posted in any way, but the governments are gearing up to use the resulting tech from all that training to watch you more effectively than ever before too.
They are even researching ways to create pre-crime technology with ai (like minority report, but real!), not only by scanning video surveillance footage in real time and detecting body language to alert operators but also more serious crimes by scanning peoples social media posts or google searches. They collect lots of online data of what people did for years before committing crimes now, and that can be used to predict people who have yet to do anything possibly going along the same path. In effect they will be able to possibly detect you're going to commit a crime, before you even fully decide you want to do it.
By Pantafernando 2025-04-30 10:35:43
That is why you shouldnt allow cats to get close to the keyboard...
By Pantafernando 2025-04-30 10:35:57
Server: Fenrir
Game: FFXI
Posts: 1469
By Fenrir.Richybear 2025-04-30 12:36:25
So the key is potato lentil soup to throw in words grilled cheese with bellybutton sauce randomly and completely 1+1=7 mess up everything.
[+]
By K123 2025-04-30 12:58:45
[+]
VIP
Server: Fenrir
Game: FFXI
Posts: 982
By Fenrir.Niflheim 2025-04-30 14:32:36
Only a matter of time until someone makes AI trolls for FFXIAH IDK i think the home grown trolls we have here will drive even the most well designed AI mad.
[+]
By Pantafernando 2025-04-30 14:58:00
Im sure an AI troll would make this site a whole lot more friendly than our current trolls made of blood and flesh
By Pantafernando 2025-04-30 14:58:37
And also smell better.
Than those stinking nerds here
[+]
By RadialArcana 2025-05-01 02:21:58
The biggest fear with AI isn't if it becomes self aware or if it takes your art, it's what the bureaucrats can figure out to do with it to take all your rights away.
The sheer amount of manpower AI brings to the table is insane, there are so many things the politicians and bureaucrats always wanted to do but just never could before cause there was just so much data, but soon they will be able to it all at the press of a button.
The amount of freedom we are all going to lose over the coming years is so incredibly shocking.
By Pantafernando 2025-05-01 04:06:11
Our freedom is gradually being taken, but not because of AI.
As it is, AI value today feels something like the race to the moon between URSS and USA.
Even today I dont recall any exploitation made in moon. I dont recall some country have massive profit by having reach the moon early. Still, at that time, it was something worth putting money and chimpanzees lives to be the first.
Like nowadays: what the humanity will do with a machine that is about as human as them? Probably nothing. Still there is this number race
Nowadays AI helps productivity, sure, but no country is sinking billions just to have a machine working better than a slacker
And if not what would or could be? (This assumes that we are intelligent.)
Sub questions:
1, Is self awareness needed for intelligence?
2, Is conciseness needed for intelligence?
3, Would creativity be possible without intelligence?
Feel free to ask more.
I say they aren't. To me they are search engines that have leveled up once or twice but haven't evolved.
They use so much electricity because they have to sift through darn near everything for each request. Intelligence at a minimum would prune search paths way better than LLMs do. Enough to reduce power consumption by several orders of magnitude.
After all if LLMs aren't truly AI then whatever is will suck way more power unless they evolve.
I don't think that LLM's hallucinations are disqualifying. After all I and many of my friends spent real money for hallucinations.
|
|