New being unfamiliar. LLMs can’t just abstractly create things they don’t have training data for the same way a human can. They’re parrots that rely on training data to “create” anything, and that’s why I said they’re good at creating copies and mash-ups.
A good example is DALI being famously unable to depict an empty glass of wine because its training data didn’t have one.
OpenAI had to feed it training data of empty wine glasses to undo that.
That need for base data to make literally anything is the whole reason why AI companies have been scraping the ever living shit out of the internet, to give as much training data to mash-up as is possible.
The more data it has, the more convincingly unique its output can be.
Iterate was a poor word to use, but you’ll have to chalk that up to me being a fallible human.
What I mean is that it can’t extrapolate from training data to make something unique. Everything it makes you will always be cobbled together from the data it has, because LLMs only know what things look like, not what they are as concepts.
Hell you want to see AI not understanding what good code actually is - look at MicroSlop’s Windows 11, where damn near every update has a crippling bug in it that could’ve been avoided
Ask some image generator to make an image of a undarbinian alien, which are super aggressive. I made that up and Google shows no result.
Create an image of a beaver-axolotl-bird. I am sure there exists no such picture on the web. It will make it up. I could not make both of these things up or somehow imagine them. You could also ask an LLM to generate these examples in the first place. Is that not “something new”? Not unique? Define these words then. These systems being unable to do some specific detail does not mean they can’t do anything to begin with. No human can do everything, that is completely disconnected from everything we are discussing.
Also, Windows, pre LLM it was bug free and nobody complained?
New being unfamiliar. LLMs can’t just abstractly create things they don’t have training data for the same way a human can. They’re parrots that rely on training data to “create” anything, and that’s why I said they’re good at creating copies and mash-ups.
A good example is DALI being famously unable to depict an empty glass of wine because its training data didn’t have one. OpenAI had to feed it training data of empty wine glasses to undo that.
That need for base data to make literally anything is the whole reason why AI companies have been scraping the ever living shit out of the internet, to give as much training data to mash-up as is possible. The more data it has, the more convincingly unique its output can be.
Iterate was a poor word to use, but you’ll have to chalk that up to me being a fallible human. What I mean is that it can’t extrapolate from training data to make something unique. Everything it makes you will always be cobbled together from the data it has, because LLMs only know what things look like, not what they are as concepts.
Hell you want to see AI not understanding what good code actually is - look at MicroSlop’s Windows 11, where damn near every update has a crippling bug in it that could’ve been avoided
Ask some image generator to make an image of a undarbinian alien, which are super aggressive. I made that up and Google shows no result. Create an image of a beaver-axolotl-bird. I am sure there exists no such picture on the web. It will make it up. I could not make both of these things up or somehow imagine them. You could also ask an LLM to generate these examples in the first place. Is that not “something new”? Not unique? Define these words then. These systems being unable to do some specific detail does not mean they can’t do anything to begin with. No human can do everything, that is completely disconnected from everything we are discussing.
Also, Windows, pre LLM it was bug free and nobody complained?