It really is worth a read. Thank you.
post
Because it'll burn the planet?
Amazing article. Thanks for sharing.
That was a really interesting and well-written read, though I got a bit lost when the logic took some sharp turns. The idea of fascism in LLM systems was new to me and certainly got me thinking.
"AI" is certainly environmentally damaging and dangerous, and if it isn't given new input, it quickly starts generating absolute crap, but I don't agree with this statement:
LLMs are simply not capable of producing new knowledge. They can only reproduce what’s in their training data. An LLM-based system, being a statistical model of its training data and therefore effectively a form of lossy compression, can by definition never solve any problem for which the training data or information otherwise available to the system doesn’t already contain the solution.
We've seen new mathematical proofs coming out of LLMs. Those proofs weren't in the dataset that they were trained on.
AlphaGo Zero was given the rules of go and made to play against itself with no example games. It came up with new openings that hadn't been seen before, and were better than anything that humans had come up with.
AlphaFold was given protein sequences and was able to generate correct 3D structures, that again weren't in its training data.
Trying to defend the position of "nothing new comes out of AI" will necessarily lead you to such a narrow definition of novelty, that it will exclude most things that we consider to be human creativity.
replies:
all 23 comments