OK, Chat GPT4 is now out.

It’s a incrementally smarter version of Chat-GPT3, shock horror. 😂

It is very capable at referencing information that is commonly referenced. eg law, book keeping, medicine, etc. It struggles with more esoteric niche things.

It has broad and deep understanding of mainstream science and technology as found across industry.

But it has no real understanding of patents other than popular patent history. It does not understand prior art, state of the art or the frontier.

It is not capable of innovation. It doesn’t even understand how to do innovation.

It is almost entirely retrospective.

This is largely down to the inescapable fact that AI requires data on which to train. For tasks and domains where lots of data exists, AI will surpass humans very quickly and will outcompete all workers on memory intense tasks.

Where AI seems to be very limited (just now at least) is at the fringe and the frontier of knowledge.

AI will achieve super human competence at many things that are already done today, but it is far from obvious to me that AI will leapfrog humans working at the state of the art.

It’s also difficult for me to imagine AI self innovating as a new vanguard beyond the frontier of human invention.

I can imagine how this might be achieved, but it would require AI to amass large datasets at the frontier and incrementally bridge off the state of the art into the abyss generating new data and retraining as it does so.

This is very different to how humans innovate. It would be vastly more laborious and difficult for AI than for a human inventor hypothesising new concepts sans data.

Reply to this note

Please Login to reply.

Discussion

If it helps me do better searches then that’s all I need it to do 😂

Yes it crushes search.

Google Search is very obsolete at this point. The fact it is also ad ridden malware is just 🥲

Well it’s a particular type of search though. For example it would need to be able to see any image using any hashtag in any language on Instagram, or any other site where photos are kept online. That’s one thing that I currently do manually and it doesn’t scale at all

Did AI not already inovate, when it came up with a fancy new strategy to win in Go?

It created a gigantic procedurally generated training dataset using the formulaic rules of the game.

That doesn’t work irl.

Why should it not work irl? It could try billions of possibilities to build better, faster airplanes for example. Could also easily find best marketing approaches by millions of parallel a/b tests etc.

Neither of those things are innovative.

There probably isn’t enough aircraft design data to train a reliable model. You might be able to take a 747 design and make incremental improvements to some components.

But it isn’t going to design a previously unseen hypersonic passenger jet with new engine technology.

The hardware necessary to support that kind of program doesn’t exist.

I've asked now GPT4. Let's see ehat the future brings 🙃

With the rapid advancements in artificial intelligence and machine learning, it is possible that AI could come up with new inventions in the future, including super-fast airplanes and other advanced technologies. By analyzing vast amounts of data from previous designs and simulations, AI could potentially develop innovative solutions that humans may not have thought of before.