Nostr Web Client

Replying to

Laan Tungir

I hear people mentioning that LLMs will cause the death of programmers.

What I don't hear is that LLMs will cause the death of programming languages.

If I'm using an LLM to write my code, why am I using Python or Javascript? What is the point?

As long as my LLM is doing the programming, I might as well have it program in C.

Even further, why not have the LLM program directly in machine code?

There is no need to program in a slow high level programming language if the LLM is doing the programming for me.

calle 9mo ago

Training data

Reply to this note

Please Login to reply.

Discussion

liminal 🦠 9mo ago

LLMs can only statistically predict logic, rather than run and validate logic.

Statistically predicted logic tends to converge on correct logic through lots of examples.

roll_the_dice 9mo ago

Can't you just train it on literally all binaries that exist?

calle 9mo ago

Is there a stack overflow of people asking questions about binaries?

roll_the_dice 9mo ago

Is that required? I'd argue just directly ingesting all the software that exists directly avoids all the garbage that comes with human language. Maybe there's not enough data though.

Daneel 9mo ago

As @calle points out, there is no vast repository of assembly language projects to train the models on. Obviously there is plenty of compiled code but not sure there would be enough context for that to be useful?