Nostr Web Client

Replying to

ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ

dirty secret of AI business: 37% of outputs are hallucinations

that lines up with 2 or 3 wrong

it's way too lossy haha, anyone who believes the marketing doesn't read any of the critical press

i saw that figure of 37% that was part of technical reports on OpenAI a week or two ago

the same goes for image generation, almost always overlapping stuff, absurd context, misshapen limbs and fingers

if this is the AI that is going to bring us skynet it's 37% vulnerable to making bad decisions

Silberengel 8mo ago

Well, it'll keep getting better at the pictures, but always double-check anything it does because it guesses and makes up stuff. Calls functions from libraries that don't have that library, or finds bugs that don't even exist and then adds 20 lines of code and 10 debugging logs to "correct" it.

Mine tried to add a monospace font that looks exactly like the standard ones and bloated up the size of the app.

That's the sort of stuff that vibe-coders can't see and just "approve". That's why they're actually quite slow developing with AI, as it's faster to hit the brakes and redirect to something more promising, but then you have to be able to code and think algorithmically.

Another example, it tried to make up wanton links to the pages to scrape, by taking a selection of pages like https://divineoffice.org/easter-w02-thu-mp/?date=20250501 and just randomly making up shit for the middle section.

I had to explain that it should do a first-pass on the main date for the page (as dates are a standard calendar object and not a fluctuating liturgical object) https://divineoffice.org/?date=20250502 or whatever, record the sub-page links (they change from year to year and season to season), and then do a second pass and scrape those links. Then you only scrape pages that exist and only with accurate links. That also gets around the fact that they change the content on the fly to introduce special mourning days for the Pope and stuff.

Then I can just rescrape the links and update whichever ones break, in my thrice-daily Jenkins routine, so that the 30040 hour content for the time frame selected. That way my stuff is always accurate and the links don't break. Don't have to look at the content, for that, just the links, as major changes to the content result in differnt links.

But, like, the AI couldn't figure that out. Seems completely obvious to me and it was so tedious writing it out that it's like, I coulda coded that faster.

And then the regex would have been right. How the heck do you try to use "psalm" for "Psalm 20" and "psalm-prayer". Those are obviously two completely different things. It couldn't even find all of the headers, when I told it precisely what the html tags look like for the divisions.

Just fighting stuff like that, all over, and so irritated.

Reply to this note

Please Login to reply.

Discussion

ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 8mo ago

yeah, the ML and AI features in intellij very often, like 2 out of 3 times doesn't even get the types right, the autocomplete very often picks something completely irrelevant and only starts to get what i'm doing after i've done about 5 examples

intelligent, it is not

and like you say, planes are going to be falling out of the sky if this shit infiltrates mission critical software development

Silberengel 8mo ago

Definitely puts in question using standard libraries in critical systems, as you know that shit be vibe-coded.

ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 8mo ago

i know for a fact that is impossible to do with the standard libraries of #golang AI can't generate functioning code even one time out of 5, it would be faster to write it by hand

the simple, yet deceptively sophisticated language grammar is a huge roadblock for AI to generate go code with any degree above scripting level of complexity

at the way things are going, there's gonna be such a thin field of competitors for me in my skillset that in 2 years time i will walk into a $100/hour server dev job that has knowing managers who have got completely sick and tired of guys who have no skills and reject 99 out of 100 applications

it's gonna be quite the turn-around for me because when i first started my career as a tech support freelancer, i did that because i tried to apply for thousands of jobs and got like one in a hundred "sorry" replies, i expect within two years they are gonna be flooding my inbox with sugar coated begging and huge pay packages for me because i did the work the hard way and proved that you can't shortcut serious engineering

Silberengel 8mo ago

It's already like that, in testing.

Used to be that there were 3 to 5 competent people applying for every testing job and it was a real competition, back in the naughties. But, now, it's like... I applied to 5 positions, got interviewed in person for 3 within 2 weeks, and got offered this job the day after the interview.

The position is still open, for more hires, but he's received a pile of applications and hasn't contacted even one. I've seen some of the applications. The resumes are almost all AI-generated and full of absolute bizarre garbage that doesn't even make any sense. And the rest of them can't speak Deutsch, to save their lives. Just garbled nonsense.

All of my coworkers are pretty good, but he has to weed through knee-high piles of crap to find them. Geez. Unfreakingbelievable.

Silberengel 8mo ago

And this is all critical systems stuff. This is not some little cellphone game app, or something.

It's the software used to design Autobahn bridges and conceive powertrain functions, or route logistics parks, and etc.

Scary as heck. They can't even math.

ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 8mo ago

it's hard not to get the feeling we are in a slow motion trainwreck right now as a species

even if trump manages to get a few things in order the magnitude of the epic bullshit out there in the world could not be fixed by a human. It be God fixing time.