Personally I do care, in the sense that, everything else being equal, I'd use software written by hand rather than written by AI. This is especially true for open source software.

Software programs are works of literature. If a program has been written by humans, it's pretty clear what the "source code" is and what should be shared. We know it's intelligible to humans because a human wrote it.

But what if a program has been generated by an illiterate vibe coder? In that case it may go to production without anyone ever understanding the program in full. The prompt isn't source code either, since models behave randomly and may generate different programs with the same input.

To this, you should add that many "vibe coders" depend on specific models offered by specific companies through an API. This effectively adds a dependency on those companies for the development of the program.

It matters to have people that understand programs and, for that, it makes sense to prefer programs that have been written and continue to be written by hand.

The use of prompts in natural language is not akin to using high level languages. Natural language is inherently imprecise, while all programming languages, no matter how high level, communicate ideas precisely and are formal languages.