In the 14 hours since that flagged post, the OP has changed _nothing_ in that repo to address the feedback people gave him, and instead decided to just resubmit his proj to HN.
I flagged it because it includes incidents that weren't related to "vibe coding", e.g. ones related to Tea/Vite, and Cursor using "outdated Chromium/Electron builds".
This is a deeply unserious book. It gives no concrete outline that leads to extinction. I agree with the overall premise that IFF we give inscrutable black boxes the ability to self-replicate, build their own data centers, and generate their own power, we're doomed. However, I see no hint that people (or governments) will give black boxes complete autonomy with no safeguards or kill switches.
Frankly, if we give black boxes the ability to manipulate atoms with no oversight, we _deserve_ to go extinct. The first thing we should do if we achieve AGI is to take it apart to see how it works (to make it safe). I believe that's one of the first things a frontier lab will do because it's our nature as curious monkeys.
> Frankly, if we give black boxes the ability to manipulate atoms with no oversight, we _deserve_ to go extinct.
Well we are giving them ability to manipulate all aspects of a computer (aka giving them computer access) and we all know how that went (Spoiler or maybe not so much spoiler for those who know but NOT GOOD)
AI absolutely is capable of doing damage, and _is_ currently doing damage. Perpetuating inequality, generating fake news, violation of privacy, questionable IP/rights, etc. These are more pressing than the idea that someday we will give AI the ability to manufacture nano-mosquitos that will poison us all, as Yudkowsky suggested on a recent podcast. He's so busy fantasizing about scifi he's lost touch with the damage it's currently doing.
The social and financial impacts of AI can hardly be understated and although one can go into the weeds of fascination and imagine what if's, largely speaking, we have to do something right now about the problems which are impacting about us right now too.
I would love a discussion about what are some things which can be done at a societal level about these things.
reply