Prevent dangerous AI: Difference between revisions

From the change wiki
(Refactored)
No edit summary
 
Line 4: Line 4:
}}
}}
===Not being able to trust pictures, video, audio===
===Not being able to trust pictures, video, audio===
Let's draft up some policies that could stop this. Join the {{tp2}}.
{{R|FAQ
|''What about AI detection software?''<br />Even though generators and detectors both get more advanced over time, the generators ultimately win, unfortunately. ''Read&nbsp;more''
}}
What could be done:
:; policy ideas:
:* [[Ban unwatermarked generative AI]] {{talk|should watermarking be combined with an additional policy where every AI image generator company has to keep a database of all generated images, and offer a free service for anyone to verify any image on the internet, as in, to see if it matches something in the database?<br />what should we title such a policy?}}
:; tech ideas:
:* [[Anonymous camera digital signature]]s
Status quo:<small>
* Google's AI image generators produce images with a "synth ID" so they can be identified as fake. Not sure how foolproof it is though.
* Sora AI (video generator) adds a subtle watermark to the video. Some people have been known to crop it out though.
* There are plenty of image generators that don't produce any watermark at all.
* Watermarks in general are not hard to remove, unfortunately. Still better than nothing though; most people probably won't bother removing them. So watermarking can at least reduce the total amount of misleading slop on the internet.</small>
{{R|FAQ
{{R|FAQ
|Why not just create more jobs? {{p2|''Read&nbsp;more''
|Why not just create more jobs? {{p2|''Read&nbsp;more''

Latest revision as of 01:15, 7 March 2026

Current dangers

Why it matters
1. Don't let governments become dictatorships. Footage is a key part of holding authorities accountable. Who will watch the watchers? We the people. We can't let AI ruin that.

Not being able to trust pictures, video, audio

FAQ
What about AI detection software?
Even though generators and detectors both get more advanced over time, the generators ultimately win, unfortunately. Read more

What could be done:

policy ideas
  • Ban unwatermarked generative AI
tech ideas

Status quo:

  • Google's AI image generators produce images with a "synth ID" so they can be identified as fake. Not sure how foolproof it is though.
  • Sora AI (video generator) adds a subtle watermark to the video. Some people have been known to crop it out though.
  • There are plenty of image generators that don't produce any watermark at all.
  • Watermarks in general are not hard to remove, unfortunately. Still better than nothing though; most people probably won't bother removing them. So watermarking can at least reduce the total amount of misleading slop on the internet.
FAQ
Why not just create more jobs? Read more

Unemployment

Main solution: Socialize basic needs

Future dangers

Unaligned superintelligence

If you're not familiar with this, you can start by watching: If anyone builds it, everyone dies

Now is the time to figure out how to prevent catastrophic AI, before it's too late. If you have policy ideas or more, join the discussion.