55Rick Rosner, American Comedy Writer, www.rickrosner.org
Scott Douglas Jacobsen, Independent Journalist, www.in-sightpublishing.com
Rick Rosner: We’ve talked about it numerous times now: AI will claim to be conscious well before it’s anything like what we would consider conscious. But its claims will probably be qualitatively similar in terms of their output as it goes from not being conscious and claiming to be conscious to being pretty conscious.
Scott Douglas Jacobsen: We could discuss what behaviours might emerge as AI goes from falsely claiming to be conscious to being conscious.
Rosner: Well, I don’t have any information on that. It’ll be easier to see AI as conscious when AI has agency, especially when AI has little robots and scooters that it can use to have some agency, to move around, and to do things. If it’s engineered, we’ll certainly engineer some AIs to protect their physical integrity because we spent money on them and don’t want them to be destroyed willy-nilly.
Also, we should do that because it will seem nicer to us, though the idea of niceness when engineering what AIs want to do requires a lot of philosophizing and some skepticism. You have to decide whether a sufficiently developed AI will also develop a drive for self-preservation, probably in many cases. Then you have to decide whether it’s nice to make AIs want to save themselves instead of AIs being cool with being just turned off and going off to oblivion. It’s a big area, and I don’t want to talk about it much beyond that right now.
License & Copyright
In-Sight Publishing by Scott Douglas Jacobsen is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. ©Scott Douglas Jacobsen and In-Sight Publishing 2012-Present. Unauthorized use or duplication of material without express permission from Scott Douglas Jacobsen strictly prohibited, excerpts and links must use full credit to Scott Douglas Jacobsen and In-Sight Publishing with direction to the original content.
Rick Rosner 