A recent open letter by computer scientists and tech industry leaders calling for a six-month ban on artificial intelligence development has received widespread attention online. Even Canada’s Innovation Minister François-Philippe Champagne has responded to the letter on Twitter.

The letter, published by the non-profit Future of Life Institute, has asked for all AI labs to stop training AI systems more powerful than GPT-4, the model behind ChatGPT. The letter argues that AI has been “locked in an out-of-control race to develop and deploy ever more powerful digital minds that nobody — not even their creators — can understand, predict, or reliably control.”

The letter assumes AI is becoming, or could turn into, “powerful digital minds” — a longtermist interpretation of AI’s development that ignores necessary debates about AI today in lieu of future concerns.

Longtermism and AI

Longtermism is the belief that artificial intelligence poses long-term or existential risks to humanity’s future by becoming an out-of-control superintelligence.

Worries about superintelligent AIs are frequently the stuff of science fiction. AI fantasies are one in every of many fears in Silicon Valley that may result in dark prophecies. But just like the Torment Nexus meme, these worries translate into major investment not caution. Most major technology firms have cut their responsible AI teams.

ChatGPT is clearly not a path to superintelligence. The open letter sees AI language technology like ChatGPT as a cognitive breakthrough — something that permits an AI to compete with humans at general tasks. But that’s just one opinion.



There are many others that see ChatGPT, its GPT-4 model and other language learning models as “stochastic parrots” that merely repeat what they learn online so that they intelligent to humans.

Superintelligence’s blind spots

Longtermism has direct policy implications that prioritize superintelligence over more pressing matter reminiscent of AI’s power imbalances. Some proponents of longtermism even consider regulation to stop superintelligence more urgent than addressing the climate emergency.

AI policy implications are immediate, not far off matters. Because GPT-4 is trained on your complete web and has expressly business ends, it raises questions on fair dealing and fair use.

We still don’t know if AI-generated texts and pictures are copyrightable in the primary place, since machines and animals cannot hold copyright.

The open letter sees AI language technology like ChatGPT as a cognitive breakthrough — something that permits an AI to compete with humans at general tasks.
(AP Photo/Michael Dwyer)

And on the subject of privacy matters, ChatGPT’s approach is difficult to differentiate from one other AI application, Clearview AI. Both AI models were trained using massive amounts of non-public information collected on the open web. Italy’s data-protection authority has just banned ChatGPT over privacy concerns.

These immediate risks are left unmentioned within the open letter, which swings between wild philosophy and technical solutions, ignoring the problems which are right in front of us.

Drowning out pragmatism

The letter follows an old dynamic that my co-author and I discover in a forthcoming peer-reviewed chapter about AI governance. There is an inclination to view AI as either an existential risk or something mundane and technical.

The tension between these two extremes is on display within the open letter. The letter begins by claiming “advanced AI could represent a profound change within the history of life on Earth” before calling for “robust public funding for technical AI safety research.” The latter suggests the social harms of AI are merely technical projects to be solved.

The deal with these two extremes crowds out necessary voices attempting to pragmatically discuss the immediate risks of AI mentioned above in addition to labour issues and more.

The attention being given to the open letter is very problematic in Canada because two other letters, written by artists and civil liberties organizations, haven’t received the identical amount of attention. These letters call for reforms and a more robust approach to AI governance to guard those being affected by it.

An unneeded distraction toward AI laws

Government responses to the open letter have stressed that Canada does have laws — the Artificial Intelligence and Data Act (AIDA). The longterm risks of AI are getting used to rush laws now like AIDA.

AIDA is a vital step toward a correct AI governance regime, nevertheless it must higher seek the advice of with those affected by AI before being implemented. It can’t be rushed to reply to perceived longterm fears.

The letter’s calls to rush AI laws might find yourself advantaging the identical few firms driving AI research today. Without time to seek the advice of, enhance public literacy and take heed to those being affected by AI, AIDA risks passing on AI’s accountability and auditing to institutions already well positioned to learn from the technology, making a marketplace for a brand new AI auditing industry.

Humanity’s fate won’t be on the road, but AI’s good governance definitely is.


This article was originally published at theconversation.com