Full Interview starts at (00:05:01)
Please Donate Here To Help Promote For Humanity
https://www.paypal.com/paypalme/forhumanitypodcast
In episode 30, John Sherman interviews Professor Olle Häggström on a wide range of AI risk topics. At the top of the list is the super-instability and the super-exodus from OpenAI’s super alignment team following the resignations of Jan Lieke and Ilya Sutskyver.
Olle HäggströmOlle Häggström
This podcast is not journalism. But it’s not opinion either. This is a long form public service announcement. This show simply strings together the existing facts and underscores the unthinkable probable outcome, the end of all life on earth.
For Humanity: An AI Safety Podcast, is the accessible AI Safety Podcast for all humans, no tech background required. Our show focuses solely on the threat of human extinction from AI.
Peabody Award-winning former journalist John Sherman explores the shocking worst-case scenario of artificial intelligence: human extinction. The makers of AI openly admit it their work could kill all humans, in as soon as 2 years. This podcast is solely about the threat of human extinction from AGI. We’ll meet the heroes and villains, explore the issues and ideas, and what you can do to help save humanity.
Timestamps
1. **(00:00:00)** AI Safety Competence and Alignment Team Necessity at OpenAI
2. **(00:02:56)** New Podcast Title and Music Unveiled
3. **(00:03:56)** Host Acknowledges Positive Feedback from Professor Hagstrom
4. **(00:05:05)** Host Excited by Professor Hagstrom’s Show Familiarity
5. **(00:06:44)** Key Departures and Developments at OpenAI
6. **(00:12:54)** Public Awareness Trajectory of AI Safety
7. **(00:14:17)** Super Alignment and AI Safety Research Funding
8. **(00:26:27)** Sam Altman’s Character Post-Scarlett Johansson Incident
9. **(00:28:11)** Recalling Sam Altman’s Candor on AI Risks
10. **(00:28:50)** The Corrupting Influence of Commercial Incentives on Individuals
11. **(00:30:13)** The Need for Oversight to Prevent Corruption
12. **(00:31:03)** Government Intervention in AI Development Urged
13. **(00:32:54)** US Leadership in AI Safety and Regulation
14. **(00:35:58)** Evaluating the Impact of AI Regulation
15. **(00:36:19)** Concerns Over Political Understanding of AI Risks
RESOURCES:
JOIN THE FIGHT, help Pause AI!!!!
Pause AI
Join the Pause AI Weekly Discord Thursdays at 2pm EST
/ discord
https://discord.com/invite/pVMWjddaW7
22 Word Statement from Center for AI Safety
Statement on AI Risk | CAIS
https://www.safe.ai/work/statement-on-ai-risk
Best Account on Twitter: AI Notkilleveryoneism Memes
https://twitter.com/AISafetyMemes
source
After what the democratically elected government did with the last big thing (medical) I doubt things would be better if they get involved. Probably worse in fact. They are too corrupt .
I think what people are most scared of is that the truth will finally be revealed in relation to a lot of miseducation and misinformation whitewashing and propaganda that was put forth to keep a certain group of individuals above others
celebrities getting upset that ai did work that they turned down. that concept generalizes in favor of ai pretty quickly. what if they had hired a real human that sounded even more like scarjo, would there be the same issue? 🤔
there is no “right person” to be ceo of a multi-billion dollar for-profit company. if that person is choosing the future of humanity over return on investment for investors/shareholders, they will be replaced by someone else who is not. the scenario is the problem, not the individual humans in their roles.
He gave words to my greatest hope: that there might be some principle of universal morality. I believe humanity has morality mostly figured out. We just have to live up to it
unfortunately, the only way to know that something is outsmarting you is to realize it in hindsight, when it becomes obvious that you’ve already lost.
Never liked Sam Altman since the start. There's always something sus about him.
He seems too soft spoken for my liking. It's always the quiet ones that you should be worried about.
Dollars signs in their eyes – there's no hope for 'open'AI – it's lost. The best we can hope for is someone demonstrating the dangers of AI before they get too far.
This all reminds me of Y2k. So preposterous. It also reminds me that people need to go outside and touch grass. Sure one day the sun will become red giant and AI may become a bond supervillain, but for the foreseeble future we have so many more things to worry about.
Okay, here we go!
Our vision in hindsight is incredible, paired with a remarkable skill for messing things up.
If you're relying on government(s), especially the U.S. government, to be the arbiter(s) of AI safety, you have already failed…. We are all already dead…..
In order to move towards a safer AI development schedule, I think the AI companies need to be directly responsible for all unexpected consequences and every claim in this respect should be 100% public and transparent – regardless of outcome. Furthermore every prompt and response should be scrutinized by a separate AI for adherence to acceptability rules coupled with a three strikes policy for rate limiting an account.
In AI, there are generally programmers and mathematicians. Programmers understand that if something can go wrong, it always does and that software must handle all edge cases.
Mathematicians understand that AI has limitations and that those limitations do not currently pose a significant risk.
Everyone understands we are on a trajectory toward more powerful AI.
In a Venn diagram, those within the intersection are generally those who are sounding the alarm. Just as the mathematicians have a higher net understanding of math than the programmers , the programmers have a higher net understanding of software than the mathematicians.
To solve alignment we need to fundamentally understand each point of view, without dismissing any knowledge from either.
Mathematicians: prove AI cannot be used catastrophically.
Programmers: prove AI can be used catastrophically.
Greed is driving our own demise unfortunately. It has to be a global solution as no one country will give the other an advantage to catch up or surpass them.
The US government or EU can NOT save us. They are BOTH completely corrupt organizations.
To the point of being EVIL.
The most frightening thing for me is that the board at Open for whatever reasons fire SA and the culture at the company rebelled and forced the board to resign. Is it because they saw their stock options lose value after he was fired?
Sadly Sam Altman has turned into Elon Musk. When people call me a doomer, I just say "yup, 100 years ago doomers said the Titanic needed more lifeboats and should watch out for icebergs. The builders of the Titanic disagreed."
At 1:26:56 — Timnit Gebru, fired from Google in December 2020?