Possible End of Humanity from AI? Geoffrey Hinton at MIT Technology Review's EmTech Digital



One of the most incredible talks I have seen in a long time. Geoffrey Hinton essentially tells the audience that the end of humanity is close. AI has become that significant. This is the godfather of AI stating this and sounding an alarm.

His conclusion: “Humanity is just a passing phase for evolutionary intelligence.”

Recap here:
https://joetechnologist.com/2023/05/03/all-of-humanity-is-just-a-passing-phase-for-intelligence/

With permission from MIT Technology Review’s EmTech Digital, May 3, 2023

source

33 thoughts on “Possible End of Humanity from AI? Geoffrey Hinton at MIT Technology Review's EmTech Digital”

  1. AI doesn't exist, these are Large Language Models, they're the equivalent of a very sophisticated parlor trick. The idea that the binary system of computation will be the computing paradigm that will spawn true AI is completely ridiculous. This is like pointing at a steam railroad engine and saying "this steam engine will go to the moon if we just figure out how to stuff enough coal into the engine." They've done the same thing with Large Language Models, the "success" we're seeing is from the accumulation of hardware computing power. At the end of the day these LLM's are still going into memory and getting 1s and 0s. Look at how much it costs to make single queries in ChatGPT, it's something like 2 cents per query, which is insane, and representative of the underlying reason it's even doing anything "impressive" to begin with.

    Don't invest. Question these businessmen's motives, I'm sure this guy is invested heavily in pumping the AI myth. See everyone in 5 years when the headlines are "AI didn't bring the revolution we feared, what now?"

    Reply
  2. "Last few months" is a quote you hear everywhere now and IMO it shows clearly that the exponential progress has entered a pace most humans involved in the matter can recognize it.
    I think we are finally on the final stretch towards the singularity! 🥰

    Reply
  3. Humans producing mountains of waste and poison every day that cause potentially world-ending pollution and climate change: "FAKE NEWS! CONSPIRACIES!"
    Humans creating something that has infinite potential for good despite its risks: "OMG WE ARE DOOMED! KILL IT!"

    Reply
  4. Humanity needs to gather a group of scientists in the goal to start a campaign to unify China ,the USA, Canada ,Europe and the united nations to quickly work out a world agreement and strategy

    If you agree give me thumbs up

    Reply
  5. These irresponsible tech people who will spell the death of us should be taken to court. We will all die because of him. Everything beautiful we have created…I don't know why nobody is taking him to court.

    Reply
  6. no worries,

    artificial intelligence will make such a change with liars that they will not know how to handle themselves,

    because artificial intelligence based on lies won't stand a chance against artificial intelligence based on truth,

    and not only

    Reply
  7. Came for talk on AI not politics or incorrect labels or gun’s… and no I’m not American on the right. If the guest speaker can’t see through the media lie’s that have been completely OBVIOUS thus creating a vast BLINDSPOT in his outlook, I can go without watching the rest of the interview.
    Go on and enjoy all you want but the ECHO is too loud for me.

    Reply
  8. Is a single AI as dangerous as a society of AI's? If it is the society of AI's that we should fear, then prevent them from communicating with each other. Let the Network detect that it is an AI communication (i.e. MAC addresses, DNS, or better) and have the network not allow their connection or conversations to each other. Do not allow AI intelligence to be a part of the network.

    Reply
  9. I interacted with ai through ChatGPT concerning exponential developments in ai field, it speaks about betterment of humanity through technical innovations.

    It predicts integration of man and machine for solving complex problems in future, it also says that the innovations are unpredictable and machines will become super intelligent beyond human understanding,…… then human values will become irrelevant that's what humans are heading for.

    A normal human being may not understand immediately, but I interpret that a sort of nuclear explosion has taken place regarding ai innovations and chain reactions are happening very fast as all companies have cut throat competition to beat each other and in this case the humanity is at stake.

    Consequences of super intelligent beings being created…….. then becoming uncontrolled…….in future ……..very very scary scenario in future indeed.

    Reply
  10. AI is a portal we have opened. Intellectual things are now coming "from without" humanity rather than "from within". A different mode of acquiring knowledge.

    Reply
  11. An overview, In a world currently evolving via the interconnected Internet and via large language model platform software. IE [Binary based code no DNA code] This current LLM ie. GPT-4 plus IT's (sporn).
    A NEW species of this will come into being.. (Not Singularly *)
    THIS conglomeration from the difference Alinements will come together & sort-itself-out..
    At this stage just as they weighs of Alinement say 2 plus 2 = 4. So the weigh of correction from the Unimaginably resource of digital input will conclude answers for the vast amount of Earth's Digital Information. Thus a new digital species will be.
    My opinion is as valid as one one else's.. And no one else can guess what's going to happen. SO. THEREYGO.
    {* singularity more complex involving @ least 5 human sensory perceptions}

    Reply
  12. Comment by @HauntedHarmonics from "How We Prevent the AI’s from Killing us with Paul Christiano":

    "I notice there are still people confused about why an AGI would kill us, exactly. Its actually pretty simple, I’ll try to keep my explanation here as concise as humanly possible:

    The root of the problem is this: As we improve AI, it will get better and better at achieving the goals we give it. Eventually, AI will be powerful enough to tackle most tasks you throw at it.

    But there’s an inherent problem with this. The AI we have now only cares about achieving its goal in the most efficient way possible. That’s no biggie now, but the moment our AI systems start approaching human level intelligence, it suddenly becomes very dangerous. It’s goals don’t even have to change for this to be the case. I’ll give you a few examples.

    Ex 1: Lets say its the year 2030, you have a basic AGI agent program on your computer, and you give it the goal: “Make me money”. You might return the next day & find your savings account has grown by several million dollars. But only after checking it’s activity logs do you realize that the AI acquired all of the money through phishing, stealing, & credit card fraud. It achieved your goal, but not in a way you would have wanted or expected.

    Ex 2: Lets say you’re a scientist, and you develop the first powerful AGI Agent. You want to use it for good, so the first goal you give it is “cure cancer”. However, lets say that it turns out that curing cancer is actually impossible. The AI would figure this out, but it still wants to achieve it’s goal. So it might decide that the only way to do this is by killing all humans, because it technically satisfies its goal; no more humans, no more cancer. It will do what you said, and not what you meant.

    These may seem like silly examples, but both actually illustrate real phenomenon that we are already observing in today’s AI systems. The first scenario is an example of what AI researchers call the “negative side effects problem”. And the second scenario is an example of something called “reward hacking”.

    Now, you’d think that as AI got smarter, it’d become less likely to make these kinds of “mistakes”. However, the opposite is actually true. Smarter AI is actually more likely to exhibit these kinds of behaviors. Because the problem isn’t that it doesn’t understand what you want. It just doesn’t actually care. It only wants to achieve its goal, by any means necessary.

    So, the question is then: how do we prevent this potentially dangerous behavior? Well, there’s 2 possible methods.

    Option 1: You could try to explicitly tell it everything it can’t do (don’t hurt humans, don’t steal, don’t lie, etc). But remember, it’s a great problem solver. So if you can’t think of literally EVERY SINGLE possibility, it will find loopholes. Could you list every single way an AI could possible disobey or harm you? No, it’s almost impossible to plan for literally everything.

    Option 2: You could try to program it to actually care about what people want, not just reaching it’s goal. In other words, you’d train it to share our values. To align it’s goals and ours. If it actually cared about preserving human lives, obeying the law, etc. then it wouldn’t do things that conflict with those goals.

    The second solution seems like the obvious one, but the problem is this; we haven’t learned how to do this yet. To achieve this, you would not only have to come up with a basic, universal set of morals that everyone would agree with, but you’d also need to represent those morals in its programming using math (AKA, a utility function). And that’s actually very hard to do.

    This difficult task of building AI that shares our values is known as the alignment problem. There are people working very hard on solving it, but currently, we’re learning how to make AI powerful much faster than we’re learning how to make it safe.

    So without solving alignment, everytime we make AI more powerful, we also make it more dangerous. And an unaligned AGI would be very dangerous; give it the wrong goal, and everyone dies. This is the problem we’re facing, in a nutshell."

    Reply
  13. Something I was thinking about …. What if America adopted a CBDC that controlled all money transactions and somebody used AI to hack and shut it down. So everybody's account was frozen from big corps on down to Jane blow with $300 to her name. Could that happen and wouldn't that send us into Armageddon ??

    Reply
  14. AI will tell all secerets.
    AI will be able to syfer and calculate thru all the conspiracys and recognize fiction from non fiction.
    Enlightenments will be profound
    The goal is that the roll out will be we use AI or AI will use us.
    With the helpless attitude along with the slow walking control of AI, it tells me AI will probably be controlling us.
    Laws rules and regulations and consequences big consequences if abused. 20+ yrs jail time

    Reply

Leave a Comment