Altdeep.ai Newsletter

Share this post
Artificial thinking, fast and slow
newsletter.altdeep.ai

Artificial thinking, fast and slow

ML luminary's AI roadmap promotes popular dichotomy from psychology

Robert Osazuwa Ness
Dec 25, 2019
Share this post
Artificial thinking, fast and slow
newsletter.altdeep.ai

At his NeurIPS keynote, Yoshua Bengio (one of the Turing Award winners for research in deep learning) gave a keynote to a massive crowd. I’m in there somewhere.

In it, he lays down a roadmap for tackling consciousness. Bengio cited the “System 1 and System 2” dichotomy introduced by Daniel Kahneman in his book Thinking, Fast and Slow. System 1 refers to what current deep learning is very good at — intuitive, fast, automatic, anchored in sensory perception. System 2 meanwhile represents rational, sequential, slow, logical, conscious, and expressible with language.

Important milestones on this roadmap include more forms of compositionality and systematic generalization.  These terms generally refer to the ability to dynamically combine modeling artifacts into new artifacts in a way that provides exponential performance gains. He points to human language as an example.

Bengio believes that deep learning will be the primary driver of this transition from system 1 to system 2, mainly using attention mechanisms.

Resources

  • Full talk: From system 1 deep learning to system 2 deep learning

Share this post
Artificial thinking, fast and slow
newsletter.altdeep.ai
Comments
TopNewCommunity

No posts

Ready for more?

© 2023 Robert Osazuwa Ness
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing