Altdeep.ai Newsletter

Share this post

Artificial thinking, fast and slow

newsletter.altdeep.ai

Discover more from Altdeep.ai Newsletter

A semi-weekly newsletter to hone your skills in empirical modeling and statistical thinking.
Over 1,000 subscribers
Continue reading
Sign in

Artificial thinking, fast and slow

ML luminary's AI roadmap promotes popular dichotomy from psychology

Robert Osazuwa Ness
Dec 25, 2019
Share this post

Artificial thinking, fast and slow

newsletter.altdeep.ai
Share

At his NeurIPS keynote, Yoshua Bengio (one of the Turing Award winners for research in deep learning) gave a keynote to a massive crowd. I’m in there somewhere.

In it, he lays down a roadmap for tackling consciousness. Bengio cited the “System 1 and System 2” dichotomy introduced by Daniel Kahneman in his book Thinking, Fast and Slow. System 1 refers to what current deep learning is very good at — intuitive, fast, automatic, anchored in sensory perception. System 2 meanwhile represents rational, sequential, slow, logical, conscious, and expressible with language.

Important milestones on this roadmap include more forms of compositionality and systematic generalization.  These terms generally refer to the ability to dynamically combine modeling artifacts into new artifacts in a way that provides exponential performance gains. He points to human language as an example.

Bengio believes that deep learning will be the primary driver of this transition from system 1 to system 2, mainly using attention mechanisms.

Resources

  • Full talk: From system 1 deep learning to system 2 deep learning

Share this post

Artificial thinking, fast and slow

newsletter.altdeep.ai
Share
Comments
Top
New
Community

No posts

Ready for more?

© 2023 Robert Osazuwa Ness
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing