Altdeep.ai Newsletter

Share this post
Artificial thinking, fast and slow
newsletter.altdeep.ai

Artificial thinking, fast and slow

ML luminary's AI roadmap promotes popular dichotomy from psychology

Robert Osazuwa Ness
Dec 25, 2019
Comment
Share

At his NeurIPS keynote, Yoshua Bengio (one of the Turing Award winners for research in deep learning) gave a keynote to a massive crowd. I’m in there somewhere.

In it, he lays down a roadmap for tackling consciousness. Bengio cited the “System 1 and System 2” dichotomy introduced by Daniel Kahneman in his book Thinking, Fast and Slow. System 1 refers to what current deep learning is very good at — intuitive, fast, automatic, anchored in sensory perception. System 2 meanwhile represents rational, sequential, slow, logical, conscious, and expressible with language.

Important milestones on this roadmap include more forms of compositionality and systematic generalization.  These terms generally refer to the ability to dynamically combine modeling artifacts into new artifacts in a way that provides exponential performance gains. He points to human language as an example.

Bengio believes that deep learning will be the primary driver of this transition from system 1 to system 2, mainly using attention mechanisms.

Resources

  • Full talk: From system 1 deep learning to system 2 deep learning

CommentComment
ShareShare

Create your profile

0 subscriptions will be displayed on your profile (edit)

Skip for now

Only paid subscribers can comment on this post

Already a paid subscriber? Sign in

Check your email

For your security, we need to re-authenticate you.

Click the link we sent to , or click here to sign in.

TopNewCommunity

No posts

Ready for more?

© 2022 Robert Osazuwa Ness
Privacy ∙ Terms ∙ Collection notice
Publish on Substack Get the app
Substack is the home for great writing