A CS Professor on Why Slow Learning Wins in the AI Era | CU Boulder, Tom Yeh
Tom Yeh, Associate Professor of Computer Science at the University of Colorado Boulder & creator of AI by Hand, breaks down why he teaches AI by hand at huma...
Watch on YouTube →Transcript
Intro
- 00:00My name is Tom Yed. I'm a professor of
- 00:02computer science at the University of
- 00:05Colorado in Boulder. I'm also a founder
- 00:07of AI by hand is a global education
- 00:10initiative to make AI inside the black
- 00:12box accessible and approachable. Writing
- 00:15out all the maths with hand in doing so
- 00:17understanding that AI is not a big
- 00:20mystery [music] is something we all can
- 00:21understand. What is the purpose of
- 00:23learning? Having the answer doesn't mean
- 00:25you know it. People can buy degree by
- 00:27certificate. Do you have ownership of
- 00:29this particular idea core and
- 00:32foundational that doesn't change is
- 00:34evergreen? AI cannot change people but
- 00:37you can change AI.
Why I Teach AI by Hand- The Power of Learning "Slow"
- 00:48A transformer is to me to process
- 00:52individual words in your sentence. And I
- 00:54can started with say well at the token
- 00:57number four in my sentence and then just
- 00:59then this is a boxes I draw to show that
- 01:01well each token actually has multiple
- 01:04number in this case simple case that
- 01:05says three numbers. Unfortunately while
- 01:08I was a student I missed deep learning
- 01:11entirely. I was a bit too old. So I
- 01:14studied support vector machines
- 01:15traditional [music] machine learning
- 01:17method. So when then I became a
- 01:18professor all of a sudden all these
- 01:20people are doing deep learning. I have
- 01:22to learn deep learning all over again.
- 01:24So what I'm doing today with AI by hand
- 01:27is to share my learning journey. How I
- 01:29as a old professor trying to learn deep
- 01:31learning from scratch.
- 01:34All the things I'm sharing has been
- 01:37about to show my own struggle with
- 01:39understanding AI model math and
- 01:41algorithms. Only way I can get it is I
- 01:43[music] get to draw or write on the
- 01:46paper. This is what oh I actually get
- 01:47it. So when I share my drawing, shared
- 01:50my way to map out the math and a lot of
- 01:53people resonated and people started to
- 01:55comment out, hey, I really like your
- 01:56approach to breaking down by hand. I
- 01:59started, hey, maybe I just call it AI by
- 02:01hand. There's a reason that people
- 02:03resonate with this. Connect with this
- 02:06thing that I'm doing by hand.
- 02:09Why do we like to calculate this by hand
- 02:13when AI can do this very well? when I
- 02:16was teaching introduction to programming
- 02:19and I have a feedback like I going too
- 02:21fast. I'm going to s slides and so on
- 02:24and just [music] too fast because I
- 02:26really like to share a lot of my
- 02:27teaching and knowledge with my students.
- 02:30So I decided to teach the entire
- 02:32semester of C++ programming on the
- 02:34blackboard instead of doing live coding.
- 02:36So I decided to do that. So I have a
- 02:38whole semester of doing writing the I
- 02:41this my notes about I wrote it down on
- 02:44the piece of paper as a semester
- 02:46progressing I see a few benefits. One is
- 02:48that I can only go at the humanly
- 02:51possible speed of my writing. I cannot
- 02:53go any faster they can write. Second
- 02:56student can only learn at a humanly
- 02:59possible speed. They can only follow how
- 03:01much I write. And number three is that
- 03:03if I get my student to use their hand to
- 03:06copy my notes on a notebook, their hands
- 03:08are not on their keyboard checking their
- 03:10Instagram messages. So help with focus
- 03:13as well. The by hand is really about a
- 03:15way to connect back to our humans. So
- 03:18using your hand, you can go at a human
- 03:20speed. You commute in a human way. And
- 03:23over time I learned this. I started to
- 03:25see this values of going back to the old
- 03:28school by hand.
- 03:31What is the purpose of learning? Is it
- 03:33about that physical or digital artifact
- 03:36that prove they have learning or
- 03:38something you feel like you actually
- 03:40internalize you actually own this kind
- 03:42of [music] stuff? Do you have ownership
- 03:43of this particular idea? Well, AI give
- 03:45me an answer right away. Having the
- 03:47answer doesn't mean you know it people
- 03:49can buy degree by certificate. Whether
- 03:52you or not you own something, you value
- 03:54something is actually proportional to
- 03:56how much [music] time you spend um
- 03:58acquiring that piece of knowledge. You
- 04:00have to first define what learning
- 04:02actually means to you.
The Foundation That Doesn't Burn
- 04:08I remember when I was a undergrad, we're
- 04:10learning linear algebra as part of a
- 04:13requirement for getting a CS degree. We
- 04:15have learned linear algebra and we have
- 04:17learned max computation. I have no idea
- 04:19why it is even important. But then it
- 04:22turns out over time computer graphics
- 04:24became really popular because of
- 04:26Jurassic Park. They put this CGI up the
- 04:29front and people talk about hey
- 04:30everybody need to learn CGI and CGI uses
- 04:34a lot of matching application and then
- 04:36after a few years there was big data
- 04:38movement then it turns out you also need
- 04:40maximum application to do some sort of
- 04:43processing and then move to machine
- 04:44learning again forget about data science
- 04:47we should be machine learning specialist
- 04:48engineer again maximum application and
- 04:51today's AP is AI AI everybody need to be
- 04:54AI native we should raise our kids send
- 04:56into AI
- 04:57[music]
- 04:57M application in few years we all all we
- 05:00talk about is quantum computing is
- 05:02possible right and guess what m
- 05:04application again so you see this a
- 05:06trend that every time there's something
- 05:07that tool keep changing but it's always
- 05:10something that's core and foundational
- 05:12that doesn't change it's evergreen you
- 05:14could revisit a year from now two years
- 05:17from now it's still relevant people
- 05:18still care a lot about whereas the
- 05:20deepseek there was popular at the time
- 05:22but there's been a while now so deepse
- 05:24not as popular as before there's a new
- 05:26new thing for instance like this cloud
- 05:28super popular but let's see in two two
- 05:30months is it still popular we don't know
- 05:32but I'm pretty confident transformer
- 05:34topic is still going to be popular
- 05:37couple summers ago I had a opportunity
- 05:39to visit uh South Korea and I got to
- 05:42visit where everybody else will go the
- 05:45what's called Kukong there this palace
- 05:47that's that was just a view of the
- 05:49history very beautiful palace and then
- 05:51what just struck me when I learned about
- 05:53a bit more history the entire thing was
- 05:56burned down in like a 1500s except for
- 06:00the foundation that was made in Saudi
- 06:03rock. So in 1800s they rebuilt the
- 06:06entire palace based off the same
- 06:08foundation. Like to talk about this
- 06:10story because that reminds me of how
- 06:13this technology has been changing over
- 06:15and over again. But if you had a
- 06:18foundation on the maximum application,
- 06:20you could just apply it to AI. It
- 06:22doesn't really matter. We build your
- 06:23skill based on your solid foundation.
- 06:25[music] And so that's why I'm focusing
- 06:27on foundation because I believe there
- 06:29something you can rebuild. Doesn't
- 06:31really matter whether the new tools is
- 06:33obsolete. If you keep focus on the
- 06:35surface features, [music] the tools then
- 06:38forget about foundation. You just have
- 06:40to keep rebuilding your houses. You
- 06:42still never have your foundation up or
- 06:44can build a pump. So how can it apply to
- 06:47your own situation? Think about the way
- 06:49you grew up. Maybe your parents sent you
- 06:51to a soccer game or maybe the piano and
- 06:54you have something some skill you have
- 06:57become good at. Is it piano? Is it
- 07:00chess? And think about the way you
- 07:01acquire the skill and that is actually
- 07:05something that doesn't change. So as AI
- 07:08tool come every day the fact that you
- 07:10could acquire very difficult skill that
- 07:12is something that part of your identity
- 07:14that doesn't change. If you continue to
- 07:16focus [music] on that and you have
- 07:17ability to realize, hey, I could acquire
- 07:20this, I can learn this skill, I can
- 07:21become really good at it. That's when
- 07:23you could continue to apply that skill
- 07:25to a new AI tool. So, I'm a good
- 07:28example. I was falling behind on deep
- 07:30learning for quite a while. But I have
- 07:32learned skills really trying to break
- 07:35down difficult [music] topics by
- 07:37patiently writing everything down on
- 07:39paper. So that skill I able to
- 07:41eventually catch up. I caught up on deep
- 07:44learning by from a position that's way
- 07:46behind from people who actually been
- 07:49working on deep learning for a long
- 07:50time. So for you your piano skill, your
- 07:53soccer skill is not useless. That will
- 07:55be a skill to help you eventually once
- 07:57we figure out all this like crazy stuff
- 07:59and this one tool. You just skip this
- 08:02tool. I think it's absolutely fine. Who
- 08:05knows what are you going to next? But if
- 08:07you skip your next piano practice, you
- 08:08skip your next soccer practice [music]
- 08:10and you give up on that, that's not fine
- 08:13because that is going to be eventually a
- 08:15long run define who you are. But not
- 08:17this tool, not just one tool.
- 08:20At this moment in my career as a
- 08:22educator, I started to care more about
- 08:24not that they learned this math. A lot
- 08:26of times when I teach, oh, you showed
- 08:28up, you listen to me, you're trying to
- 08:29go through it, but I bet maybe a year
- 08:31from now, you don't remember anything.
- 08:33But what you can remember is more about
- 08:36you are able to understand this at the
- 08:38moment. You are willing to come here to
- 08:40understand foundation. You are willing
- 08:41to open up the black box. That
- 08:43willingness is what set you apart from
- 08:45others. [music] Others would never try,
- 08:47never attempted, never took out a
- 08:49challenge. That's why differentiate.
- 08:51It's not really about how much you
- 08:52remember the equation about [music]
- 08:54transformer about attention mechanism.
- 08:56It's really about there was once upon a
- 08:59time I try hard to memorize this. I stay
- 09:02in the library for hours of study. I was
- 09:05successful. So next time when there's a
- 09:07learning challenge I can learn this. So
- 09:09that is more important about what
- 09:11differentiate that people who know
- 09:13foundation they implies the process time
- 09:16the person invested in learning it. So
- 09:18that is what I value versus person who
- 09:20never really learn foundation implies
- 09:22the lack of effort the lack of
- 09:24willingness to invest in time and effort
- 09:26to take on a challenging learning task.
The 'AI-Native' Trap - AI can't change people, but people can change AI
- 09:32When I was teaching the intro to
- 09:34programming, you would really spend a
- 09:36lot of effort making new assignments a
- 09:38whole every semester because of check
- 09:41places that people share solutions and
- 09:43we have all these technical solutions.
- 09:46We're trying to check the IP addresses
- 09:48see whether people are accessing this
- 09:50and we even put some kind of a trap on
- 09:53the site. if somebody access that. We
- 09:56know they access this but at the time I
- 09:58was like okay well I hope Czech could
- 10:01get out of business maybe shut down by
- 10:04the government that they will help us
- 10:06educators and my dream came true because
- 10:09AI become a new treating tool and the
- 10:12check out the business [music] and then
- 10:13when I realized hey check was all the
- 10:15business my dream came true but problem
- 10:17is still there what's going on so it
- 10:19reminds me again we should keep thinking
- 10:22going back to the source there was the
- 10:24reason why people have to cheat at the
- 10:27first place. That is the main cause.
- 10:30It's not and check and AI just a
- 10:32symptoms. [music] So check is gone,
- 10:34people still cheat. I bet when AI is
- 10:36gone, people can still find way to
- 10:38cheat. Is this AI cheating that distract
- 10:40us from the bigger fundamental profit of
- 10:45the society's incentive system? Why
- 10:47[music] are student compelled to cheat?
- 10:50Why is it that this the system doesn't
- 10:52encourage real learning that has
- 10:54actually have spent time So when you
- 10:57hire somebody, what do I care about? Is
- 10:59does student have a good work ethics?
- 11:01What I care about? Is a student a good
- 11:03problem solver? Is this the person a
- 11:05team player that can actually
- 11:06communicate willing to work with others?
- 11:08[music] So when you hire somebody, we go
- 11:12back to those basic. That's what you
- 11:13actually care about. You want to keep
- 11:14those people as employees. And this AI
- 11:17thing is just going to be a byproduct of
- 11:20this. Think about it. When we hire
- 11:22someone because there's a problem solver
- 11:24in [music] order to solve problem that
- 11:26person is automatically just going to
- 11:28learn AI you don't have to tell them the
- 11:30reason why you had to force your AI
- 11:32native you had to go back maybe you
- 11:33didn't hire the right person you forgot
- 11:36to emphasize on person being a problem
- 11:39solver again similarly if you are hiring
- 11:42this person because this person team
- 11:43player because [music] the person is
- 11:45team player the person will learn how to
- 11:47use AI to facilitate team collaboration
- 11:49so you don't even have to tell the the
- 11:51person will automatically do that as
- 11:53well. Trust your instinct. [music]
- 11:54Continue to hire people like that
- 11:56because those people would automatically
- 11:58adopt AI. You're not a team player. AI
- 12:00not going to make you a team [music]
- 12:01player. You always look up your own
- 12:02interest. You do not respect others. AI
- 12:05not going to fix that. How can AI fix
- 12:07that? AI cannot change
- 12:10people only you. You [music] but you can
- 12:13change AI.