Fix your AI-limited mindset in 12 mins | Caltech, Anima Anandkumar
Caltech's Professor Anima Anandkumar states, "A lot of these AI tools are getting better, but you still need to provide AI what to do." So how can we discove...
Watch on YouTube →Transcript
Intro
- 00:00A lot of these AI tools are getting
- 00:01better, but that only means they can do
- 00:04a certain set of instructions which are
- 00:06seen in data. You still need to provide
- 00:09AI what to do, right? You still need to
- 00:12be able to describe it. And that ability
- 00:15to describe what are the tasks AI should
- 00:17do, what are the programs to be written
- 00:19is still important. I think one job that
- 00:22will not be replaced by AI is the
- 00:25ability to be curious and go after hard
- 00:28problems. So for young people, my advice
- 00:30is not to be afraid of AI or worry what
- 00:34skills to learn that AI may replace them
- 00:37with, but really be in that path of
- 00:40curiosity. I'm an animant Kumar. I'm
- 00:43brand professor at Caltech. I've been a
- 00:45professor at Caltech for about 8 years
- 00:47now and during that time I also had
- 00:50stints in industry. I was principal
- 00:52scientist at Amazon Web Services. So at
- 00:55Caltech, I lead the AI and science lab,
- 00:58which means uh working on some of the
- 01:01hardest challenges we see in science and
- 01:03engineering and how we can not only use
- 01:07existing AI methods to solve them, but
- 01:09really develop new ones.
- 01:12[Music]
- 01:20I think one job that will not be
- 01:22replaced by AI is the ability to be
Start Where You Are Curious
- 01:25curious and go after hard problems. For
- 01:28a lot of students, there is a strong
- 01:30motivation to just conform and go ahead.
- 01:33Right? The number one thing I would ask
- 01:36is to question everything. Think
- 01:38critically. I always begin the classes
- 01:40by asking questions, not writing down
- 01:42math equations, right? Not going into
- 01:44the details but just intuitively based
- 01:47on everything that you've seen you've
- 01:49done what do you think I asked them
- 01:52simple cases for instance if you were to
- 01:54design for a fire alarm when should it
- 01:57say that there is fire or not that's
- 01:59something you can change right you can
- 02:01put a threshold you know what level of
- 02:03smoke or when does it think it's smoky
- 02:05and that's a very practical question so
- 02:08if you just had fire alarms every day
- 02:10we'd be just out and it would be useless
- 02:13we would not have a functional office
- 02:14space. But on the other hand, if we
- 02:17never set fire, that would be bad, too.
- 02:19So, how to balance this and how to model
- 02:22how noisy this sensor could be. And
- 02:25sometimes I see with students who may
- 02:27not have the mathematical training, but
- 02:29they're very intuitive and practical.
- 02:31They may be like, oh, I would go and
- 02:32measure how noisy it is, or I would show
- 02:34different levels of smoke, have like
- 02:36candles of different sizes and go and
- 02:39test it. that and you know many times
- 02:41people already maybe somewhat aware of
- 02:43this so they have some intuitive ideas
- 02:45so that already is a good starting point
- 02:47and sometimes they are maybe really
- 02:49wrong they have an intuition but that's
- 02:51a wrong intuition which is still okay
- 02:53because intuitions are not always the
- 02:56only answer right so I think a lot of it
- 02:58comes by asking questions and now you
- 03:01can use these AI tools to get answers
- 03:04very quickly and also verify them a lot
- 03:06of it comes from being just like curious
- 03:09or interested and that could be one
- 03:11specific topic and if somebody's
- 03:13interested in music they can delve
- 03:15deeper into that if somebody is
- 03:16interested in art so it just has to that
- 03:19spark has to come from within and I
- 03:21think giving students more the freedom
- 03:24to pursue where they are passionate
- 03:26where they have a spark I think is going
- 03:29to be the future and that's the right
- 03:31thing rather than forcing everybody to
- 03:33learn
- 03:35everything I'm always motivated by the
How I Started Where I Was Curious
- 03:38hardest challenge challenges. You know,
- 03:39I want to know what is difficult, but
- 03:41also why it's difficult, right? And even
- 03:44though I may not be able to solve it
- 03:45today, how do we build up the
- 03:47foundations to get there? Growing up in
- 03:50my sore as a kid, I loved just solving
- 03:54math problems, you know, going to my
- 03:56parents' factory. I was reading up their
- 03:59program manuals. I was, you know,
- 04:01learning how they could be programmed.
- 04:03And unlike in other computer programs
- 04:05here if something was wrong that would
- 04:08lead to like physical failure parts
- 04:10being like not manufactured correctly
- 04:13and I'm like oh but how does it go into
- 04:14the computer and how does the computer
- 04:16tell the machine what to do so there
- 04:18were always gaps because as a kid you
- 04:21don't know everything but to me it was
- 04:23like observing and then understanding
- 04:26what the gap is and even if I didn't get
- 04:28an immediate answer I would remember
- 04:30that there is a gap and then later when
- 04:32I was introduce use those topics. I was
- 04:34in my mind I was like, "Oh, that's what
- 04:36it relates to." So somehow I had built
- 04:39up that mental map and I had put places
- 04:42of where things I knew and things I
- 04:44didn't know and I kept kind of growing
- 04:47that in my mind as I progressed through
- 04:50the years. So when I was growing up, AI
Developing the AI That Changes the Real World
- 04:53was considered science fiction.
- 04:55Naturally, there were lots of science
- 04:57fiction movies where I saw and was
- 05:00fascinated. But that's not something
- 05:02people thought were practical. Uh since
- 05:04I was in middle and high school and now
- 05:07it's almost 30 years, right? It is a
- 05:10long time, but the amount of progress
- 05:12that has happened is also so astounding
- 05:15in so many ways. So since I joined
- 05:17Caltech in 2017, the timing just felt
- 05:20right to use AI as a tool and a
- 05:23framework to solve some of the hardest
- 05:26problems which until that point was not
- 05:28considered practical. So after I joined
- 05:31Caltech and wanted to explore problems
- 05:34at the intersection of AI and science
- 05:36and I was talking to everybody on
- 05:37campus, I was like okay do you need
- 05:40compute? What do you need it for? Let me
- 05:42understand the problems that you're
- 05:44tackling. And you know I can't possibly
- 05:46go and solve each one of them problems
- 05:48myself. Right? My question then was are
- 05:51there general tools we can develop that
- 05:53could impact so many different areas?
- 05:55And that again put me back to
- 05:57mathematical foundations. So because a
- 06:00lot of these different real world
- 06:01phenomena are modeled by partial
- 06:03differential equations. So now can we
- 06:05design AI that can solve this and do it
- 06:08much faster do it much better than what
- 06:11is currently being done with traditional
- 06:13simulations. And to do that we developed
- 06:16neural operators. We've invented an AI
- 06:19technology called neural operators that
- 06:21is trained to understand physical
- 06:24behaviors not just highle reasoning with
- 06:27text. So think of a hurricane. The
- 06:29hurricane if you will just eyeball it,
- 06:32can you tell where it's going to go? You
- 06:34know, most humans cannot, right? It's a
- 06:36superhuman skill to predict where
- 06:39hurricanes are going to go. And for to
- 06:42do that, we need finecale information
- 06:44and finecale modeling. So this cannot be
- 06:46just a core scale image like the image
- 06:49of a cat where even if it's gets blurry,
- 06:52you know it's a cat. The same techniques
- 06:54don't work for phenomena like
- 06:56hurricanes. Once we developed tools and
- 06:58then the next natural question is what
- 07:01were practical use cases that involved
- 07:03and the weather models was a natural one
- 07:06because it's widely used. It has huge
- 07:09implications on our lives especially if
- 07:11extreme weather events like hurricanes
- 07:13if we get them right that has the
- 07:15potential to save human lives and also
- 07:18bring down economic costs. So I was
- 07:20motivated by how it can be helpful to
- 07:22people, but I was also motivated by that
- 07:26being considered a very hard technical
- 07:28challenge. In fact, just a few months
- 07:30before we released our model, there were
- 07:32a group of very wellrespected weather
- 07:35scientists who published in the Royal
- 07:37Society Journal thinking they're they
- 07:39were under the impression that AI would
- 07:42take more than a decade or even longer
- 07:44to replace traditional ways to forecast
- 07:47weather. and they felt AI was just not
- 07:49ready. This problem is way too
- 07:51difficult. And we released this and it
- 07:53just took everybody by surprise. It was
- 07:55not only accurate, it was tens of
- 07:58thousands of times faster. So what would
- 08:00take a big supercomput for traditional
- 08:03weather models can now be run on a local
- 08:06gaming PC with just a consumer GPU. So
- 08:09that's the beauty of uh machine learning
- 08:12as a field. We are not always stopped by
- 08:16what others think as difficult. As long
- 08:18as we can get the data and we can design
- 08:21the methods, we can just go and try
- 08:23it. So my mission is to constantly be
Can AI Replace Scientists?
- 08:26curious and learning and not assume that
- 08:31any problem is easy. I can't imagine a
- 08:33world where scientists will be out of
- 08:35jobs because the definition of a
- 08:37scientist is somebody who tackles open
- 08:40problems, right? So there are harder and
- 08:43harder problems to tackle. You know, if
- 08:45you want to look at the deep secrets of
- 08:48our universe, go down to the smallest
- 08:50scale and understand at the atomic and
- 08:53subatomic level how matter is
- 08:56constructed to of course level of galaxy
- 08:59and beyond and understand how the
- 09:00universe is put together. There are
- 09:03still lots of open challenges. Many
- 09:06other teams such as Google Deepine focus
- 09:08on what is known as an AI scientist.
- 09:11Meaning AI that comes up with new ideas.
- 09:14But so much of scientific progress is
- 09:16not limited by the lack of new ideas,
- 09:19right? Lots of people have lots of
- 09:21ideas. But the bottleneck is going to
- 09:24the lab or going to the real world and
- 09:26testing them. That is slow. That is
- 09:28expensive. So my focus is how we can
- 09:31replace those lab experiments. Can we
- 09:34come up with AI that inherently
- 09:35understands the physics better? So we
- 09:38can completely avoid the lab experiments
- 09:40or maybe only do it to do the final
- 09:43testing. And so with that focus and with
- 09:45that physical knowledge, we can come up
- 09:48with AI designed answers that we can go
- 09:52directly to the real world and minimize
- 09:55this need for testing. To me, human
- 09:58agency is driving AI to do something
Does AI Kill Curiosity?
- 10:01that you want it to be done. You have
- 10:04the agency as a human to decide what
- 10:07tasks AI does and then you're evaluating
- 10:11and you're in charge, right? So, you go
- 10:13and verify whether what AI is saying is
- 10:16true or not and then over time provide
- 10:18that feedback to AI and make it
- 10:21better. AI is a tool. It can both help
- 10:25curiosity but also kill it depending on
- 10:27how it's used. Right? So for young
- 10:30people, my advice is not to be afraid of
- 10:32AI or worry what skills to learn that AI
- 10:36may replace them with, but really be in
- 10:39that path of curiosity, right? Use AI as
- 10:42a tool to drive that curiosity, learn
- 10:45new skills, new knowledge, and you can
- 10:48do that in a much more interactive way.
- 10:50Even when it comes to writing computer
- 10:52programs, you know, a lot of these AI
- 10:54tools are getting better, but that only
- 10:56means they can do a certain set of
- 10:58instructions which are seen in data. You
- 11:01still need to provide AI what to do,
- 11:05right? You still need to be able to
- 11:06describe it. And that ability to
- 11:09describe what are the tasks AI should
- 11:11do. What are kind of highlevel
- 11:13understanding of what AI is doing when
- 11:16it writes these computer programs is
- 11:18still important because a bad programmer
- 11:21who is not better than AI will be
- 11:23replaced. But a great programmer who can
- 11:26assess what AI is doing, make fixes,
- 11:29ensure those programs are written well
- 11:32will be in more demand than ever.