"ChatGPT Moment" for Robotics Is Coming. The Real Problem Isn't Intelligence | Stanford, Catie Cuan
Catie Cuan, Stanford Roboticist, Robot Choreographer, and founder of ART Lab (AI Robot Technology), breaks down why the humanoid race led by 1X and Unitree m...
Watch on YouTube →Transcript
Intro
- 00:00It's a tremendous time to be working in
- 00:01robotics. It feels like every week or
- 00:04multiple times a week there's new
- 00:05announcements about amazing things
- 00:07happening. So, we're in this absolutely
- 00:10unbelievable moment [music] right now. I
- 00:13think the thing that we're missing in a
- 00:16lot of this is what is that human
- 00:18interaction piece look like? [music] The
- 00:21question though in terms of building
- 00:23humanoids for me is is this really what
- 00:26we want? Is this what literally my
- 00:29[music] 77year-old English is his third
- 00:31language dad wants? Even if maybe it can
- 00:35do some tasks. We've sort of locked
- 00:37ourselves into a slightly myopic vision
- 00:40of what our future with robots can look
- 00:42like. And I would love for that aperture
- 00:44[music] to be broadened.
- 00:46My name is Katie Quan. I am the founder
- 00:49and CEO of Art Lab. It stands for AI
- 00:52robot technology. I'm a robot
- 00:54choreographer, a roboticist, a [music]
- 00:56researcher, an entrepreneur, and an
- 00:58artist. My mission is to make nent
- 01:02technologies like AI and robots [music]
- 01:05more humanistic, whimsical, and widely
- 01:08accessible. And I do that through
- 01:10business, [music] research, and art. My
- 01:12definition of humanistic is human-
- 01:15centered. So thinking about how we can
- 01:17drive interactions and experiences with
- 01:20these machines that help humans feel
- 01:22more empowered and safe, but also help
- 01:25them live healthier, better lives.
- 01:36We're at the Stamford Robotics Center on
- 01:38the Stamford campus in Palo Alto,
- 01:40California. The idea was to bring
- 01:42together a variety [music] of
- 01:44disciplines and engineering backgrounds
- 01:47to work on flagship projects [music] in
- 01:50robotics like domestic robotics,
- 01:52industrial robotics, medical, underwater
- 01:55and [music] exploration or in my case
- 01:57education, art, culture, movement and
- 01:59dance.
Billions of Robots Are Coming, Are We Ready?
- 02:05We're going to have billions of robots
- 02:07in our lifetimes. [music] It only took
- 02:1013 years for there to be a billion
- 02:12iPhones on Earth. We have so many people
- 02:15working in robotics right now. And so
- 02:17we're [music] going to see billions upon
- 02:19billions of these robots showing up in
- 02:20our everyday spaces, offices, hospitals,
- 02:24hotels, homes, caretaking facilities.
- 02:27When you take all of these robots out of
- 02:29these very niche, narrow vertical
- 02:31applications, and you give them a lot
- 02:33more intelligence and put them in situ
- 02:35with people, you have this huge
- 02:37opportunity. and also challenge which is
- 02:39how do you make humans and robots
- 02:41legible to one another and that's what
- 02:44my work is interested in. Human
- 02:46interaction is a grand challenge for
- 02:48robots. [music] It's been the case for
- 02:50the last several decades. Humans are
- 02:52really unpredictable. We [music] tend to
- 02:55do and say things and move in ways that
- 02:57you might not always expect. The
- 02:59problems that I'm interested in are how
- 03:01can we make robots more legible to
- 03:03people, but also more animating, more
- 03:05inspiring [music]
- 03:06to delight and bring awe into our lives.
- 03:10And so the thing that I have always been
- 03:12curious [music] about throughout my
- 03:13whole career is what kinds of
- 03:15interactions can we facilitate that both
- 03:19inspire and surprise us but also open
- 03:22the door into what [music] technology
- 03:24can be where it's not exclusively tool
- 03:28but it also is something [music] that
- 03:29you could socialize with or learn from.
- 03:32We are building a kind of model that we
- 03:34call a VLI a vision language interaction
- 03:36[music]
- 03:37model. This is the first kind of model
- 03:39that's existed which takes [music] the
- 03:42impetus of what it should be doing from
- 03:44humans in the environment. LLMs [music]
- 03:46are acting on human information and then
- 03:48maps that again to a series of robot
- 03:50actions but measures the success [music]
- 03:52or the failure of those robot actions on
- 03:54the basis of a human response. So we can
- 03:57tell is the human increasing in positive
- 03:59affect or decreasing was that what they
- 04:02wanted or not. And so we think this is
- 04:04the first start for robots that can
- 04:07really naturally and intuitively
- 04:09socialize and interact with people. And
- 04:11we want those interactions to be safe,
- 04:13legible, and clear. I grew up in the Bay
- 04:16Area from the time that I was really
- 04:18young. I always loved numbers and I
- 04:21always loved to dance. I loved math and
- 04:23I loved science, too. My dad's Cuban, so
- 04:26my whole family grew up social dancing.
- 04:28And I would say if you don't know how to
- 04:30dance, you're probably not Cuban. I
- 04:31always grew up with those two [music]
- 04:33very strong interests. And then at some
- 04:36point when I was getting towards the end
- 04:37of college, I had interned here at a big
- 04:39technology company in the Bay Area and I
- 04:42knew I really wanted to try what it was
- 04:44like to be a professional [music] dancer
- 04:46and that you only have a very small
- 04:48window in your early adulthood when you
- 04:50can go for it. I was a little scared. I
- 04:53didn't know anyone who had been [music]
- 04:54a professional dancer in my immediate
- 04:57sphere, my friends, my family. So, when
- 04:59I graduated from college, I wound up
- 05:01taking a job doing private equity
- 05:03consulting in New York. I realized
- 05:05really quickly [music] that wasn't for
- 05:06me, mainly because I had this childhood
- 05:09dream and I figured I'm only going to be
- 05:1121 once. [music] Um, and if I don't go
- 05:13for this now, I I'll regret it for the
- 05:15rest of my life. And so, I actually
- 05:17wound up leaving that job and then
- 05:19became a professional dancer in New York
- 05:21City. I had my own dance company for a
- 05:22long time. I danced for the Metropolitan
- 05:24Opera Ballet at Lincoln Center in New
- 05:26York, which was crazy experience. So,
- 05:29I'll never forget what it's like to bow
- 05:30on that stage. Around that time, my dad
- 05:33also got sick. He spent a while in the
- 05:35hospital. I think my dad seeing him be
- 05:39sick [music] in the hospital was really
- 05:41scary because here's somebody who you
- 05:43care about and you love so much and you
- 05:45want them to be healthy and safe. I
- 05:48think [music]
- 05:49the fact that he was surrounded by all
- 05:51these big machines that were supporting
- 05:53him, they were meant to help him
- 05:56literally survive. They were beeping and
- 05:59booping and had these proportions and
- 06:02colors and this sort of overall presence
- 06:05that I think was oppressive to him. And
- 06:09it was also opaque. He [music] didn't
- 06:11understand what they were doing. And
- 06:13there were very few opportunities where
- 06:16someone could explain it to him. And
- 06:18seeing him be that vulnerable, you know,
- 06:20it occurred to me that a lot of other
- 06:22people are in that same position all the
- 06:25time.
- 06:27One of the [music]
- 06:28projects I worked on when I was at
- 06:29Google was called Music Mode. When I
- 06:32first got there, you know, we had 200
- 06:34robots and they were all driving around
- 06:36Google buildings doing useful work. They
- 06:38were wiping tables, sorting trash,
- 06:41resetting conference rooms. They were
- 06:43doing valuable things [music] and I was
- 06:45there as an artist and residence and I
- 06:47remember going around and asking a few
- 06:50people who were software engineers you
- 06:51know what do you think about the robot
- 06:53and they were like h it's fine [music]
- 06:55you know it's a robot it was kind of
- 06:57cute or kind of cool initially and now
- 06:59it very slowly [music] does these
- 07:01different tasks and I'm thinking what a
- 07:02missed opportunity you know here's this
- 07:04amazing new flagship Vanguard technology
- 07:08showing up in [music] your lives and you
- 07:10feel a little bit ambivalent towards it
- 07:11I think for some people that would be a
- 07:13success. For me, it was like, huh, we
- 07:14could be doing a lot more. So, my first
- 07:16idea was to get the robots to play
- 07:19[music] music. I thought, why don't they
- 07:21sort some trash and wipe some tables and
- 07:23then they can go over here and play the
- 07:25cello? We worked on that for a few weeks
- 07:27[music] and then my friend and colleague
- 07:29Tom came up to me one day and he said,
- 07:31"You know, Katie, the robot generates a
- 07:33lot of data. [music] Instead of the
- 07:35robot playing music, what if the robot
- 07:39was the music? what if this data became
- 07:42the music? That was such a clever
- 07:44breakthrough [music] that he came up
- 07:46with because we then started working
- 07:47with a composer named Peter Van Stratton
- 07:49on this piece of software that we called
- 07:51music mode. And what we did was that
- 07:53every time a different part of the robot
- 07:55moved, [music]
- 07:56we would map it to a different sample of
- 07:59music. For example, me as the robot, I
- 08:01open and close my gripper, it goes cling
- 08:04cling. or [music] if I turn the torso of
- 08:07the robot, it would make this beautiful
- 08:09bass noise like boom boom boom. And
- 08:12Peter, [music] who was our composer, was
- 08:14such an amazing artist to work with
- 08:16because he understood [music] that you
- 08:18could move all these joints of the robot
- 08:20in any combination. So it was a real
- 08:22combinatorics problem. And so we worked
- 08:25on this for a couple months and then we
- 08:27shipped it on the robot this software
- 08:29called music mode. And we would just be
- 08:31able to say, "Hey robot, turn on music
- 08:32mode." And then as it's wiping the
- 08:35table, you just hear this symphony. Then
- 08:39I started getting emails from people at
- 08:42Google who I did not know that were
- 08:44like, "This is the most incredible thing
- 08:47I have ever seen." Like, I'm sitting at
- 08:49my desk crying because I never thought
- 08:53that a robot could be so beautiful. I
- 08:55never thought that a machine could make
- 08:57me feel this way. So we shipped music
- 08:59mode on every single one of the robots
- 09:00and and it was crazy. Like we would have
- 09:02nine robots that were sorting trash at
- 09:04the same time and you would go around
- 09:05and say, "Hey robot, turn on music
- 09:06mode." And just this beautiful symphony
- 09:09arose. [music]
- 09:10That for me was such a proof point that
- 09:12we need these experiences [music] with
- 09:14our technologies. We want to feel
- 09:17something. We want to feel engaged.
- 09:23We have been so influenced by fiction
Break Out of the Humanoid Imagination
- 09:26and media. dozens, I mean, I [music]
- 09:28think at this point, of humanoid
- 09:30companies that are making robots that
- 09:31look like humans. And often the argument
- 09:33that you hear is, well, they're they're
- 09:35made for human spaces, so we need them
- 09:37to look like people. Rodney Brooks says
- 09:39it really well. He's a titan in our
- 09:41field, and he says, the closer that
- 09:42something looks to a person, the higher
- 09:45the expectations people have for it. And
- 09:47you can't help yourself. Your mirror
- 09:49neurons go off. you start having all
- 09:51these expectations that because it's
- 09:53bilaterally symmetric and it's roughly
- 09:55in the same proportions as a human, it
- 09:57should be able to do what a human does.
- 09:59The expectations that you set are so
- 10:01high and and I think also for people,
- 10:03you know, if I ask whether it's my
- 10:0677year-old dad or whether it's one of my
- 10:09nieces and nephews and I'm like, "Hey,
- 10:11is that the robot that you want?" I
- 10:13think there isn't enough expansive
- 10:15thinking into what robots can be. We've
- 10:18sort of locked ourselves. we meaning the
- 10:20the broader robotics field into a
- 10:22slightly myopic vision of what our
- 10:25future with robots can look like and I
- 10:27would love for that aperture to be
- 10:29broadened.
- 10:31There's this phrase called dirty, dull
- 10:33and dangerous. So for a long time robots
- 10:35were useful for tasks that were too
- 10:37dirty, dull or dangerous for people to
- 10:40do. And then I think there was appetite
- 10:42for robots to do other things that were
- 10:44not exclusively dirty, dull and
- 10:46dangerous jobs. It's just that I think
- 10:48we've still gotten locked into this
- 10:50paradigm of like robots are for utility.
- 10:53They need to alleviate [music]
- 10:55certain parts of physical labor in our
- 10:57lives when I think robots can do a lot
- 10:59more than that. The Paru robot was a
- 11:01very soft seal robot that was popular I
- 11:04think in the mid2010s [music] um that
- 11:06would just provide companionship for
- 11:08people who were ailing or lonely. There
- 11:10have been robots used for helping
- 11:13children with autism learn social
- 11:14skills. So, I think we have a lot of
- 11:17opportunities [music] for robots to show
- 11:19up in our lives and be beneficial for
- 11:21humans that are not exclusively [music]
- 11:23humanoids that do our dishes in our
- 11:25laundry. I've worked with a lot of
- 11:26different robots in my career. I've
- 11:28gotten to use Roombas in a dance
- 11:31project, small humanoid robots, drones,
- 11:35big industrial robot arms, [music] these
- 11:38mobile manipulators from Google. I've
- 11:40used quadripeds from Boston Dynamics.
- 11:42The very first experience I ever had
- 11:44dancing with a robot in Amy's lab in
- 11:462017 was transcendent. [music] It was
- 11:49the first time that I got to imbue
- 11:51myself inside of something and then also
- 11:53interact with it. [music] So I created
- 11:55this choreography for the machine and
- 11:57then it performed the choreography and
- 11:59then I got to dance with it and I was
- 12:01like [music] wo. I felt myself on this
- 12:04very long continuum of humans and our
- 12:07tools.
- 12:07[music]
- 12:07everything from early stone tools and
- 12:10fire to the wheel and the printing press
- 12:13and [music] the modern computer and
- 12:14these robots. And I thought, wow, this
- 12:17is part of definitionally what it means
- 12:19to be a human is to be in relationship
- 12:21with tools. Aristotle used to say we
- 12:23shouldn't be called homo sapiens. Homo
- 12:25sapiens, you know, wise man, intelligent
- 12:27man. There are a lot of species in the
- 12:29world that are intelligent. We should be
- 12:30called homoche. The thing that makes us
- 12:32unique is our relationship to our tools
- 12:34and our ability to make tools. What I've
- 12:36learned since then, oh my gosh, so much
- 12:38frustration, so much debugging, there's
- 12:41so many limitations. How my relationship
- 12:44has changed is I've become much more
- 12:46acutely aware of how amazing human
- 12:49beings are relative to all of the robots
- 12:52that I work with. They don't have the
- 12:54expressive potential that people have.
- 12:57Humans need to give ourselves a lot of
- 12:59credit. We can do a wide diversity of
- 13:02things. If you think about what was
- 13:04required to come into this building
- 13:06today, [music] you had to open a door.
- 13:08It was a door that you had never seen
- 13:10before with a handle that you couldn't
- 13:12have predicted. There are infinitely
- 13:14many different kinds of door handles
- 13:15with different friction [music] and
- 13:17torque required to get the door open.
- 13:18You had to walk down stairs that you'd
- 13:20never seen before in a space with a
- 13:23proportionate move, you know, a large
- 13:25object around, whether that's a backpack
- 13:26or something else that you're carrying.
- 13:28[music] You needed to then socialize and
- 13:31show up and make conversation and be
- 13:33acutely aware of timing. And to build
- 13:37the type of [music] dexterity and acuity
- 13:40and specificity that we have took not
- 13:44only your lifetime to evolve, but also
- 13:47the many generations before you that
- 13:49encoded all of that stuff in your DNA.
- 13:51We are really remarkable animals. I read
- 13:55a beautiful article yesterday about
- 13:58writing as a craft and how it's a
- 14:01hardearned craft in many cases that
- 14:04anything that's worth doing, [music]
- 14:07anything that is a craft in the richest
- 14:09sense of the word takes effort. I feel
- 14:12that way about many different [music]
- 14:14things, not only writing. That anything
- 14:16that's really worth doing or worth
- 14:19earning is hard. Otherwise, everybody
- 14:22would [music] do it. otherwise it
- 14:23wouldn't be considered worthy. I'm
- 14:26reminded again of this professor here at
- 14:28Stanford named Mark [music] Skyler Scott
- 14:30where he said, "My goal in my research
- 14:32is to 3D print a human heart and I think
- 14:35it's going to take me 25 years to do it.
- 14:38But it is a challenge that's worthy of
- 14:40your [music] life's attention because
- 14:42the impact at the end is so lifealtering
- 14:45literally that it will have been worthy
- 14:47of your life's [music] attention. I
- 14:49think we need things that are still
- 14:51challenging. Part of what I learned in
- 14:53my dance training [music] is that to
- 14:55really be at the top, to be at the
- 14:58highest levels, you need to [music] work
- 15:00hard. It is not easy. Otherwise,
- 15:02everyone else would do it. When you show
- 15:04up to an audition [music] and there's
- 15:05400 people there and they're going to
- 15:07hire four people, you better be good.
- 15:10Otherwise, everybody else in that room
- 15:12is good, [music] too, and you should go
- 15:14home and get better. And a thing I
- 15:16certainly don't [music] see myself
- 15:17delegating in the future is this pursuit
- 15:21of high impact challenging [music]
- 15:24problems with solutions that I want to
- 15:27build with people who inspire me.
You Can Build Anything. The Question is Why
- 15:33I teach a class at Stamford called CS
- 15:36[music] 334 Robots and Arts. It is the
- 15:39first class that's cross-listed between
- 15:41computer science and theater arts and
- 15:43[music] performance studies. And the
- 15:45invitation was that they could use AI
- 15:48and robots to make [music] a creative
- 15:51statement with a political,
- 15:53philosophical, or social underpinning.
- 15:55[music] You couldn't just have a robot
- 15:57do something. You actually needed to
- 15:59make an assertion with that project
- 16:02about I believe the world [music] should
- 16:03be like this or this is something that
- 16:06inspires me about the world or here's
- 16:08something that I don't like and I would
- 16:09like to change it. [music] The very
- 16:10first day of the class, I was thinking
- 16:12about here are all of these amazing
- 16:14students at Stanford Nexus of
- 16:17technology, culture, [music] art, but
- 16:19we're in this moment that is so special
- 16:22when it seems that everything [music] is
- 16:24possible. People, researchers here at
- 16:26Stanford are 3D printing organs where
- 16:29you can take an autonomous car all
- 16:31around San Francisco or Austin or
- 16:33Phoenix, depending on where you are,
- 16:34where we also are using large language
- 16:36models to potentially [music] make
- 16:37sequences of DNA. so we could build new
- 16:40life forms. So, we're in this absolutely
- 16:43unbelievable moment right now. Well,
- 16:46ostensively this class is you're going
- 16:48to make a project. But really what this
- 16:50class is about [music] is when you are
- 16:52in a place of infinite opportunity to
- 16:55build so quickly, [music] easily, and
- 16:57seamlessly. The question that's
- 16:59interesting is not what I should build,
- 17:02but the question is why am I building
- 17:05[music] it? do I want it to say or to
- 17:08do? When you're in this space of
- 17:10infinite choice, you need to understand
- 17:12why you're making decisions, [music]
- 17:14where your values are. We all have a
- 17:16finite amount of resources that we can
- 17:18[music] dedicate to anything. We have
- 17:21our energy, our brilliance, our network,
- 17:24our relationships, our technical [music]
- 17:25skills. And we have this really precious
- 17:28thing which is our time. That is [music]
- 17:30the only resource that you cannot scale,
- 17:32you cannot get back, that is equal for
- 17:35everyone. does not matter who you are,
- 17:36where you are, your time [music] is
- 17:39tremendously valuable. The dedication of
- 17:42that time, it's one of the biggest
- 17:43choices that [music] you make in your
- 17:45life. And we need to know why we make
- 17:49choices because it's a reflection of the
- 17:52it's the spending of this really
- 17:54precious [music] resource which is our
- 17:55time and knowing why you're building and
- 17:58making what you're [music] doing, what
- 18:00the statement is that you wanted to
- 18:01make. So, I think the why for my
- 18:03students and and for everyone else, when
- 18:06it's authentic, when it's real, it will
- 18:08carry you through a lot. If you know why
- 18:10you're doing it, it can create less
- 18:12resilience in these challenging
- 18:15circumstances where you need to be able
- 18:16to overcome and do better, be better,
- 18:20work harder, learn faster, go farther
- 18:22than you thought. The why carries you
- 18:24through a lot of that.