How to Stay Great When AI Is Good Enough | Matt Beane, UC Santa BarBara
Matt Beane, Associate Professor of Technology Management at UC Santa Barbara & author of The Skill Code, breaks down why AI's endless flood of B+ work is a t...
Watch on YouTube →Transcript
Intro
- 00:002025 was the year of try everything with
- 00:04AI, get results with AI, do your very
- 00:06best, experiment, learn, licenses for
- 00:09everyone. 2026 is the year that the
- 00:11board [music] of directors is coming to
- 00:13the CTO and saying, "Where is our return
- 00:16on our investment?" Jensen Hang from
- 00:18Nvidia is very famously on interviews
- 00:21saying, "If I'm paying $500,000 for an
- 00:24engineer, they need to be burning at
- 00:25least $250,000 worth of tokens." You can
- 00:28burn many many many tokens very
- 00:31inefficiently. All AI can do most of the
- 00:34time is create B+ content. It will just
- 00:36lots of free B+ content and you will
- 00:39forget what an A+ looks like. A wise
- 00:41[music] leader in an organization will
- 00:44reward people with cash or promotion or
- 00:48visible recognition for stopping a B+
- 00:52idea. I'm Matt Bean. I'm an associate
- 00:56professor at UC Santa Barbara in the
- 00:58technology management department and
- 01:00also CEO and co-founder of Skillbench, a
- 01:03startup in the AI enablement space.
Don't Let AI Dumb You Down
- 01:17I wrote an article about this called
- 01:18don't let AI dumb you down and I put
- 01:21that on my Substack. That was 2 and a
- 01:23half years ago. This immediately I saw
- 01:24this technology I went this is a major
- 01:27risk. I can produce many many lots of
- 01:29lines of code. I can produce documents
- 01:31for free or cheap. Should I have done
The B+ Trap
- 01:33that? Some experts uh say that the most
- 01:37valuable function of expertise is to say
- 01:39we will not do that thing. That is a B+
- 01:42idea. That is not an A+ idea. We will
- 01:45skip the B+ ideas. unhealthy
- 01:47organizations, unhealthy uh you know
- 01:49people who create problems for
- 01:51themselves will see lots of ideas and go
- 01:53do them and it turns out they produce
- 01:55lots of B+ ideas. That's not too good.
- 01:58You have to have restraint. You have to
- 02:00only do the maximum quality thing. Um AI
- 02:04will make that harder. So then even when
- 02:06you're in a task, you produce some
- 02:08content and some output. In general, it
- 02:11could be good, but there are quality
- 02:12problems inside. If you haven't made
- 02:14yourself learn to think, write, and do
- 02:18whatever this expert process is you're
- 02:20trying to do very well, you will miss
- 02:23these quality problems. [music] And then
- 02:26you slowly and subtly prevent yourself
- 02:28from learning and you might even lose
The Trillion-Dollar Deskilling
- 02:31skill. I said in the book that this is a
- 02:34trillion dollar problem and I think it's
- 02:36really true. It is actually true that if
- 02:38we don't take active steps to protect
- 02:41ourselves from this, we will deskkill
- 02:43ourselves, other people, the next
- 02:45generation, [music]
- 02:46that will harm the economy, not right
- 02:48now, but a few years from now. The
Fighters vs. Coasters
- 02:52difference between uh those who care and
- 02:54are trying to protect their learning and
- 02:56those who are just pushing through and
- 02:58using AI, one is to your disposition.
- 03:02Are you just driven to make sure that
- 03:05you can do your own independent work and
- 03:07get your own independent results? This
- 03:08is some sometimes just something about a
- 03:12given individual that makes them fight
- 03:14and protect their learning. But a lot of
- 03:16it also has to do with incentives and
- 03:18the social structure you're embedded in.
- 03:21If the nature of my job is to produce
- 03:24more lines of code as a software
- 03:26engineer, I'm focused a lot on software
- 03:27engineering today. Or burn lots of
- 03:29tokens. This is another one that is very
Burning Tokens, Running in Circles
- 03:31common now. Jensen Huang from Nvidia is
- 03:34very famously on interviews saying, "If
- 03:36I'm paying $500,000 for an engineer,
- 03:39they need to be burning at least
- 03:40$250,000 worth of tokens." You can
- 03:43[music] burn many, many, many tokens
- 03:45very inefficiently. It's like saying, "I
- 03:48burned a lot of uh calories today." That
- 03:51this could be okay, but did you just run
- 03:53in circles? The immediate first question
- 03:56is, is that a B+ idea or an A minus
- 03:59idea? You have to set some threshold. A
Reward the B+ Killers
- 04:01wise leader in an organization will
- 04:04reward people with cash or promotion or
- 04:08visible recognition for stopping a B+
- 04:12idea from making it forward. You have to
- 04:15do more to create incentives for people
- 04:19to insist on superb ideas only. [music]
- 04:23And then someone who does pick an A+
- 04:25idea will win. and you'll go, "Wait, I
- 04:28didn't know you were allowed to do
- 04:29this." And [music] it's like, "Yeah,
- 04:31this is how innovation works. You have
- 04:32to be very patient. You have to be
- 04:34persistent. You have to focus on, no,
- 04:36that's not good enough."
What Shadow Learners Reveal About How We Build Skill
- 04:40In 2018, I published the first paper out
- 04:43of my dissertation, which was on robotic
- 04:46surgery, uh, which generated this idea
- 04:48of the shadow learning process. Shadow
- 04:51learning is building skill through
- 04:53nonapproved means, inappropriate means.
- 04:55Why would people do this? The reason is
- 04:58that in current circumstances in
- 05:00surgery, but I have since checked this
- 05:02in over 35 occupations, when a new
- 05:04technology arrives that disrupts the way
- 05:06that you do work, it also disrupts the
- 05:09way that you're supposed to learn on the
- 05:10job. What most of our skill comes from
- 05:12doing the work, and most of that comes
- 05:15with as we interact with experts on the
- 05:17job. The new technology allows the
- 05:19expert to do more work independently,
- 05:21which means that there's less room for
- 05:23the novice to participate. So you show
- 05:26up to the work, you hope to learn and
- 05:28build skill just by doing, and the
- 05:30expert is on Zoom, never comes to work.
- 05:33I don't get to interact with them. What
- 05:35am I learning after a year, 2 years?
- 05:37[music] Not as much. Most people will
- 05:40continue to try to learn the
- 05:42old-fashioned way. you know I will try
- 05:44to find ways to uh get involved in
- 05:47projects or something like this
- 05:49[music]
- 05:49um and they will struggle but a very
- 05:52rare few uh set of individuals will
- 05:55[music]
- 05:55instead of trying to participate
- 05:57normally they will find norm and
- 06:00rulebending culturally inappropriate
- 06:03ways to build skill. So for example in
- 06:05robotic surgery medical residents who
- 06:08were effective at building skill given
- 06:10this barrier to participation they uh
- 06:14found ways to operate on patients
- 06:16without the senior surgeon in the room.
- 06:18It's not illegal but that is not
- 06:20appropriate for a junior resident to be
- 06:23operating on a patient alone. But this
- 06:25is what the residents who were very good
- 06:27at building skill quickly did. They also
- 06:30for instance spent a lot of time on
- 06:32YouTube watching recorded video of
- 06:34surgery like a hundred times as much as
- 06:37a normal resident. So shadow learning is
- 06:40I can't build skill the normal way. So
- 06:42now I have to invent deviant or
- 06:44rulebreaking bending ways to build my
- 06:47skill. I've found this in every other
- 06:50occupation I've looked at. These are not
- 06:52practices we should copy. Obviously it's
- 06:54not appropriate. However, these people
- 06:57are fighting to protect some things in
- 07:00their work experience that will allow
- 07:02them to build skill.
The Skill Code - Three C's
- 07:06Figuring out what that is, what are they
- 07:08fighting to protect was the purpose of
- 07:10writing my book. The first third of that
- 07:12book, I looked across all the shadow
- 07:14learners that I found across many
- 07:16contexts to figure out what do they have
- 07:19in common. In fact, none of them
- 07:22explicitly identified these
- 07:24characteristics like I have a plan. I'm
- 07:26going to protect these things in my
- 07:28work. But if you look at their behavior,
- 07:30you can see what they were fighting to
- 07:31protect. And that's the first third of
- 07:33my book. Challenge, complexity, and
- 07:36connection. The three C's in the skill
- 07:38code. So the point is the shadow learner
- 07:40is a critical
- 07:42source to go to to figure out what are
- 07:45they fighting to protect. What can we do
- 07:47to keep working conditions [music]
- 07:49healthy for productivity but also for
- 07:52skill development? Not copy them but
- 07:55they are a diagnostic in they they give
- 07:57you critical diagnostic information. So
Challenge - Learn at the Edge
- 08:00challenge is the one that is perhaps
- 08:02most intuitive for folks which is you
- 08:04need to be close to but not at the edge
- 08:07of your capability to learn to build
- 08:10skill while you're working. So it must
- 08:12be very difficult require a lot of
- 08:14focus. You're not happy and relaxed.
- 08:17It's very intense experience somewhat
- 08:19stressful and you're not performing at
- 08:21your best a little bit less than your
- 08:23best because you're straining. [music]
- 08:25It's it's a challenge. You must have a
- 08:27healthy amount of this challenge in
- 08:28order to really build skill wealth.
- 08:30Another though is that an expert is
- 08:32there to help you manage the frustration
- 08:35associated [music] with that challenge.
- 08:36It's natural when you try to do
- 08:38something that is at the edge of your
- 08:40capability that you will fail in small
- 08:41ways. This is required. When you fail,
- 08:45you get frustrated. If an expert is
- 08:47present and doing a good job, they can
- 08:50help you put this failure into context
- 08:52[music] to say, "Yeah, you tried to do
- 08:54this and you didn't quite succeed, but
- 08:57you're now capable of attempting this
- 08:58task. Last week, you couldn't even
- 09:00attempt." So, they helped you sort of
- 09:02understand that your frustration is
- 09:04natural and that in fact, you have
- 09:05already progressed quite a bit. The
- 09:07expert [music] has an important role to
- 09:08play in helping you process the
- 09:12frustration of challenge enough so that
- 09:14you can continue to push yourself
Complexity - See the Whole System
- 09:16further. The next of those is
- 09:18complexity, which is about how you
- 09:21digest and engage with the broader work
- 09:24experience that you're embedded in, not
- 09:26just the focal task. So the focal task
- 09:28for a surgeon might be making a suture
- 09:30well and then tying a knot. These are
- 09:32very focal skills that I have to get
- 09:34very good at. But a good surgeon that's
- 09:36learning well is also engaging with the
- 09:39nurse, the scrub tech, the supply in the
- 09:42hospital, the finances for the hospital,
- 09:44the computer and the IT system. They're
- 09:47trying to understand the entire system
- 09:49of work that they're embedded in. And
- 09:51they give themselves time to reflect on
- 09:53the whole system so that they can
- 09:55process and understand it. Engaging with
- 09:57complexity but makes you better able to
- 10:00handle surprise and discover new ideas
- 10:03because I'm more attuned to the system.
- 10:05The individual, you must always preserve
- 10:07space and time to reflect on the
- 10:09circumstance and look left, look right,
- 10:11try to understand. You yourself can do a
- 10:14great deal to be curious and try to
- 10:17engage with the broader system. At the
- 10:19same time, performance pressures in jobs
- 10:22are very high and [music] it's very hard
- 10:24for individuals to devote the time and
- 10:27effort to do this kind of engagement and
- 10:28leaders [music] in organizations can do
- 10:30a lot to enable this kind of success. So
- 10:33for instance, you can have job rotation
- 10:35program. I've seen two warehouses where
- 10:38in warehouse 1, [music] people just go
- 10:40in, get on the line, and do their job.
- 10:42And they get paid the same wage as
- 10:44someone over here who um will learn more
- 10:47in uh warehouse B because they come in
- 10:50and for 2 to 3 days they work on the
- 10:52line, they put their item in the bag and
- 10:53then they are rotated to a different
- 10:55part of the line. And [music] these
- 10:57rotations give you an exposure to
- 10:59different parts of the experience. same
- 11:02wage, same job, same job title, but that
- 11:05person is going to be more adaptive.
- 11:07[music]
- 11:08Interestingly, the leaders in those
- 11:09organizations are not doing it to try to
- 11:11develop employees. When I ask them, it's
- 11:14very fascinating. They're doing it to
- 11:16create resiliency in the line. What
- 11:18matters to them is that the building is
- 11:20an effective processing unit. That means
- 11:22it needs to be able to handle surprise.
- 11:25It needs to be able to notice problems
- 11:28and catch quality issues. And then the
Connection - Trust Is a Skill
- 11:30third C which is connection which is a
- 11:32bond of trust between human beings.
- 11:35trust and respect actually I should say
- 11:37we don't often think of bonds of trust
- 11:39and respect as critical for learning
- 11:42except actually if you reflect on your
- 11:43own work experience anybody and you
- 11:45think about when did I learn the most
- 11:47and why often it's a who there is a
- 11:51person the person who trusted you who
- 11:53gave you an opportunity who gave you
- 11:55some healthy feedback that you wanted to
- 11:58earn their trust and respect by getting
- 12:00better I can speak for myself this was
- 12:02part of my career for sure this kind of
- 12:04bond of trust and respect for the
- 12:06novice. It provides them with motivation
- 12:08to do better because you it's just
- 12:10important to you intrinsically. This is
- 12:12how humans are wired. We want to earn
- 12:14the trust and respect of mentors, senior
- 12:16people. And it goes for the other
- 12:17direction as well. Senior people, it's
- 12:20meaningful to [music] realize that you
- 12:22can help a junior person develop and
- 12:24give them challenges to help them do
- 12:26this. You want to earn their trust and
- 12:28respect in response. But for the junior
- 12:30person, it also means that that senior
- 12:31person, if you do this, will give you
- 12:33your next opportunity. They'll help you.
- 12:36So it's a functional thing as well. It's
- 12:38not just relational.
- 12:40Challenge, complexity, and connection
- 12:42were consistently evident across all of
- 12:44the shadow learning that I looked at.
- 12:46All these people who were breaking and
- 12:48bending rules, they were finding ways to
- 12:50protect challenge, complexity, and
- 12:52connection. Unconventional ways,
- 12:54inappropriate ways, but they were
- 12:56grabbing for those three things.
What Leaders Must Do Now
- 13:02What's the leader's role in protecting
- 13:06healthy good quality target selection?
Learn in Public
- 13:10Individual leadership action [music] is
- 13:13and has always been important. It will
- 13:15remain important. You have to lead by
- 13:17example and get primary data, personal
- 13:20experience with how people are doing the
- 13:22job in the organization. [music]
- 13:23most effective leaders now that I see
- 13:26spend personal significant time with the
- 13:29most advanced AI building things and
- 13:32showing how quickly [music] they can do
- 13:34that in a way that's valuable to the
- 13:36organization and including displaying
- 13:38failure and waste when they use
- 13:40reporting out to the organization as the
- 13:42leader or a leader of a function and
- 13:44saying you know I tried to do this thing
- 13:45with AI and it was very bad I decided
- 13:48it's a bad idea but still revealing this
- 13:51to people shows no one knows
- 13:53how to use this technology. Now, so
- 13:55modeling this is is very important. The
Hire Juniors, Learn Both Ways - Inverted Apprenticeship
- 13:58general trend uh that seems to have
- 14:01shown up in the economy in the last year
- 14:02or year and a half is that firms have
- 14:05slowed down hiring at the junior level
- 14:07and tried to retain and grow talent at
- 14:10the more senior expertise level. It is
- 14:13very shortsighted. You need to be much
- 14:16more assertive about hiring junior
- 14:17people who are AI native and can do
- 14:20astounding things with AI even if
- 14:22they're professionally less experienced
- 14:24or have no experience and set up
- 14:27learning dynamics that are birectional
- 14:29so that the senior person can learn from
- 14:31the junior person and the junior person
- 14:33can learn from the senior person. I
- 14:35called this in my book and in my
- 14:36research inverted apprenticeship
- 14:38especially when new technologies arise.
- 14:40You [music] need a birectional learning.
- 14:43New employees have fresh perspective on
- 14:45the organization and can help improve
- 14:46things. So [music]
- 14:48healthy organizations are willing to
- 14:50take a shortrun uh hit to the
- 14:53productivity in order to ensure that
- 14:55they're ready for tomorrow.
When AI Beats Us at Everything
- 14:58It's very rare in human history that we
- 15:00get a general purpose technology [music]
- 15:02that really changes the way we do
- 15:04things. It is going to be messy in the
- 15:05beginning. No one will get it right. We
- 15:08must all learn from each other. And so
- 15:10it's important to have have high
- 15:12standards, but also be forgiving with
- 15:14yourself and others and understand that
- 15:16everybody's going to be wasteful and
- 15:18make mistakes. I think it's important to
- 15:21be open to the possibility that AI in
- 15:24between 3 and [music] 40 years will be
- 15:28better at everything than humans are.
- 15:31Literally everything, all tasks,
- 15:33including empathy, including judgment,
- 15:36including creativity. This is not a
- 15:38crazy view to hold anymore. It is not
- 15:41obvious to me that our governmental,
- 15:43educational, institutional
- 15:46systems will adapt fast enough, even
- 15:49given a 30-year timeline, even given 50.
- 15:51And that means change will be more
- 15:53disruptive and difficult. We can either
- 15:56make AI part of the solution and [music]
- 15:58make for a better future and a better
- 16:00path to the future that is less painful,
- 16:02more beneficial for more people or
- 16:04change will come in more [music] painful
- 16:06ways. I want to live in the future where
- 16:09we are grateful that AI has arrived.
- 16:11That [music] we can look around and see
- 16:13that everybody is better off, not just a
- 16:15few, because of AI. And I think we must
- 16:19act immediately and together to create
- 16:22that kind of future.