Building AI Search Engine for the GPT-5 Era | Will Bryk, Exa
“In five years, we can have systems that completely automate all human labor, AI does all the repetitive work and humans do all the novel work.” Will Bryk is the co-founder and CEO of Exa, an AI search engine startup. Unlike traditional keyword-based search engines, Exa analyzes the meaning
Watch on YouTube →Transcript
Intro
- 00:00In 5 years, we could have AGI systems
- 00:01that completely automate all human
- 00:03labor. AIs do all the repetitive work
- 00:04and humans do all the novel work. Every
- 00:06human is going to become a product
- 00:07manager of a team of AIs. How are you
- 00:09supposed to plan for that? I think it's
- 00:11extremely hard to predict where the
- 00:12world will be in 5 years. One-year plans
- 00:14make sense right now. Threeear plans are
- 00:16really hard and 5ear plans are
- 00:18impossible. So, because the AI market is
- 00:20changing so fast, like every month, like
- 00:22new systems come out that make new
- 00:24things possible. The right way of
- 00:26navigating that is to think from first
- 00:28principles about like what does the
- 00:29market need that still will be true in a
- 00:31year. Because if you're thinking about
- 00:32what does the market need right now, a
- 00:33month later something new is going to
- 00:34come out and they're not going to need
- 00:36it anymore. So you have to think a
- 00:37little more longterm. You have to be a
- 00:38little more strategic than in the past.
- 00:40You know, for example, like when I was
Argument with Greg Brockman
- 00:41in college, AI was not at all as
- 00:43prominent as it is today. Everyone today
- 00:45talks about AI, but there were a few
- 00:46people who were aware of what was going
- 00:48on. I was lucky enough to go to a
- 00:50Westworld watching party at OpenAI and I
- 00:52was actually on a bean bag with Greg
- 00:54Brockman um just chilling on this bean
- 00:56bag and we were arguing about the
- 00:58scaling hypothesis and the scaling
- 00:59hypothesis is this idea that you keep
- 01:01putting more compute into transformers
- 01:04and they'll just keep getting better and
- 01:05that's how we get to
- 01:07AGI. That was a crazy idea when I was in
- 01:10college. The vast majority of people
- 01:11didn't believe it. I didn't believe it.
- 01:12Greg was arguing that if we just keep
- 01:14scaling these things, we'll get there.
- 01:16We'll get to AGI. And I was arguing that
- 01:18we need new types of methods. I think we
- 01:20were both right in our own way, but we
- 01:22kept seeing progress from GB1 to GB2,
- 01:24GB3, eventually GB4. And at some point
- 01:27along that trajectory, I was like, "Holy
- 01:29cow, like these systems when you scale
- 01:31them, they just get really good." I
- 01:34think the people who were earlier to
- 01:35that conclusion did better. And we kind
- 01:37of apply the same scaling logic to Exa.
- 01:40We are building transformer-l like
- 01:41systems for search. And we also know
- 01:44that if you keep packing data and
- 01:45compute into the search engine, it will
- 01:47get better and better. That's a
- 01:48hypothesis we have. It's like our own
- 01:50scaling hypothesis for search. It's very
- 01:51different from traditional search
- 01:52engines like Google or Bing which
- 01:54basically have stayed the same for you
- 01:56know many years whereas like X is
- 01:58getting better like this. And so we're
- 02:00thinking a lot about like where is the
- 02:01future going? Uh so we see a world where
- 02:03there are agents everywhere. GBD5 level
- 02:05AI agents navigating the web doing all
- 02:07sorts of tasks. This future is coming.
- 02:09They're going to need search all of
- 02:11them.
How Is Exa Different from Google?
- 02:14Hey, I'm Will. I'm the CEO of Exa. We're
- 02:16building the next generation of search.
- 02:17One good way of understanding Exa is in
- 02:19contrast to traditional search. So,
- 02:21traditional search engines use mostly
- 02:23keywords. Okay? So, if you're using a
- 02:24traditional search engine and you want
- 02:26to find startups working on futuristic
- 02:28hardware in the Bay Area, traditional
- 02:31search engines will use keyword
- 02:32matchings. The results they give you
- 02:34will be documents that contain the words
- 02:35startup and hardware and Bay Area. But
- 02:38startups that are working on futures of
- 02:39hardware in the Bay Area, they don't
- 02:40typically have those terms. Like you
- 02:42might have a a rocket company in SF. A
- 02:45traditional search engine won't be able
- 02:46to find that rocket company. But Exa can
- 02:48because uh we understand the meaning of
- 02:50documents. We understand the meaning
- 02:51that oh, if it's a rocket company in SF,
- 02:53then it does match startups working on
- 02:55futures of hardware in the Bay Area. We
- 02:58believe it's possible to have perfect
- 02:59search over the web, meaning whatever
- 03:01information you want, you get exactly
- 03:03that. We help companies integrate this
- 03:05high-quality knowledge into their
- 03:07applications. So we recently raised $17
- 03:09million from Lightseed and Nvidia. Our
- 03:11revenue is doubling every quarter. We're
- 03:12building the next generation of
- 03:17search. I came into college wanting to
The Movie That Changed Me
- 03:20study physics to like I want to
- 03:21understand how the universe works and I
- 03:23thought physics was the right way to do
- 03:24that. Something big that influenced me
- 03:25was watching the social network cuz I I
- 03:27was studying at Harvard and the social
- 03:29network took place in Harvard. It was
- 03:30actually a very accurate movie and it
- 03:32was very inspiring to see this guy
- 03:34change the world just on his laptop. I
- 03:36realized that you could have like a
- 03:37massive influence just coding on your
- 03:39laptop in a way that you couldn't as
- 03:41much with physics. It was very clear
- 03:43that that that the AI could understand
- 03:45the problems of physics. So I went into
- 03:47computer science and I think that turned
- 03:48out to be right because now like the AI
- 03:50is getting so good that it should be
- 03:52able to just tell us the answer or
- 03:54infuse it into our brains. Before EXA on
Google Really Fails
- 03:57the side I was writing a history book. I
- 03:59got really excited about world history
- 04:00and I decided I'm just gonna write a
- 04:02book about it because I'm like no one
- 04:04has captured in a book my the level of
- 04:07excitement that I had and so I was doing
- 04:08a lot of research for the book. I
- 04:10quickly realized that Google is actually
- 04:12not good enough for that type of
- 04:13research. Like Google is great for
- 04:15surface level investigations. Once you
- 04:17start like trying to go deeper and
- 04:19trying to understand any topic deeply on
- 04:21the web, Google really fails. For
- 04:23example, if I want to find like all the
- 04:24research papers on uh poverty in ancient
- 04:27Rome, it's actually really hard to find
- 04:28that on Google. Not every paper will
- 04:30mention the word poverty. And so I was
- 04:31doing the research for this book and it
- 04:33was really hard to find things. And then
- 04:35at the same time, GB3 had recently come
- 04:37out and GB3 was this magical creature
- 04:39really that I could talk to and it could
- 04:42understand like anything I say at a very
- 04:44deep complex level. And so the thinking
- 04:46was what if we could apply the same
- 04:49technology of GB3 to search? What if you
- 04:51can make a search engine that actually
- 04:53understands you at a deep level? And
- 04:55it's been the same goal ever
Good Products Make Customers Knock
- 05:00since. The first year and a half of EXO,
- 05:03we did research into uh search models
- 05:06into how can we take transformer models
- 05:08and apply them to a search engine. No
- 05:10one's really done that before. It took a
- 05:12long time to figure out how to do it
- 05:14well. And that required persistence.
- 05:16like we were just banging our head
- 05:17against the wall for a year and a half
- 05:18trying out different models, trying out
- 05:20different data sets and eventually we
- 05:22got something that worked really well.
- 05:23If we didn't have the persistence, you
- 05:24know, 6 months in, we might have given
- 05:25up, but we didn't. Early November 2022,
- 05:28we launched the first version of Exa to
- 05:30the public. We built a search engine
- 05:32that was perfect for AI applications.
- 05:33Basically, AI systems, they have all
- 05:35this intelligence, but they're lacking
- 05:36in knowledge. And so, when they need
- 05:38knowledge, they go make a call to Exa
- 05:40and get exactly that knowledge. Then
- 05:42catch came out a few weeks later and
- 05:45that was a big moment uh for the
- 05:47information ecosystem. But for us it was
- 05:48really interesting because we started
- 05:49getting requests for API access to our
- 05:52search engine. We started getting
- 05:53requests for API access uh first from a
- 05:55friend who was actually like living
- 05:57downstairs. I told him no sorry we don't
- 05:59have API access. And I didn't really
- 06:01think much of it. Uh but then we kept
- 06:02then we got uh a request for API access
- 06:05from someone from some company in
- 06:06Germany. And we also told them no sorry
- 06:08we don't have an API. And then we kept
- 06:10getting requests for API access. And we
- 06:12realized that because of chatbt, people
How ChatGPT Changes Exa
- 06:15were starting to build AI applications
- 06:17all over the place for all sorts of
- 06:19businesses. And all these AI
- 06:20applications needed search. Like the AIS
- 06:22themselves needed to search and that's
- 06:24when we started to realize, okay, X
- 06:26could be really useful for these AI
- 06:28applications. Yeah. So our initial
- 06:30customer found us. And so one lesson
- 06:32there is just like be a really good
- 06:34listener to the market. Like what are
- 06:35people repeatedly saying they need? and
- 06:37you might have some idea of what you
- 06:40know what you're going to sell but then
- 06:41if people keep requesting something like
- 06:43API access maybe you should start
- 06:44listening to them like we cared more
- 06:46about uh learnings from the customer
- 06:48than getting a lot of revenue and so
- 06:50yeah we were like opening our ears to
- 06:52what do the customers need uh over time
- 06:54developed a hypothesis about how we
- 06:57should price and what types of customers
- 06:59we should
Preparing for the GPT-5 Era
- 07:03pursue. I think you can guess where
- 07:06companies like OpenAI and Enthropic are
- 07:08going to build based on like what are
- 07:11like what are big markets that they
- 07:12could tackle like agents like automating
- 07:14work is a clear huge market and so
- 07:17they're clearly going to do that. Okay.
- 07:18So now you know what types of things
- 07:20they want to do. Can they do it? Well
- 07:22then you think about fundamentals of
- 07:24LLMs. You think like okay LLM can as
- 07:27long as you can make training data for
- 07:28some objective they will get better at
- 07:30that objective. Can you make training
- 07:32data for agentic behavior? Definitely
- 07:34you just have a bunch of examples of
- 07:37navigating the web in order to buy plane
- 07:39tickets and if you have a million
- 07:41examples of that then now the LLM will
- 07:43know how to buy plane tickets. Yes. So
- 07:45any sort of task such that you could
- 07:47create data for it LLM will get near
- 07:50perfect at that task. So that's like a
- 07:51fundamental way of thinking about this.
- 07:53So will AI get really good at navigating
- 07:55the
- 07:58web? Yes. That's pretty easy because
- 08:00it's it's easy to generate lots of
- 08:02navigating the web data. Will AI get
- 08:04really good at
- 08:07robotics? Yes, but probably on a longer
- 08:09term horizon because gathering lots of
- 08:12robotic training data is harder because
- 08:14it's hardware and hardware is hard to
- 08:16work with. So what do we learn from
- 08:17that? We learned that AI's navigating
- 08:18the web will come pretty soon. AI's
- 08:21navigating robotics will take longer. So
- 08:23just from like simple first principles,
- 08:25you can like guess where things are
- 08:26going. Picture in your mind how crazy
- 08:28good technology will be and AI will be
- 08:30in a year and then build for that world.