From Foundation Capital, this is B2B SEO, a podcast about the startup journey, what going from idea to IPO, and growing from a founder into a CEO. On each episode, I speak with notable CEOs and founders and get their stories, but what they took to build a company of scale and become a leader in the enterprise. I'm Ashu Gard, a general partner at Foundation Capital.
As everyone listening to this podcast knows, the release of ChatGPD last November are shared in a new age of AI and catalyzed a wave of AI startups. The team at Foundation Capital has backed AI first startups since 2010 and we are privileged to be early investors in companies like Databricks, Eightfold, Jasper, Cerribrares, any scale and a rise.
We're in a special moment in time where giants like Microsoft, Google and OpenAI are hogging this spotlight and every AI entrepreneur is wondering how to dance with the elephants. So for this episode of B2B SEO, I invited Bobbi Rao, a friend, serial entrepreneur, former VC and currently Chief Strategy Officer at Microsoft to share his point of view.
I picked Bobbi's brain on what sectors and province spaces he thinks are right for innovation with AI and what the opportunities for startups are. We then dissect the four layers of the AI stack from applications to platforms to infrastructure to models. Lastly, we talk about AI beyond large language models.
Pleasure to be here, Ashin. Thank you for joining us today.
很高兴能在这里见到你,Ashin。感谢你今天的加入。
Perhaps you could start by just introducing yourself a little bit and talking about some of the highlights of your career.
也许您可以先简单介绍一下自己,谈谈您职业生涯中的一些重要亮点。
Sure, I was born in India, moved early age to the UK as you can tell from my accent. Grop there to my undergraduate engineering and PhD. I spent a lot of time actually in high school with electronics and coding and became fascinated with that whole area, decided to pursue it to the level where I started actually becoming very interested in robotics. So that's what my PhD was in.
My postdoc, unfortunately, I was leaving my PhD in postdoc at a time where it was difficult to find good engineering roles which is kind of difficult to conceive of, given what's going on today. So I ended up actually in McKinsey and through that had a long and winding career of one of the business side, we're ended up becoming a, she's trashy on syrup, had to abode and ended up selling some companies and then ended up running a venture fund, not quite as illustrious as foundation but nevertheless a fund.
And now I'm going to say it was a great fun, you had some great companies. We got lucky but like every year, investors we stopped our tow, good amount as well. Fortunately we got a bit more lucky than tow stopping but we had our share of wounds to lick. But it was a great experience all around and now here I am at Microsoft, Frank Swatchy.
It must be a fun time to be running strategy at Microsoft given all that's going on in the world of AI.
在人工智能的世界中,微软战略部门的工作一定十分有趣。
It's actually, it's extraordinary and I don't think that anybody could really have predicted how it was going to evolve and how rapidly things have taken off. Certainly, you know, I assume you are on the same Microsoft as well, and then to Fugera, Yuff, now we're in an era which was already exciting when you think about the migration to the cloud which is still in relatively early innings, the growth of SaaS and some of the interesting evolutions of other aspects of the landscape. But once you add in this PI momentum to it, it just becomes a whole different level of interesting.
And what is it about the AI moment that stands out for you? Are there one or two things? Are there sort of the highlights or sort of the high notes, so to speak?
对于您来说,人工智能时刻的最突出之处是什么?有没有一两个方面?有没有所谓的亮点或高潮?
You know, I think I've been in technology for a while, as I mentioned, I was even proud owner of a soldering on in my bedroom as an early teenager and coding up on very early computers and writing programs such as publishing magazines. So I've been relatively paid out nerd for a period of time. And what's always interesting is to see something which just completely breaks out of the trajectory of what is expected.
And you know, when I was an undergrad, we had neural networks that were, you know, two or three layers deep and could look at an A by A pixel array of an A or a B or a one or a two and resolve between the two and everyone go very excited about it because this is a very different computing paradigm to sort of more algorithmic and logic based approaches which are more deterministic.
当我还是一个本科生的时候,我们已经有了神经网络,这些网络可以深度达到两三层,并且可以查看由 A 或 B、1 或 2 组成的 n × n 像素数组,从而在其中进行区分,人们对此感到非常激动,因为这是一种非常不同的计算范式,相对于更基于算法和逻辑的方法更加确定性。
So people got excited, obviously, that Bloom came off that rose very rapidly and these things didn't work beyond that at that time. So people got about it. But now what you're seeing is just a level of progress that was that is completely off any kind of graph that you could draw in terms of projection into the future as to how things would evolve.
And so that's one thing which makes it just extraordinary when you see these massive leaps that you often see in the in the core sciences in physics of chemistry and biology sometimes you see these massive unexpected leaps typically. That is how you see progress in those areas, which is not much happens and suddenly there's a massive leap. In technology that happens much more rarely and so it was extraordinary to see that here which is just something that nobody had anticipated.
And I must say that if you'd asked me, I would have said I would not have anticipated seeing this level progress in my lifetime and I hope to live for a bit longer. So I really hadn't expected to see that in my expected lifetime. So that makes it kind of extraordinary.
I think then the other thing which makes it extraordinary is just the general purpose utility of it. It's so fundamental. Its capabilities are so broad that it really sort of harkens back to some of the most fundamental innovations that created the technology industry in the first place. I often think of it as being almost like the transistor. It's just one of these things that just enabled a massive amount of change and value creation and opportunity and innovation to all just do one go.
And here's where you think if you had to start sort of seeing out in the future and what are some of the areas you're most excited about. Well, I think that for me one of the most interesting things about technology is the ability to democratize access to services good, it's an opportunity for people at large. It's important to know that there are, it's not just people living in developed and wealthy economies that can benefit from all this.
There are eight million people on the planet. And I was for a period of time in the mobile industry at a time when that was going through an enormous growth period. And if you look now country by country other than some countries where they got real structural issues as societies and governments, pretty much every country in the world has greater than 90% penetration of mobile technology. Not everyone's carrying a smartphone but people can make goal. There is a tech message is they can interact in ways that they could not even 20, 25 years ago.
And what that has done is it's really inflected the growth in productivity and opportunity for every person on the planet. Maybe people are not able to do a conference call while they're driving down their car, down the freeway. Maybe they use the phone instead to make sure that they have access to confirmation to keep them safe or allows them to know where they can go and sell their their chrome. But there's some value that's created there that affects everybody. And that I think was a very important aspect of the mobile industry and certainly something that a lot of us who are involved in were inspired by.
And I think that with AI as you've mentioned, the chat GPT moment has caught the zeitgeist of people everywhere and it's not just the dinner parties in the valley or in New York or in London. It's actually everywhere. Everybody is talking about this and every in every strata. And that I think is great because if we get to the point where this technology can help everybody in some way or the other, I think that will be a magnificent achievement.
It struck me as you were talking. And I had read about something called Kishan GPG, which is an AI chat part that seems to be designed to help Indian farmers with their agriculture and their farming. I mean, it is truly remarkable that within months of chat, they've been being launched. There's a very thing available for farmers in India. And as you said, given what's happened in Telecom, in the mobile industry, literally every farmer in India can access it. It is tremendously exciting. And I think where mobile technology took 25 years to go from something that was an interesting sounding thing to almost a little bit of a professional development.
It'll be interesting to see how AI, what trajectory AI is. Are there particular sectors or problem spaces that you think are particularly right for innovation, given what LLMs are capable of? I think there's two or three that I get particularly excited about. I don't think it's going to surprise you when I mention healthcare as one.
As you know, I started a couple of companies in the biotech arena. And I think that there's just extraordinary opportunities. I wouldn't come myself in any way as a healthcare expert, having said that. But I do think there's extraordinary opportunities to help every part of the health and life sciences ecosystem.
There's Peter Lee here, who was a colleague of mine here in Microsoft who runs our research analysis, written a book where he's been looking at applying the GBT models to physicians daily lives. And he's been looking at this for the last six months, so there are a number of esteemed practitioners in the space. And it's just absolutely mind-blowing for some of the physicians who have the emergency to interact with it in terms of how well the model does in helping the physician to diagnose and making sure that the physician has the ability to not miss something. And even extraordinarily helping physicians to know how to deal with patients who are going through very difficult times and how to cancel the parents of a sick child, for example, is just extraordinary.
Now, it doesn't mean it's perfect, it's all has the ability to eliminate it, etc. But we're seeing just amazing progress there in that sense in the physician space. Then when you think about also diagnosis, the ability for AI to help with diagnosing and analyzing radiology images, or to look at how the AI can look at signaling, it can derive from analyzing blood samples, you can detect cancer learning. These are all areas where we see opportunity for the AI to make a very big difference in terms of pruning the outcomes of patients.
And in the end, healthcare is one that everyone on the planet cares about, is becoming an increasingly unsustainable and unaffordable cost for even developing economies are still waiting for a decent healthcare. So I think the ability to have that be in population scale in fact is extraordinary. So healthcare is one broad area that you're very excited about. And there's many multiple dimensions to that.
What are other broad areas where you feel like there is near term potential for disruption with other events? I think that more than disruption, I'm excited about the augmentation possibility with education. I think anybody who's used any of these large algorithm model based chat tools has experienced this feeling of wonder of how well they do at explaining things. And you can regulate it up and down, explain it as if it was a phone. So by the old explainer, as if I was a college graduate. And the models will do a pretty good job of explaining abstract concepts in that way. And since these models are largely speaking red everything, they have the ability to teach you or anything. And so I think having the human teachers augmented with this AI, I think will open up extraordinary opportunities. Again, just the fact that everybody has a phone means that people can access a lot of this.
And you can just imagine the impact that's going to have in areas where you don't have access to people who know certain subjects or can teach to a certain level. This is that will be truly a democratizing force that will allow everyone to rise up. I think that's very well. I mean, that is actually something that's available today. It almost needs no new, there's no net new innovation required.
And the model's actually remarkably being able to teach people. That's exactly right. And I think that's right. I think the education process itself might have to change a little bit because some of the ways in which we measure progress for students will have to modify. Just in the same way that when capricators came around, you'd have to modify how they did certain exams to make sure that they were either used or not used, etc. I think that the education system is going to have to be modified to take that into account. But it's clearly a good thing that more people have access to high-quality education.
If we move on beyond healthcare education, I think both very large sectors of the economy, both global sectors where you know, access to both is very unequal based on economic factors. I do think Ellen Anthony, a huge level playing field. If we move on beyond that to sort of enterprise is in the US or in developed part, it's thinking the global goes thousand.
It's obviously very early days for most enterprises in terms of adopting an of them. But I've been surprised by how much interest there is. Do you see that as well in your role or through the lens with which you talk to large enterprises? Or is it near a sort of they have their head buried under the set right now? No, absolutely. I think we're seeing enormous interest.
And I think that what we are thinking about is there's three levels at which enterprises can deal with or interact with and benefit from AI right now.
我认为我们现在考虑的是企业可以通过三个层面来应对、与人工智能互动并受益。
The first I think is just simply to adopt the tools that have been created by Microsoft and other companies that allow everyday processes to be just done better.
我认为首先要做的就是采纳微软和其他公司开发的工具,这些工具可以让日常流程变得更加高效。
So just how you can start to email or how you start a document, even how you have a meeting on a video call.
那么,您要如何开始发送电子邮件或创建文档,甚至如何在视频通话中进行会议呢?
Can all be made better now through the summarization or the created aspects of AI? And that will make a very big difference to how employees are able to adopt their daily roles.
A great example there is, is, get on code by an obviously is something which was released about a year ago.
有一个很好的例子,就是“get on code”,显然是一年前发布的东西。
意思是说,“get on code”是一个在一年前发布的项目,是一个很好的例子。
It's called progress through better and better.
这被称为不断进步。
It's not getting to the point where we have metrics that show that for coding activities it's able to speed and do not half the coding that professional coders will do on a daily basis.
我们还没有取得这样的指标,即针对编码活动,能够加速并且不会比专业编码人员每天完成的编码量少一半。
And what that does is more than anything it improves the job satisfaction for others.
这样做最重要的是提高别人的工作满意度。
It takes away the work work and it takes away a lot of the stuff that is, you know, just depending on the aspect.
它消除了重复的工作,也消除了很多依赖于方面的东西。
Yeah, because the truth of the matter is while coding it's a great profession.
是的,事实上编码是一份非常好的职业。
There's a decent chunk of it which is repetitive and kind of just not that interesting.
其中有相当一部分是重复的,而且并不是那么有趣。
And so by having the AI be able to take care of that people are able to spend their time on the parts that they enjoy the most.
因此,通过使人工智能能够照顾那些让人们最喜欢的部分,人们可以花更多的时间在自己最喜欢的事情上。
And so you can think about being replicated across all the whole range of roles in an enterprise.
你可以想象自己被复制到企业中所有角色中。用于表达跨角色的复制。
And that I think should be priority number one for pretty much every enterprise because it's just almost an overgrace type of move to do that and allow productivity to flourish as a consequence.
So that's number one. Then the second thing that people can do is to develop their own AI based applications which are useful for their own enterprise.
因此,第一件事情是那样的。第二件事,人们可以做的是开发适用于自己企业的基于人工智能的应用程序。
This is where we should expect to see a lot of citizen developers or semi professional developers in their company having their creativity completely unleashed as AI actually reduces the barriers to being able to create applications.
这就是我们应该期望看到公司中有许多公民开发者或半专业开发者,他们的创造力在人工智能的帮助下完全得以释放,因为 AI 实际上降低了创建应用程序的障碍。
So you no longer need to be an expert in programming in C to be able to create Java or whatever it is to be able to go and create a website.
现在,您不再需要是C编程专家,就可以创建Java或其他网站。
You know, just happy when to be able to type into a prompt box and stuff will happen.
你知道的,当能够在提示框中输入内容时,就会感到很开心,这样一些事情就会发生。
And that will I think unleash another wave of productivity within companies.
我认为这将会在公司内释放出另一波生产力。
And then the third is actually just baking in AI into the core product itself which depending on the industry you're in has more or less applicability.
第三个是将人工智能直接嵌入核心产品中,具体适用程度取决于所处的行业。
If you're making washing machines at bridges, only a bit less because the core product is still a physical item that has to do certain things.
If you've got a product which is more software based or more services based potentially quite a lot of benefit could be driven by Intusio value proposition by making an AI.
And that's where I think we're going to see a need for people who know how to infuse AI into these applications of the big demand for that type of talent.
But there will also be opportunities that are more suited to startups.
但也会有更适合初创企业的机会。这意味着初创企业可以发现并利用这些机会来获得成功。
You know, just given that you've been involved with so many startups yourself, where do you see startup opportunities in this whole landscape?
你知道的,鉴于你自己已经参与了这么多创业公司,你认为在整个行业中有哪些创业机会?
Well, first of all, I very much hope there's going to continue to be vibrant opportunities to start on because that's where a lot of the innovation occurs in the first place.
首先,我非常希望未来还会有充满活力的创业机会,因为那是创新发生的地方。
I think that we're in a very fluid and dynamic phase of the development right at the start of this.
我认为我们正处于一个非常流动和动态的发展阶段,就在这个阶段的开头。
And so if you take the sort of three layers that you get, or maybe there's four layers, there's applications and there's a platform, then there's models, and then there's the infrastructure itself.
所以,如果您考虑到一些层次,或许有三个或四个层次,包括应用程序和平台层、模型层以及基础设施本身。
So I think, to a large extent, the infrastructure is where there are established players already.
我认为,基础设施方面已经有已经确立的玩家存在,这在很大程度上是如此。
There's a range of established players, and I think that's kind of that.
When you go to the models, there's a whole bunch of people who are doing interesting stuff there, all the way from the large, largest models being trained with the largest civic computers to people who are finding ways to shoe on those things onto edge silicon and getting a much smaller footprints.
We will see how the landscape evolves in terms of which models are applicable for which type of applications.
我们将看到在应用什么模型方面,景观将如何演变,以适用于不同类型的应用场景。
The platform area is one where there's an incredible amount of innovation, as I'm sure you see on a daily basis, a solid foundation.
平台领域是一个非常创新的领域,就像你每天所看到的那样,它拥有一个扎实的基础。
And there, the extraordinary thing that we're seeing right now is just things get developed, put out there on GitHub or wherever.
现在我们看到的非同寻常的事情是,代码被开发出来,然后放在GitHub或其他地方。
And with sort of minimal marketing, and sometimes not even yet formed as a company, you'll see vertical takeoff in terms of application.
即使没有做过多的营销,并且有时甚至不是一家正式的公司,也会看到应用垂直起飞的现象。
I often joke that these days, vertical is the new up until the right. And in the platform, you've just got such an enormous amount of activity right now, that it's fantastic to see the innovation. Not to know exactly how it's going to shake out until about a bit later, but I think there's a lot of energy going into that space, which is great. And then of course, there's the applications themselves and of course there's an equal lot of energy going on there. And there, I think, you know, it's going to vary a lot in terms of which areas are going to be fruitful and which areas are going to end up being more quantitized. Ultimately, I suspect that a lot of it will still come down to some basics, despite how exciting and how radical AI is. I think that there's going to be some, you know, usual basics, which will make a very big difference.
我经常开玩笑说,在现在这个时代,垂直排列已经取代了向右的方向。在这个平台上,目前有着如此巨大的活动量,非常令人振奋地看到了创新。虽然到后来会有些变化,但我认为现在有很多能量注入这个领域,这非常棒。当然,还有应用本身,而且在那里也有同样的能量。在这方面,我认为结果会有很大的差异,一些领域会非常有前途,而一些则会变得更加定量化。最终,我认为,尽管 AI 很激动人心和激进,但很多基础知识仍然是至关重要的。
And in this case, I think distribution is going to be a pretty important prerequisite to success. Distribution allows you to not only get out there, but also to start improving the application given that the feedback is actually an important determinant of success in AI-based apps. So I think that, you know, looking beyond all of the glamour, you know, basic distribution will, I think, turn out to be a pretty important aspect for us to start up to consider as they enter in the application space.
Now, I think that's a great framework to sort of think about it. So let's go to each of those layers, if you don't mind in a little more detail. On the applications side, you know, in some ways, the rules of the game haven't changed. I think what LLM and AI will broadly has done is create opportunities for a whole new class of applications. As you said, you could have a co-pilot for marketers, you could have a co-pilot for AEs, you could have a co-pilot for salespeople, you could have a co-pilot for physicians. I think there'll be a whole range of applications that get created. In that genre, there'll be applications that are broader.
You know, you can imagine applications that enable you to sort of impress the human time involved in processing insurance claims, processing healthcare claims. I think there's going to be a Cambrian explosion of application companies because this technology allows you to do some things that you couldn't have done before in the cloud with applications. And as you rightly said, I think distribution will be an important competitive advantage. But as will the ability to really understand the pain point and to define a product that you can get early adoption because the technology itself, you know, I'm sure there'll be elements of technology that matter.
But most application companies are going to use third-party platforms, models, and infrastructure. Is that how you think about it or are there other factors that application companies should be thinking about? Well, first of all, I think I'd really agree with you. In fact, I also use the phrase Cambrian explosion. And I think we're seeing it happening right now with an enormous flowering of ideas and innovation, which are based on the fact that there are standard models of platforms available. People are able to knock things together very, very quickly and get them out of there, which I think is fantastic.
The thing that you said is, I just want to kind of emphasize how important that is, which is getting adoption is going to be as important as it ever was. And in this case, the technology of the speed of writing applications is going to far outpace the ability for people to change their behavior if that's what they need to do to adopt. And I think thinking really hard about how the application could be easily entering to the existing behavioral patterns is actually a pretty important thing.
So that, for example, if COVID hadn't happened, video conferencing was on a penetration trajectory. It was interesting. But COVID happened and it just went through an enormous tech change. So now, video conferencing is something that is there in many people's lives on a daily basis. So it's easier to introduce AI features into video conferencing and know that it will be adopted because you don't have to rely on someone doing something they weren't doing before. If people were not doing video conferencing and you introduced AI into that, they'd have to first of all get used to video conferencing before they could have been able to do the AI.
And in the same way, I think we see the same thing when it comes to helping physicians, have tried and true ways of doing things and for good reason because they know that it works. And so getting a physician to benefit from AI, you have to think hard about making sure it's easily adopted in their natural workflow because they're not going to change their workflow.
Absolutely. It's the same for sales people, it's the same for finance people. It's the same for everybody in the end. It has to be in your existing workflow very close to it in terms of your existing behavioral pattern to be able to get adoption. I think that's well said.
As you were talking about video conferencing, I was reminded of the fact that one of the areas that's changed dramatically over the last three years, post-COVID has been sales. Most sales used to be, we always talk about sales as being a contact sport and face to face. And I think we've gone from that to probably 60, 70% of sales happening over video conferencing, team, zoom, and otherwise. And I think that's a huge opportunity for AI because there's data that you've been extracting, signal from you create a poll pilot for a salesperson or a Zoom call. It's very different from someone who's in base-to-base meeting, just as an example.
I completely agree with you. And I think that when you go through each of the function sales is a great one because of course there is still a base for burning the shoot at the moment, but a lot of it is now done through inside sales or what's through the remote. And that's a pattern that can very easily be influenced through AI or impacted through AI. And I think that you go through function by function, you'll find it's not the whole function, but there'll be elements of what people do during their day, which can very easily be prevented from the usage of AI. So that's the application layer.
But before we move on to platforms, are there other categories we got healthcare, education, and we talked about sales, anything else that Staddog for you is low-hanging fruit?
I think that the actual act of programming itself is the obvious one to mention here. We talked about earlier with GitHub Code Violet. Yep. But the changes that are happening there are just so rapid and fantastic. The combination of a Code Violet together with the capability of being your chat GPT, I've had even very, very experienced and renowned engineers saying that it's a magical experience when you do that because people find it liberating. It just helps them to stay in the flow longer and they're able to more create it as a result. Nice to hear about that.
When you see that joy from, let's face it, the average programmer is not generally the sort of person who's going to exhibit a whole pile of joy on a voluntary basis. But when you see that joy coming from that particular group of professionals, it really means something. I think that's well said.
In many ways, programming languages are the most structured form of communication. For the last 30, 40 years, we've seen increasing levels of abstraction. At some level, the ultimate form of abstraction or transform of based models are just the ultimate form of abstraction. There's a lot of structure needed that already exists to enable you to train the models on top of that. There is this meme that's going around that the next new programming language is the English language, which I don't know if in the end, that's actually going to be the case that the ping is opposed to the regular languages programming. But it's clear now that natural language being the English or branch or whatever, you don't need to be in the English. Is a pretty important mechanism also getting some tasks done as well?
Let's go on to the next layer, the platform layer. Can you unpack that a little bit? When you think about the platform layer, what is going on there? What are some of the interesting trends you're seeing?
I think it's a massive jump ball at this point, Ashu. I think that what we're seeing is even the way in which people are developing applications is evolving. Retrieval augmented generation is now becoming the kind of approach that a lot of people are using. Fine tuning was another approach that was being used. Maybe it's being replaced by RAID. It's kind of hard to know exactly how it's all going to evolve. I'd say that the thing that's happening is that people are very rapidly responding to signal that they're seeing. It's important to have a vector database so people are developing that. It's important to have long-term memories so people are developing that. I think that we're seeing this emerging as we speak as people are trying to evolve the best ways to respond to the signal they're seeing from application of their actual driving growth and take-on. It's hard to put a finger on it to be perfectly honest with you.
Even from an investment perspective, I'd say it must be very difficult for you because you're seeing these incredibly spiky signals of something that didn't exist last weekend. There's now suddenly spiked up out of nowhere and a lot of people are using it. Then two weeks later, maybe that's actually no longer relevant because some other approach is found to be superior. That is no longer that obvious the need for that being in the first place. It's a really chaotic but creative moment as well, I'd say. I think you're smart on it. It's both been exciting but also very frustrating to watch.
We've seen the explosion in vector databases. I was on a call earlier today with a Cedar Executive at AWS and their view was that, look, a vector databases, it's really just a search index with some specialized code and every hyperscaler has search indexes available and we'll just offer that. Like his view was, look, there's no way there'll be a standalone vector database six months or a year from now. In the fact that buying phone has five million revenues up from two million two weeks ago is completely relevant. Just take one example. Similarly, we've seen tons of activity around things, open source projects like Langt chain and others and it's really hard to tell which one of these is transient and which one would be subsumed actually by the underlying infrastructure provider itself. What will become a part of the infrastructure whether it's Microsoft or Google or the models as an API companies like OpenAI? We've been mostly, we think model observability is probably an enduring position to be in and you and I have talked about a rise in that category. So we definitely think that category stays, but a lot of the other stuff is just hard to tell what is enduring versus transient right now.
我们已经见证了向量数据库的爆炸式增长。今天早些时候,我与亚马逊 AWS 的一位高管进行了通话,他的观点是,向量数据库实际上只是一个带有一些专门代码的搜索索引,每个 hyperscaler 都可以提供搜索索引,我们也将提供。他认为,六个月或一年后,不会有一个独立的向量数据库。而现在的情况是,小米买手机的收入从两周前的两百万增加到了五百万元,这个例子完全具有参考价值。同样,我们也看到了像 Langt Chain 等开源项目的大量活动,现在很难确定其中哪些是短暂的,哪些会被基础架构提供商所吸收。将成为基础架构的一部分,无论是微软还是谷歌,还是像 OpenAI 这样的模型作为 API 的公司?我们认为,模型的可观察性可能是一个持久的位置,我们已经讨论过这个类别的崛起。所以,我们确信这个类别会存在下去,但其他的东西现在很难确定哪些是持久的,哪些是短暂的。
Completely agree. I mean, if you think back to the rise of the internet in the late 90s, there was a lot of chaotic innovation going on as well. But one thing that we are benefited from was the layered model of networking was relatively established both in theory and also in practice in terms of people that build networks. So while there was a lot of jockeying in the position, I don't think there was a whole host of arguing around that layer, the layers because that was kind of well known and everyone kind of competed within their layers and tried to vacationly cross a layer or two, but there was no debate about what was the layer. I think the reason why it's interesting now is because there's no defined equivalent of what the architecture should really look like and exactly what kind of workflow there should be for developers to developing AI based applications. So that is why we've got this enormous amount of flux right now.
Are there, you know, without getting into specific companies, are there one or two problem spaces within the platform layer that you think are enduring? I actually find that really hard to answer actually because one of the things is that it's still unclear to me exactly how the whole space of models is going to evolve when I was mentioning earlier that you've got everything all the way from these very large models trade on supercomputers down to models which are squeezed into to pitch. What may end up happening is just the combination that's required for any application may we change over time. There's one world view which says you just use the largest of the large models all the time and even if they're not using using it to its full maximum, that's going to be the most cost effective thing. There is another world view which says actually you should do everything that you can on the edge and only spike up into the burst into the powder you need to. Then there's other arguments which are actually maybe what you need is actually a cost of these things together to be able to really break through and make your application work well. Much like the human brain has very different elements to it. You know, maybe all those things need to be stitched together. So that's one of the reasons why I'm finding it hard to answer this question because we're obviously thinking about it too. So I think that there's going to be a platform that's going to be useful for the next little while. But then as the models themselves evolve, I think we're going to learn a lot now. Maybe the platform that was useful in 2023 and maybe 2034 becomes less relevant in 25 and 26. I just don't know. It may be that it induced. Maybe that it done.
That's well said. And I think as you rightly said, I think a lot of this world depends on how the ecosystem models and what is the, what are the different deployment models for models? Like do you, you know, do you use, as you said, do you use one large model, do you use multiple models? To what extent do you use open source models that you trade yourself at the against using foundation models as an API? What are you seeing in that, you know, it's gone.
It's been pretty wild. How much again, there's almost, I'm not sure if I would use a word came to an explosion, but there have been an explosion of activity in terms of people releasing models of their own, whether it's dolling from data bricks or folks like Alpaca from, you know, it seemed like they have, you know, used GPT, either train or GPT equivalent or a competitor.
There just seems a lot of, a lot of activity in the modern space as well is your sense that that space will be fragmented over time or will we see consolidation or just too early to tell? I suspect we're going to see some of the activity continuing, but that eventually will die down a bit, not completely it will die down a bit for the following reason, which is that ultimately I think it's quite important to make sure that these models don't lose to me.
And I think that it's hard to know how some of these smaller models and some of the models which are sort of retrofits of larger models can avoid that hallucination problem. So I think that once we think about the objective in terms of what we're going to achieve, which is useful models that are as inexpensive as possible, as really applicable as possible, and could be grounded in data to make sure they hallucinate the least. I think once you kind of start applying those parameters, I think the number of models that can actually do that for a given application has got to probably go down is what I'd say.
And has that caused challenges that result in concentrating of power amongst, you know, do these large elements become the next new operating systems? I don't know about operating systems, but you can almost even think about them as semi-conductive modes or most, that you have leading nodes that are useful for the most challenging type of problems and applications. And as they age and new nodes emerged, these nodes have come in minus one and minus two and minus three, which are made available for a broader range of things. And so I think that we can almost think about it that way. And once it dealing with it, n minus two and minus three model, which only a few years ago might have been the model that was advanced and able to do great things. You can see that being delivered through a greater number of mechanisms and people and companies. So it may just evolve in a slightly different way.
I don't think it's always just going to be that there's one massive model that moves a lot from one provider. But I've never thought of models in the context of semi-conductive nodes, but the analogy makes perfect sense. Just as you're trying to release the next GPU or GPU, you do need to let us know it. But for most A6, you're okay with n minus one and minus two and some cases of n minus three. That's right. There's going to be applications for which an n minus model will be good enough.
What advice would you have for start? Let me give you your own experience. Both as an investor and as a series of founder. Across these four layers of the stack, what would you advise founders to do? And of course, different founders would do different things. That's the beauty of the start of ecosystem. But are there any common themes or questions? Or what advice do you have at the highest level?
I mean, at the most abstract level, what I'd say is that it's more important than ever to find a durable problem. A problem that is going to be durable to the progress of the models themselves. And as the ability, if you solve it, to really be able to have the impact they expect it to have. So if you're talking about at the application level, I think the durable problems are going to be the ones which are reliant on having some form of data source that is hard to get. Because other kinds of problems may get solved more quickly than those sorts of problems tend to, I think, endure a bit longer.
More difficult in the platform there as we talk about. I think that you told your own observability. I think that's a great one. I would say that in general, all of the capabilities that you do with ensuring compliance of the model and prediction, go to the model of privacy, all of those areas, I think, are definitely going to endure for a very long time. So I'd say it's important to make sure you have a view of why you think your problem with your solving is going to endure a lump and up for you to actually see your company growing to scale.
The whole conversation so far, Bobby has been about LNM's. And in the context of the hype in the last six months, it would seem that LNM have subsumed all other variants or flavors of AI. And this is it.
And there are people who would argue that LNM's will sort of solve all kinds of problems, including what they don't solve today. I had a conversation with someone who said, well, LNM will solve partial differential equations in the coming years, which is not a class of problems they've been solved today. So that's one extreme. They say, hey, all AI research or all models will essentially become will be subsumed by LNM's.
And then there's an argument to be made that looked as one branch in the tree and there'll be other equally important branches that are sort of less developed today or a more in research that in virtualization and could be as important or perhaps even more in order to overcome.
Just give it your vantage point where you sort of both see the commercial world and sort of have a lens into Microsoft research. What's your take on this debate?
请尽量明白地表达您的看法,考虑商业世界和微软研究,您的观点是什么?您对这场辩论有何看法?
I think that LNM's is not the final answer. I think it's a remarkable capability and technology that's still got a long, long way to go. It is basically in some ways the first attempt of something that could be classified as an intelligence.
The concept of what is an intelligence is completely ill-defined and on note. But LNM's exhibit behaviors that would previously be classified as being intelligent. But it's not the final answer by any means.
I'll give you just a simple example, say your own son, which is that you mentioned that LNM's will be able to solve partial differential equations. Well, in actual fact, many problems that are currently only solved through PDEs are actually solved with all through LNM's protein-following, etc. And so you kind of see the path to that. Interesting. I did realize that. Yeah, that's right. And you see that at the same time, there's a decent chance of you putting a simple summation equation into the chat. It'll go wrong. So this is the same tool doing very sophisticated thing, getting it remarkably right and doing remarkably badly on something incredibly simple.
But it is, if you had classical or prior definitions of intelligence, there are some aspects of the PDEs that look like it's passed that test. Does it mean it's intelligent? No, it just means it's a capability that exhibits some aspects of what we might call intelligence.
Now, are there other systems that are going to be developed over time that will also exhibit certain aspects of what we call intelligence? Probably. I wouldn't say almost certainly. And so I think that while we're very focused on the LNM's right now, something else will show up. That's just the nature of innovation.
But we've still got a long way to go with LNM's in terms of the capability and what they could do. But I do think that it's important to continue to recognize that what actually is intelligence, what defines consciousness, what defines being a human. These are really completely unknown concepts.
And maybe one of the interesting, sort of unintended consequences of people looking at these models and seeing how they work and how they behave is actually might drive a better understanding of those core questions about the human species.
Fascinating. Definitely a fun time, both in technology and in AI more broadly. It's the most incredible time I do not recall anything like this in my career, as I said. It's just amazing every day as an adventure.
That's our show for now. You can find past episodes and subscribe to future ones. Whatever you get your podcasts, or at foundationcapital.com. And if you like the program, please leave us a review on Apple Podcasts. It really helps others to find the show.
这是我们现在的节目。您可以在过去的剧集中找到和订阅未来的剧集。无论您在哪里获取播客,或在 foundationcapital.com 上获取。如果您喜欢这个节目,请在 Apple Podcasts 上给我们留下评论。这真的有助于其他人找到这个节目。
BWS CEO is a production of foundation capital, an early stage venture capital firm, with over $3 billion in committed capital and 29 public companies to our name, including Netflix, Lending Club, TubeMobile and Sandra. That foundation capital, building companies is in our bones.
I'm Ashyo Garg, a general partner at foundation capital. I'm passionate about helping B2B entrepreneurs who are trying to solve hard problems. So if this podcast speaks to you, if you're a technical founder who's interested in scaling an enterprise startup into a massive business and scaling themselves into a true CEO, drop me a life.