Arman Eshraghi, CEO and Founder of Qrvey, hosts a podcast, “SaaS Scaled.” Our latest episode featured Devvret Rishi, CEO & Co-Founder at Predibase, the low-code AI platform for developers. You can watch or listen to the podcast here and we’ve covered some highlights of their discussion below.
Have you seen movement towards democratization of LLM and AI?
“Yes, the first thing I want to say is I think this movement is critically important. I think technologies become interesting when they are put in the hands of the average software developer. One of the most fundamental shifts that happened in the last two decades was the shift to the cloud. And when that actually became useful was when your average software engineer could spin up something in AWS. We lived in a whole new world, and it led to this proliferation of SaaS applications overall.
“So, the high-level context I want to say for your question is I think it’s a very important trend. But to answer directly, ‘Are we seeing it in AI?’ I would say it’s a two-part answer.
- We see a lot of interest.
- I don’t think we’ve yet seen that interest materialized into successful production applications.
“According to a survey conducted by Predibase, 85% of organizations are either actively using LLMs or have immediate plans to do so, but only 13% of those organizations have an LLM application running in production.
“Where we are as an industry today is a lot of people have seen that promise and that desire for a more democratized interface to machine learning, and they’re ready to invest the dollars in it. But the tooling in the platforms or whatever else it is that they need to fill that last mile have not caught up yet, because the vast majority of them have not put in an application to production just yet.”
Predictions for the future
“I think that the future is not going to look like a single large model, like ChatGPT, dominating the SaaS application landscape. I think it’s going to look like many, many task-specific, fine-tuned models that are each good at doing their own individual thing. One of my favorite customer quotes is, ‘Generalized intelligence is great, but I don’t need my point of sale system to recite French poetry.’
“And so, I don’t think we’re going to have these individual single models that dominate as much as we will have individual SaaS applications building and fine-tuning small LLMs that are task-specific.”
Will LLM apps replace or enhance SaaS apps?
“I think that this is true every time there is a large secular shift in technology, there’s going to be three types of organizations.
- Incumbents that integrate that new technology and build a better workflow
- New players that basically replace an existing incumbent because their technology is now their competitive advantage, and they’re able to operationalize it faster or they’re AI-native.
- A new class of products and technologies that are just unlike anything we’ve seen before because their underlying capabilities were not possible
“I think the future is going to break down into these three herds. And it’s important to note that folks that do not integrate these technologies over a 5-year time period will probably no longer be competitive.”