RAG as a Service : The Developer’s New Best Friend

Here’s the deal:

You would never ever in a million years build your own mail server — or CRM system — or in most cases, your own LLM.

Would you?

And yet, I see so many companies trying to build their own RAG pipelines.

Developers showing off their Langchain-powered RAG pipelines — without knowing the thousands of hours of pain that they are about to get into when they go to production.

No kidding — I just ran into a startup at a conference in Boston that literally launched their MVP using a Langchain powered RAG pipeline — and then days after — were sitting around yanking out Langchain from the tech stack.

This is terrible — instead of focusing their energy on product-market fit or other factors that would drive their business, they are now re-doing their tech stack — what a waste of developer energy — it’s almost like they are building their own LLM, rather than using the OpenAI API.

Here is a tip: RAG as a Service.