Unpopular opinion: RAG is overrated, fine-tuning small models is the future

Everyone's building RAG pipelines but getting mediocre results. I switched to fine-tuning domain-specific 3B models and the quality difference is staggering. Here's my cost analysis.