https://ferkakta.dev/tags/llm/Recent content in Llm on ferkakta.devHugoen-USCopyright fizz.Thu, 19 Mar 2026 12:00:00 -0500https://ferkakta.dev/rag-judging-layer/Thu, 19 Mar 2026 12:00:00 -0500https://ferkakta.dev/rag-judging-layer/<p>If you&rsquo;re building search over a knowledge base with an LLM — the pattern everyone calls RAG — you&rsquo;ve seen the standard pipeline: embed the user&rsquo;s question, find the closest chunks in a vector store, hand them to the LLM, get an answer. For documentation search or internal wikis, this works. The LLM is good at ignoring irrelevant context when the relevant stuff is also in the window.</p> <p>I&rsquo;m building a CMMC compliance platform, and I wanted a way to dogfood our own product against our own development process. Every commit we make to the platform touches some aspect of NIST 800-171 — access control, audit logging, encryption, configuration management. I wanted our pull requests to show which compliance controls each change addresses. Not as a compliance artifact (though it could become one), but as a consciousness-raising tool: every engineer on the team sees the compliance implications of their own code, every reviewer sees which controls are being strengthened. It&rsquo;s ambient education that turns into culture.</p>