> I could indeed invoke something that requires god-knows how many tensor cores, vram, not to mention the power requirements of all that hardware, in order to power a simple CRUD App.

The app doesn't need to be powered by the LLM for each request, it only needs to generate the code from a description once and cache it until the description changes.