The financial cost of running LLMs is astonishing. In response, the industry has rushed toward FinOps for AI, the practice of meticulously tracking and optimizing every dollar spent on computation.