Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Think about the last time you searched for something specific—maybe a product comparison or a technical fix. Ideally, you ...