Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
A production-ready Python development environment template using modern tools: uv for blazing-fast package management, Ruff for lightning-fast linting and formatting, ty for fast and reliable type ...