Open-source toolkit for tracking, benchmarking, and optimizing resource usage of local LLMs
Users lack the tools to measure the resource usage and energy impact of local LLMs. Without visibility into resource consumption, it's impossible to make informed decisions about model selection, optimization, or sustainable AI practices.
Track resource usage of your local LLMs with visual dashboards. Monitor CPU, GPU, and memory usage in real-time.
Optimize performance of your local deployments with our toolkit. Compare trade-offs between model size, speed, and resource usage.