Monitors GPU performance, VRAM usage, and inference metrics for local Ollama models.
The Ollama GPU Monitor skill provides specialized tools for managing hardware performance during local AI model execution. It allows users to track NVIDIA and AMD GPU status, monitor real-time VRAM consumption, verify model loading status via the Ollama API, and calculate precise inference performance metrics such as tokens per second. This skill is essential for developers debugging slow inference, managing resource constraints, or benchmarking different LLMs within a Bazzite AI environment.
主な機能
01NVIDIA and AMD GPU status and utilization tracking
02Detailed inference performance metrics including tokens per second
03Automated health checks for hardware and Ollama server status
040 GitHub stars
05Real-time VRAM monitoring for loaded Ollama models
06Troubleshooting guides for OOM errors and slow inference
ユースケース
01Optimizing model selection based on available VRAM and performance
02Debugging why an LLM is falling back to CPU instead of using the GPU
03Benchmarking different quantization levels for inference speed
