GPT-OSS & vLLM Troubleshooter

About

This skill provides specialized guidance for developers working with GPT-OSS models and vLLM serving infrastructure. It streamlines the debugging process for complex 'openai_harmony.HarmonyError' messages by distinguishing between server-side vLLM issues and client-side application errors. Users can map specific token mismatch patterns to known GitHub issues, access critical vLLM server configuration flags for tool calling, and follow a systematic workflow for updating model configuration files and verifying server health to ensure reliable function calling performance.

Key Features

• Identifies the root source of openai_harmony.HarmonyError within vLLM layers
• Maps token mismatch errors to specific vLLM and GPT-OSS GitHub issues
• 0 GitHub stars
• Provides verified vLLM server startup flags for tool-call parsing
• Guides updates for model generation_config.json files from HuggingFace
• Offers a structured diagnostic workflow for empty tool_calls arrays

Use Cases

• Configuring vLLM servers to support tool calling with GPT-OSS-20b/120b
• Fixing 'Unexpected token' errors during vLLM model inference
• Resolving compatibility issues between vLLM and frameworks like llama-stack