How do I verify if a HuggingFace model was imported correctly?

The skill provides a verification script that lists installed models and checks for the specific HuggingFace repository name in your local Ollama library.

Where can I find compatible models for this skill?

You can find compatible models on huggingface.co/models by filtering for the 'GGUF' library and 'Text Generation' task.

Can I track the download progress of a large model?

Yes, the skill includes implementation patterns for streaming the download progress, allowing you to monitor status changes, digests, and total file size.

Which quantization level is recommended for general use?

Q4_K_M is generally recommended as the default because it provides a good balance between model size and output quality.

How do I pull a model from HuggingFace using this skill?

You can pull a model by using the syntax 'hf.co/{organization}/{repository}:{quantization}' with the ollama.pull command provided in the skill patterns.

HuggingFace Model Importer

Name: HuggingFace Model Importer
Author: atrawog

byatrawog

数据科学与机器学习

Imports GGUF models directly from HuggingFace into Ollama for seamless local inference and experimentation.

关于

This skill enables Claude to bridge the gap between HuggingFace's vast GGUF model repository and the Ollama local inference engine. By leveraging the hf.co/ prefix, it allows for direct downloading of quantized models, automated progress tracking, and immediate integration into existing workflows. It is particularly useful for developers who need access to specialized, fine-tuned, or specific quantized versions of LLMs that are not available in the official Ollama library, providing a unified interface for model management and local text generation.

主要功能

Support for various quantization levels from Q2_K to Q8_0
0 GitHub stars
Real-time download progress tracking and status monitoring
Automated inference and chat completion setup for imported models
Integrated model verification and metadata inspection tools
Direct GGUF imports from HuggingFace using the hf.co prefix

使用场景

Automating the deployment of specific HuggingFace models for local AI applications
Testing different quantization levels to balance performance and hardware constraints
Accessing specialized fine-tuned models not available on the official Ollama library

关于

主要功能

Support for various quantization levels from Q2_K to Q8_0
0 GitHub stars
Real-time download progress tracking and status monitoring
Automated inference and chat completion setup for imported models
Integrated model verification and metadata inspection tools
Direct GGUF imports from HuggingFace using the hf.co prefix

使用场景

Automating the deployment of specific HuggingFace models for local AI applications
Testing different quantization levels to balance performance and hardware constraints
Accessing specialized fine-tuned models not available on the official Ollama library