How do I verify if a HuggingFace model was imported correctly?

The skill provides a verification script that lists installed models and checks for the specific HuggingFace repository name in your local Ollama library.

Where can I find compatible models for this skill?

You can find compatible models on huggingface.co/models by filtering for the 'GGUF' library and 'Text Generation' task.

Can I track the download progress of a large model?

Yes, the skill includes implementation patterns for streaming the download progress, allowing you to monitor status changes, digests, and total file size.

Which quantization level is recommended for general use?

Q4_K_M is generally recommended as the default because it provides a good balance between model size and output quality.

How do I pull a model from HuggingFace using this skill?

You can pull a model by using the syntax 'hf.co/{organization}/{repository}:{quantization}' with the ollama.pull command provided in the skill patterns.

HuggingFace Model Importer

Name: HuggingFace Model Importer
Author: atrawog

byatrawog

데이터 과학 및 ML

Imports GGUF models directly from HuggingFace into Ollama for seamless local inference and experimentation.

소개

This skill enables Claude to bridge the gap between HuggingFace's vast GGUF model repository and the Ollama local inference engine. By leveraging the hf.co/ prefix, it allows for direct downloading of quantized models, automated progress tracking, and immediate integration into existing workflows. It is particularly useful for developers who need access to specialized, fine-tuned, or specific quantized versions of LLMs that are not available in the official Ollama library, providing a unified interface for model management and local text generation.

주요 기능

Support for various quantization levels from Q2_K to Q8_0
0 GitHub stars
Real-time download progress tracking and status monitoring
Automated inference and chat completion setup for imported models
Integrated model verification and metadata inspection tools
Direct GGUF imports from HuggingFace using the hf.co prefix

사용 사례

Automating the deployment of specific HuggingFace models for local AI applications
Testing different quantization levels to balance performance and hardware constraints
Accessing specialized fine-tuned models not available on the official Ollama library

소개

주요 기능

Support for various quantization levels from Q2_K to Q8_0
0 GitHub stars
Real-time download progress tracking and status monitoring
Automated inference and chat completion setup for imported models
Integrated model verification and metadata inspection tools
Direct GGUF imports from HuggingFace using the hf.co prefix

사용 사례

Automating the deployment of specific HuggingFace models for local AI applications
Testing different quantization levels to balance performance and hardware constraints
Accessing specialized fine-tuned models not available on the official Ollama library