Which AI services does the ai-core skill support?

It provides configurations and best practices for LiteLLM (proxy), vLLM and Ollama (inference), LangFuse (observability), Qdrant (vector DB), and n8n (automation).

Does it include monitoring for AI responses?

Yes, it integrates LangFuse observability into the stack, allowing you to trace generations, monitor latency, and score model outputs for accuracy.

Can I use this skill for GPU-accelerated inference?

Yes, it includes specific Docker configurations for vLLM with AMD/ROCm support and optimized GPU memory utilization settings.

How does it handle model routing?

It utilizes LiteLLM to create a unified API endpoint that can route requests to local models (Ollama/vLLM) or external providers like OpenAI and Anthropic with automatic fallbacks.

AI Core Command Center

Name: AI Core Command Center
Author: Lobbi-Docs

byLobbi-Docs

0•

Data Science & ML

Deploys and manages a self-hosted AI infrastructure stack including LLM proxies, inference servers, vector databases, and observability tools.

The AI Core skill provides a comprehensive framework for orchestrating the Ahling Command Center's AI layer. It enables developers to implement a robust, local AI pipeline using LiteLLM for model routing, vLLM and Ollama for high-performance inference, Qdrant for vector search, and LangFuse for end-to-end observability. By providing standardized Docker Compose configurations and implementation patterns, this skill simplifies the complexity of managing multiple AI services, ensuring a scalable and observable environment for building LLM-powered applications and automated workflows.

Key Features

01Unified model routing and load balancing via LiteLLM proxy

02High-throughput inference configuration for vLLM and Ollama

03Comprehensive LLM observability and tracing with LangFuse

04AI-driven workflow automation and event handling with n8n

05Vector database management and embedding storage using Qdrant

060 GitHub stars

Use Cases

01Setting up a private, self-hosted AI infrastructure for secure data processing

02Building a multi-model gateway with automatic fallbacks and performance monitoring

03Creating automated AI agents that interact with smart home or enterprise APIs via n8n

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add lobbi-docs/claude ai-core

For use in Claude.ai and ChatGPT

Download Skill