Local AI on Windows FAQs

Question 1

What are the prerequisites for running Local AI?

Accepted Answer

You need Windows 10 or later and Docker Desktop for Windows to run Ollama, Open WebUI, and MCP.

Question 2

What kind of tasks can I perform with this setup?

Accepted Answer

You can run language models locally, manage models via MCP, interact with them through Open WebUI, and use example tools like the leave management system to check balances, apply for leave, and view history.

Question 3

How do I install Ollama on Windows?

Accepted Answer

Download the installer from the Ollama website, run it, and verify the service is running at http://localhost:11434.

Question 4

What is Local AI on Windows?

Accepted Answer

It's a self-hosted AI environment on Windows, combining Ollama for running language models, Open WebUI for chat interaction, and MCP for model management, offering privacy and control.

Question 5

How do I access and use the Leave Manager tool?

Accepted Answer

After setting up Ollama, cloning the project, and running Docker Compose, the Leave Manager (MCP Server) will be accessible on port 8000. Connect it to Open WebUI by adding http://localhost:8000/openapi.json as a tool.

Local AI on Windows

About

Key Features

Use Cases