What happens if a cache file becomes corrupted?

The pattern is designed for graceful degradation. If a cache file is unreadable or contains invalid JSON, the system treats it as a cache miss and re-processes the file.

Does this pattern require a central database or index file?

No. By naming each cache file after its SHA-256 hash (e.g., {hash}.json), the system performs direct O(1) lookups on the filesystem without needing to maintain a separate index.

Will hashing large files slow down my application?

While hashing takes some time, this pattern uses 64KB chunked reading to remain memory-efficient. For expensive operations like OCR or LLM analysis, the time saved by hitting the cache far outweighs the hashing overhead.

How does content-hash caching differ from path-based caching?

Path-based caching fails if a file is renamed or moved. Content-hash caching uses the file's unique digital signature, making the cache valid regardless of the file's location on disk.

Content-Hash Cache Pattern

Name: Content-Hash Cache Pattern
Author: Fabio29T

byFabio29T

0•

Developer Tools

Implements a path-independent file caching system using SHA-256 content hashes to optimize expensive data processing tasks.

This skill provides a robust architectural pattern for caching the results of computationally expensive file operations such as PDF parsing, OCR, and image analysis. By using SHA-256 content hashes as unique identifiers rather than file paths, it ensures cache validity even when files are moved or renamed, while automatically invalidating entries when content changes. The pattern emphasizes the Single Responsibility Principle (SRP) by decoupling caching logic from core processing functions through a service layer wrapper, resulting in cleaner, more maintainable codebases.

Key Features

010 GitHub stars

02Automatic cache invalidation based on SHA-256 content verification

03Memory-efficient chunked hashing for large file support

04Path-independent caching that survives file renames and moves

05O(1) lookup efficiency using hash-named JSON storage

06Service layer separation to keep processing functions pure

Use Cases

01Optimizing PDF and text extraction pipelines to avoid redundant processing

02Building CLI tools with persistent --cache and --no-cache capabilities

03Reducing latency and costs in AI-driven image analysis or OCR workflows

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add fabio29t/everything-claude content-hash-cache-pattern

For use in Claude.ai and ChatGPT

Key Features

010 GitHub stars

02Automatic cache invalidation based on SHA-256 content verification

03Memory-efficient chunked hashing for large file support

04Path-independent caching that survives file renames and moves

05O(1) lookup efficiency using hash-named JSON storage

06Service layer separation to keep processing functions pure

Use Cases

01Optimizing PDF and text extraction pipelines to avoid redundant processing

02Building CLI tools with persistent --cache and --no-cache capabilities

03Reducing latency and costs in AI-driven image analysis or OCR workflows

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add fabio29t/everything-claude content-hash-cache-pattern

For use in Claude.ai and ChatGPT