Implements high-performance, content-based caching for expensive file processing tasks using SHA-256 hashing.
This skill provides a robust pattern for caching results of computationally expensive file operations like PDF parsing, OCR, and image analysis. By using SHA-256 hashes of file contents as cache keys rather than file paths, it ensures that moved or renamed files still result in cache hits while any content modification triggers automatic invalidation. It emphasizes clean architecture through service layer separation and O(1) file-based lookups, making it ideal for CLI tools and batch processing pipelines where performance, reliability, and pure function maintenance are critical.
Key Features
01SHA-256 content-based hashing for path-independent cache hits
02Automatic cache invalidation upon file content changes
03O(1) lookup efficiency using hash-named JSON storage without index files
04Service layer separation to maintain pure processing functions
05Graceful corruption handling with automatic re-processing on cache misses
060 GitHub stars
Use Cases
01Building CLI tools that require robust --cache and --no-cache functionality
02Developing PDF or image processing pipelines with high computational overhead
03Optimizing batch data extraction where identical files appear across different directories
