Optimizes KINTSUGI batch processing by enforcing GPU-only SLURM scheduling to achieve up to 25x speedups over CPU fallback.
This skill provides specialized patterns and research-backed configurations for the KINTSUGI imaging pipeline on HPC environments like HiPerGator. It addresses the significant performance bottleneck found in BaSiC illumination correction by mandating GPU-only SLURM scheduling, effectively bypassing slow CPU-based SciPy DCT operations. By implementing round-robin account assignment and dynamic worker allocation within Snakemake, this skill ensures that large-scale CODEX datasets are processed with maximum throughput, even when jobs must wait in a GPU queue. It includes verified logic for resource management, error avoidance in flatfield caching, and strategic rule targeting to prevent GPU resource contention.
Características Principales
01Verified 25x speedup for stitching and 13x for full cycles
02Dynamic worker count allocation based on SLURM resources
031 GitHub stars
04Resource isolation strategies for registration and QC tasks
05GPU-only SLURM queuing logic for Snakemake workflows
06Round-robin multi-account GPU slot distribution
Casos de Uso
01Optimizing BaSiC illumination correction for large CODEX datasets
02Managing multi-account SLURM scheduling to maximize GPU utilization
03Scaling KINTSUGI batch processing on high-performance computing clusters