Connect

IEEE VIS Reproducibility Auditor

brycewang-stanfordbybrycewang-stanford
•
1.1k
•
Learning & Documentation

Strengthens open-science practices, supplemental artifact archives, and reproducibility claims for IEEE VIS and TVCG academic submissions.

IEEE VIS Reproducibility Auditor helps researchers prepare rock-solid supplemental packages and open-science disclosures for IEEE VIS conference submissions and TVCG journal camera-ready papers. It audits open-materials statements, verifies claim-to-figure provenance, evaluates study preregistration status, and establishes clear degrees of reproducibility (turnkey, scripted, or descriptive). By identifying missing environment pins, unshared baseline datasets, or discrepancies between manuscript figures and analysis scripts, this skill ensures manuscripts withstand strict reviewer artifact checks and qualify for the Graphics Replicability Stamp.

Key Features

01Audits open-materials statements to eliminate vague 'available upon request' placeholders
021,090 GitHub stars
03Structures preregistration guidelines to separate confirmatory from exploratory perceptual study results
04Pins provenance across datasets, rendering pipelines, seeds, and hardware runtime environments
05Maps every paper figure, quantitative claim, and study finding to verifiable supplemental scripts and logged data
06Prepares double-blind compliant archives for submission and DOI-backed permanent releases for camera-ready TVCG papers

Use Cases

01Preparing the open-practices disclosure and Graphics Replicability Stamp application for camera-ready TVCG papers
02Verifying that empirical perceptual study findings match raw participant data and preregistered hypotheses
03Auditing supplemental code, datasets, and analysis notebooks prior to initial IEEE VIS submission