Journal of Software Reproducibility Guide

•
1.1k
•

Establishes experiment reproducibility, data and code availability, and artifact standards for submissions to the Journal of Software (软件学报).

The Journal of Software Reproducibility skill provides comprehensive guidance for researchers submitting computer science papers to the Journal of Software (《软件学报》, JOS). It helps authors avoid weak 'available upon request' statements by establishing clear data and code availability declarations, fixing environments with containerization and lockfiles, controlling random seeds, and locking dataset provenance or LLM API outputs. Designed to make empirical evaluations trustworthy and verifiable, it includes self-check checklists, directory structure templates, and specific advice on articulating reproducibility across methodology, experiments, and threats-to-validity sections.

Key Features

01Delivers actionable self-inspection checklists for repeatability and reproducibility readiness
02Establishes environment reproducibility through dependency pinning and containerization patterns
03Supplies standardized artifact repository structures and comprehensive README templates
04Drafts clear data and code availability statements to replace vague 'upon request' claims
05Provides dataset SHA pinning, snapshot handling, and LLM output caching strategies
061,086 GitHub stars

Use Cases

01Structuring an open-source artifact repository to accompany a Journal of Software paper submission
02Ensuring software repository mining and LLM benchmark experiments can be deterministically reproduced by reviewers
03Writing transparent data availability statements and documenting environmental configurations in empirical CS papers