ESEC/FSE Paper Reproducibility

•
1.1k
•

Strengthens empirical reproducibility and open-science compliance for ESEC/FSE and software engineering research papers.

The ESEC/FSE Paper Reproducibility skill prepares academic submissions and camera-ready papers for stringent open-science standards required by leading software engineering venues like ACM ESEC/FSE. It systematically maps claims to artifact evidence, audits Data Availability statements to eliminate vague claims, pins data provenance (including repository SHAs, LLM prompt caching, and random seeds), and establishes honest reproducibility levels (turnkey, scripted, or descriptive). This skill is essential for researchers aiming to pass double-anonymous review requirements and secure ACM artifact evaluation badges without discrepancies between the paper and the code repository.

주요 기능

011,079 GitHub stars
02Pins provenance parameters including repository SHAs, random seeds, and LLM query caches
03Audits and refines Data Availability statements to meet double-anonymous peer review standards
04Evaluates and classifies reproducibility levels across turnkey, scripted, and descriptive tiers
05Conducts pre-submission and camera-ready consistency checks to eliminate numerical discrepancies
06Maps research question findings and statistical claims directly to executable artifact scripts

사용 사례

01Preparing camera-ready packages and permanent DOI-backed archives for ACM artifact badges
02Documenting provenance and reproducibility parameters for LLM-based and repository-mining software engineering studies
03Auditing research papers and artifacts prior to ESEC/FSE double-anonymous submission