SIGMETRICS Reproducibility

•
1.1k
•

Strengthens ACM SIGMETRICS paper reproducibility through comprehensive proof derivations, seeded simulations, trace provenance, and claim-to-evidence mapping.

The SIGMETRICS Reproducibility skill prepares academic submissions and POMACS camera-ready papers for rigorous artifact evaluation and peer review. In performance evaluation research, reproducible artifacts encompass full mathematical derivations, seeded deterministic simulators, trace processing scripts, and empirical overlays matching analytic bounds. This skill audits papers for claim-to-evidence consistency, eliminates vague data availability statements, pins determinism and hardware parameters, and establishes turnkey reproducibility so reviewers can independently verify findings.

Key Features

01Pins simulation determinism, seed logging, warm-up handling, and trace data provenance
021,090 GitHub stars
03Audits paper claims to eliminate 'available on request' ambiguity in favor of concrete, verifiable artifacts
04Enforces overlays of analytic predictions directly against empirical simulation curves
05Generates structured audit reports classifying reproducibility levels into turnkey, scripted, or descriptive
06Maps every paper theorem, bound, and metric directly to appendix proofs, seeded simulation runs, or trace scripts

Use Cases

01Validating alignment between theoretical queueing/scheduling proofs and empirical trace simulation results
02Pre-submission audit to verify that all figures, bounds, and tables in an ACM SIGMETRICS paper are completely reproducible
03Camera-ready artifact preparation for POMACS and ACM Artifact Evaluation badge submissions