Connect

SOSP Artifact Evaluation

brycewang-stanfordbybrycewang-stanford
•
1.1k
•
Learning & Documentation

Guides systems researchers through packaging, documenting, and managing post-acceptance artifact evaluations for SOSP to earn ACM reproducibility badges.

The SOSP Artifact Evaluation skill streamlines the post-acceptance artifact preparation and review workflow for the ACM Symposium on Operating Systems Principles (SOSP) and sysartifacts community. It helps authors tier OS-adjacent claims across containers, testbeds, and documented setups, structure standard evaluation packages with robust 'kick-the-tires' smoke tests, target ACM reproducibility badges (Available, Functional, Reusable), and effectively manage interactive HotCRP evaluator communications under tight deadlines.

Key Features

01Design and rehearsal workflows for sub-30-minute kick-the-tires smoke tests
02Standardized artifact repository layout with claims-to-experiment mapping
03Structured tiering strategy for complex OS/kernel-level experiments across VMs and testbeds
041,090 GitHub stars
05Step-by-step guidance for targeting ACM badges (Artifacts Available, Functional, and Reusable)
06Cooperative communication and revision tracking playbook for HotCRP evaluator interactions

Use Cases

01Targeting ACM reproducibility badges or the Distinguished Artifact award
02Structuring smoke-test scripts and CloudLab/containerized profiles for AE reviewers
03Packaging systems artifacts and benchmarks after receiving SOSP paper acceptance