ICSME Artifact Evaluation

•
1.1k
•

Packages and validates research artifacts for the IEEE ICSME Joint Artifact Evaluation Track and ROSE Festival to earn IEEE research badges.

Streamlines the preparation, documentation, and validation of software engineering research artifacts for the IEEE International Conference on Software Maintenance and Evolution (ICSME) Joint Artifact Evaluation Track and ROSE Festival (shared with SCAM and VISSOFT). It guides researchers in meeting IEEE badge requirements ('Open Research Object' and 'Research Object Reviewed'), structuring frictionless containerized environments, building paper-claim-to-script mappings, and properly transitioning from anonymized review packages to permanent DOI-backed archives.

Key Features

01Generates containerization and reproducible runtime setups for rapid evaluator testing
02Establishes dataset provenance tracking with commit SHAs, extraction dates, and model IDs
03Creates explicit claim-to-script mappings linking paper findings to execution commands
041,079 GitHub stars
05Targets IEEE Open Research Object and Research Object Reviewed badge criteria
06Differentiates requirements between double-anonymous review and camera-ready badge artifacts

Use Cases

01Documenting and archiving software repository mining datasets for reproducible evaluation
02Packaging software maintenance tools or analysis pipelines for ICSME, SCAM, or VISSOFT artifact tracks
03Converting double-anonymous submission materials into permanent, open-source Zenodo deposits