Connect

OSDI Experiment Design

brycewang-stanfordbybrycewang-stanford
•
1.1k
•
Learning & Documentation

Designs and audits empirical evaluations for OSDI systems research papers to ensure rigorous baselines, realistic workloads, and robust measurement discipline.

OSDI Experiment Design helps researchers and systems engineers construct airtight evaluations tailored to the rigorous standards of top-tier systems conferences like OSDI and SOSP. The skill guides you in structuring evaluation sections around four foundational research questions, selecting and properly tuning competitive baselines, choosing realistic and stress-testing workloads, capturing distribution metrics like p99/p999 tail latencies, and condensing comprehensive experimental proof into a strict 12-page submission limit.

Key Features

01Optimizes figure layout, metric reporting grids, and space efficiency for 12-page paper budgets
02Establishes measurement rigor across throughput curves, tail latency distributions, and fault injection
031,086 GitHub stars
04Identifies workload realism risks and prevents flattering parameter choices
05Audits baseline selection to ensure state-of-the-art comparisons and prevent sandbagging
06Structures evaluation sections around clear, hypothesis-driven research questions (RQ1–RQ4)

Use Cases

01Designing experiment matrices and benchmark suites months before paper submission deadlines
02Pre-submission auditing of systems conference papers to catch reviewer-facing evaluation flaws
03Formatting and reporting tail latency, fault recovery timelines, and system overhead metrics