What frameworks does this skill use to evaluate evidence?

The skill applies recognized frameworks such as GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) and the Cochrane Risk of Bias (ROB) tools to assess evidence quality.

Can this skill help identify p-hacking?

Yes, it includes a statistical review checklist designed to detect p-hacking, suspicious p-value clustering, and improper multiple comparison corrections.

Is this skill intended for writing formal peer reviews?

While this skill is perfect for the underlying analysis, the documentation recommends using the specific 'peer-review' skill for the formal writing phase of a review.

How does it handle internal and external validity?

It performs a detailed validity analysis, checking randomization quality and confounding control (internal) as well as sample representativeness and ecological validity (external).

Scientific Critical Thinking

Name: Scientific Critical Thinking
Author: hyperbolic-c

byhyperbolic-c

•

Learning & Documentation

Evaluates the rigor of scientific claims and evidence quality using established frameworks like GRADE and Cochrane Risk of Bias.

The Scientific Critical Thinking skill provides a systematic approach for assessing the validity of research methodology, experimental designs, and statistical conclusions. It helps users identify potential biases—including cognitive, selection, and measurement biases—while evaluating the strength of evidence through standardized grading systems. Whether you are conducting a systematic review, preparing for peer review, or validating an experimental protocol, this skill ensures that scientific arguments are grounded in sound logic and robust data interpretation.

Key Features

01Comprehensive methodology and experimental design critique

02Systematic detection of research biases and confounding variables

03Evidence quality grading using GRADE and Cochrane frameworks

04Logical fallacy identification in scientific arguments and claims

051 GitHub stars

06Rigorous statistical analysis and p-value validity evaluation

Use Cases

01Critically analyzing research papers and study protocols for potential flaws

02Identifying researcher bias or statistical p-hacking in published literature

03Assessing evidence quality for systematic reviews or meta-analyses

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add hyperbolic-c/auto-writing scientific-critical-thinking

For use in Claude.ai and ChatGPT

Download Skill