How are the evaluation scores calculated?

The skill uses a 5-point scale for individual dimensions and includes a Python script to calculate aggregate scores and visualize performance thresholds.

Does it support different academic disciplines?

Absolutely. It adjusts evaluation norms based on the field, such as focusing on reproducibility in STEM or argumentation in the Humanities.

What is the ScholarEval framework?

ScholarEval is a retrieval-augmented evaluation framework that assesses research ideas and papers based on soundness (empirical validity) and contribution (advancement of the field).

Can this skill help with journal submissions?

Yes, it benchmarks research quality against established publication standards to identify gaps and improve the chances of acceptance.

Can I generate diagrams with my evaluation?

Yes, it integrates with the scientific-schematics skill to automatically generate publication-quality diagrams and flowcharts for your documents.

Scholar Evaluation Framework

Name: Scholar Evaluation Framework
Author: Weiwei-Mao

byWeiwei-Mao

0•

数据科学与机器学习

Evaluates scholarly work using the ScholarEval framework to provide structured assessments, quantitative scoring, and actionable feedback across research dimensions.

The Scholar Evaluation skill implements the peer-reviewed ScholarEval framework to systematically assess the quality and rigor of academic papers, research proposals, and literature reviews. By analyzing eight core dimensions—ranging from problem formulation and methodology to analysis and scholarly writing—this skill provides researchers with objective quality scores and prioritized recommendations for improvement. It is particularly useful for benchmarking publication readiness, performing internal peer reviews, and ensuring that scientific work adheres to high standards of reproducibility and logical coherence.

主要功能

01Actionable feedback structure ranked by impact and feasibility

020 GitHub stars

03Quantitative scoring using a standardized 5-point rubric and automated scripts

04Discipline-specific evaluation modes for STEM, Social Sciences, and Humanities

05Dimension-based assessment across 8 core scholarly quality areas

06Integrated scientific schematic generation for visual data representation

使用场景

01Pre-submission quality check for journal articles and conference papers

02Structured assessment of research proposals and grant applications

03Educational feedback for student theses and dissertation chapters

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add weiwei-mao/hydrology-skills scholar-evaluation

For use in Claude.ai and ChatGPT

Download Skill