How are the evaluation scores calculated?

The skill uses a 5-point scale for individual dimensions and includes a Python script to calculate aggregate scores and visualize performance thresholds.

Does it support different academic disciplines?

Absolutely. It adjusts evaluation norms based on the field, such as focusing on reproducibility in STEM or argumentation in the Humanities.

What is the ScholarEval framework?

ScholarEval is a retrieval-augmented evaluation framework that assesses research ideas and papers based on soundness (empirical validity) and contribution (advancement of the field).

Can this skill help with journal submissions?

Yes, it benchmarks research quality against established publication standards to identify gaps and improve the chances of acceptance.

Can I generate diagrams with my evaluation?

Yes, it integrates with the scientific-schematics skill to automatically generate publication-quality diagrams and flowcharts for your documents.

Scholar Evaluation Framework

Name: Scholar Evaluation Framework
Author: Weiwei-Mao

byWeiwei-Mao

데이터 과학 및 ML

Evaluates scholarly work using the ScholarEval framework to provide structured assessments, quantitative scoring, and actionable feedback across research dimensions.

소개

The Scholar Evaluation skill implements the peer-reviewed ScholarEval framework to systematically assess the quality and rigor of academic papers, research proposals, and literature reviews. By analyzing eight core dimensions—ranging from problem formulation and methodology to analysis and scholarly writing—this skill provides researchers with objective quality scores and prioritized recommendations for improvement. It is particularly useful for benchmarking publication readiness, performing internal peer reviews, and ensuring that scientific work adheres to high standards of reproducibility and logical coherence.

주요 기능

Actionable feedback structure ranked by impact and feasibility
0 GitHub stars
Quantitative scoring using a standardized 5-point rubric and automated scripts
Discipline-specific evaluation modes for STEM, Social Sciences, and Humanities
Dimension-based assessment across 8 core scholarly quality areas
Integrated scientific schematic generation for visual data representation

사용 사례

Pre-submission quality check for journal articles and conference papers
Structured assessment of research proposals and grant applications
Educational feedback for student theses and dissertation chapters

소개

주요 기능

Actionable feedback structure ranked by impact and feasibility
0 GitHub stars
Quantitative scoring using a standardized 5-point rubric and automated scripts
Discipline-specific evaluation modes for STEM, Social Sciences, and Humanities
Dimension-based assessment across 8 core scholarly quality areas
Integrated scientific schematic generation for visual data representation

사용 사례

Pre-submission quality check for journal articles and conference papers
Structured assessment of research proposals and grant applications
Educational feedback for student theses and dissertation chapters