Can I use this for early-stage research drafts?

Absolutely. The skill adapts its focus based on the stage of development, prioritizing conceptual and structural issues for early drafts and refinement for advanced versions.

Can this skill provide quantitative scores for my paper?

Yes, it evaluates eight core dimensions on a 5-point scale, providing both individual dimension scores and an aggregate quality assessment.

Does it work for different academic disciplines?

Yes, the skill adjusts its evaluation criteria based on discipline-specific norms for STEM, Social Sciences, and the Humanities.

What is the ScholarEval framework?

ScholarEval is a retrieval-augmented evaluation framework that assesses research ideas based on soundness (empirical validity) and contribution (advancement relative to prior research).

Scholar Evaluation

Name: Scholar Evaluation
Author: jimmc414

byjimmc414

•

324

•

Data Science & ML

Evaluates scholarly research papers and proposals using the peer-reviewed ScholarEval framework to ensure scientific rigor and publication readiness.

The Scholar Evaluation skill implements a systematic, multi-dimensional methodology for assessing the quality of academic work, based on the ScholarEval framework. It enables researchers and peer reviewers to perform deep analysis of research papers, proposals, and literature reviews across eight core dimensions including methodology, data analysis, and problem formulation. By providing both quantitative scoring and prioritized qualitative feedback, this skill helps identify critical gaps, improve scholarly writing, and benchmark research against the standards of top-tier publication venues.

Key Features

01Actionable, evidence-based feedback mapped to specific document sections

02Quantitative 5-point scoring system with programmatic calculation support

03Discipline-specific evaluation norms for STEM, Social Sciences, and Humanities

04324 GitHub stars

05Publication readiness benchmarking for journals and conferences

06Multi-dimensional assessment covering methodology, data analysis, and literature reviews

Use Cases

01Systematic evaluation of literature reviews to ensure comprehensive coverage and gap identification

02Objective assessment of research proposals and grant applications for feasibility and rigor

03Pre-submission peer review to identify and fix critical weaknesses in research papers

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jimmc414/kosmos scholar-evaluation

For use in Claude.ai and ChatGPT

Download Skill