How does it ensure the quality of collected content?

The skill uses a weighted scoring algorithm that evaluates code examples, explanation depth, practical value, and community metrics like stars and likes.

What format is the collected data stored in?

Data is exported in a standardized JSON structure containing cleaned content, extracted code snippets, metadata, and quality scores.

Which platforms does the Research Collector support?

It supports major developer hubs including GitHub, Stack Overflow, Dev.to, Medium, and Reddit through specialized API integrations.

Can I customize the collection thresholds?

Yes, you can configure quality thresholds in YAML, including minimum content length, code-to-text ratios, and required metadata elements.

Does it handle API rate limits and errors?

Yes, it features an adaptive collection strategy with intelligent retries, dynamic frequency adjustment, and multi-threaded concurrency management.

AI Research Collector

Name: AI Research Collector
Author: lazy-tortoise

bylazy-tortoise

ウェブスクレイピングとデータ収集

Aggregates and preprocesses high-quality AI programming tips and best practices from major developer platforms.

概要

The Research Collector Skill is an automated data gathering tool designed to harvest AI coding insights from top-tier sources including GitHub, Stack Overflow, and Dev.to. It utilizes intelligent filtering algorithms to score content quality based on engagement and practical value, ensuring that only the most relevant snippets, tutorials, and discussions are curated. By streamlining the collection and preprocessing of technical knowledge, it serves as a foundational layer for developers building AI-driven coding assistants or maintaining internal engineering knowledge bases.

主な機能

0 GitHub stars
High-performance concurrent processing with built-in caching and rate limiting
Intelligent quality filtering based on community engagement and code density
Automated text cleaning and syntax-aware code snippet extraction
Multi-platform integration with GitHub, Stack Overflow, Dev.to, and Reddit
Configurable search parameters including stars, scores, and temporal relevance

ユースケース

Gathering high-quality training data for fine-tuning coding models
Building a curated database of framework-specific AI coding best practices
Automating technical research for emerging AI programming patterns

概要

主な機能

0 GitHub stars
High-performance concurrent processing with built-in caching and rate limiting
Intelligent quality filtering based on community engagement and code density
Automated text cleaning and syntax-aware code snippet extraction
Multi-platform integration with GitHub, Stack Overflow, Dev.to, and Reddit
Configurable search parameters including stars, scores, and temporal relevance

ユースケース

Gathering high-quality training data for fine-tuning coding models
Building a curated database of framework-specific AI coding best practices
Automating technical research for emerging AI programming patterns