How do I add multiple traces at once?

You can use the 'add-batch' command along with a text file containing trace IDs to upload multiple entries to a specific dataset simultaneously.

What is the primary use of this skill?

It allows you to manage Langfuse datasets, which are essential for testing, evaluating, and benchmarking LLM applications directly from your development environment.

How do I view my existing Langfuse datasets?

By running the 'list' command through the provided dataset manager script, you can view all current datasets associated with your Langfuse project.

Does this require a Langfuse account?

Yes, you need a Langfuse account and must configure your LANGFUSE_PUBLIC_KEY, LANGFUSE_SECRET_KEY, and LANGFUSE_HOST in your environment variables.

Can I use this for regression testing?

Absolutely. This skill is designed to help you curate regression sets of failing traces to ensure that updates to your models or prompts do not reintroduce old bugs.

Langfuse Dataset Management

Name: Langfuse Dataset Management
Author: mberto10

bymberto10

0•

分析と監視

Manages Langfuse datasets and traces to streamline LLM application evaluation and regression testing.

This skill enables seamless integration with Langfuse for managing datasets used in LLM evaluation, experimentation, and regression testing. It allows developers to programmatically create datasets, curate golden sets, and add traces—either individually or in batches—directly within their Claude Code environment. By centralizing dataset management, it facilitates the creation of high-quality benchmarks to monitor model performance and ensure consistent output quality over time.

主な機能

01Individual and batch trace addition to specific datasets

02Curation of golden sets and regression test cases

03Support for expected score assignment to dataset traces

04Dataset item inspection and listing via CLI

050 GitHub stars

06Programmatic creation and management of Langfuse datasets

ユースケース

01Building a regression suite from failing production traces to prevent future bugs

02Creating a 'golden set' of high-quality LLM outputs for benchmarking

03Automating the collection of specific traces for LLM fine-tuning or evaluation

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add mberto10/mberto-compound langfuse-dataset-management

For use in Claude.ai and ChatGPT

Download Skill