AI LLM Development & Engineering
Guides the full lifecycle of large language model systems from architecture selection and dataset design to production deployment and monitoring.
This skill provides a comprehensive framework for building and scaling robust LLM applications using modern industry standards. It offers deep technical guidance on choosing between RAG, fine-tuning, and agentic workflows, supported by decision matrices, production-ready templates, and rigorous evaluation patterns. From optimizing high-throughput serving with vLLM to implementing multi-layered safety guardrails, it equips developers with the necessary patterns to move from prototype to production-grade AI systems while avoiding common anti-patterns like hallucination and context overload.
主な機能
01Production checklists for pre-deployment validation and safety
02Copy-paste templates for CoT, ReAct, and multi-agent workflows
0322 GitHub stars
04Advanced evaluation patterns including LLM-as-judge and multi-metric testing
05Architecture decision matrices for RAG, agents, and fine-tuning
06Inference optimization guidance for vLLM, quantization, and high-throughput serving
ユースケース
01Setting up LLMOps pipelines for model monitoring, drift detection, and evaluation
02Designing and implementing a hybrid RAG pipeline with reranking and contextual retrieval
03Developing agentic workflows using LangGraph, CrewAI, or reflection patterns