fai-build-llm-evaluator

Build custom LLM evaluation metrics for groundedness, coherence, relevance, and domain-specific quality — enabling automated CI gates and production quality monitoring for RAG and GenAI systems.

Overview

Property	Value
Type	Skill
Folder	fai-build-llm-evaluator
WAF Alignment	N/A
Compatible Plays	N/A
Lines	167

Usage

Reference this skill in your fai-manifest.json:

{
  "primitives": {
    "skills": ["../../skills/fai-build-llm-evaluator/SKILL.md"]
  }
}

Source

• GitHub: skills/fai-build-llm-evaluator/SKILL.md

---

Auto-generated from the FrootAI primitive catalog.