Llm Evaluation

MCP Server

by gitwalter · Added 5mo ago

Claude
3

Install

git clone https://github.com/gitwalter/cursor-agent-factory

Add to Claude

claude mcp add llm-evaluation

Quick Setup Config

Copy & paste ready

~/Library/Application Support/Claude/claude_desktop_config.json (macOS) %APPDATA%\Claude\claude_desktop_config.json (Windows)

{
  "mcpServers": {
    "llm-evaluation": {
      "command": "npx",
      "args": [
        "@modelcontextprotocol/llm-evaluation"
      ]
    }
  }
}

Paste into your Claude Desktop config file, then restart Claude.

About

RAGAS evaluation setup, DeepEval integration, LangSmith evaluation runs, custom metrics, retrieval quality metrics, regression testing for LLM outputs

Tags

ai-mlpythonbashtestingapiskill

From Our Store

View all →
Toolkit

AI Coding Agent Blueprints

$49+

Workflow blueprints for AI coding agents

Claude Code

Claude Code Power User Kit

$39+

Advanced Claude Code skills and configurations