CompletionKit

connects

completionkit.com

Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.

https://completionkit.com/mcpWebsiteNo authMCP 2025-03-26v0.28.42last checked 24 Aug 2026spoke MCP on 2 of 2 checks (30 days)initialize in 758 ms

How to authenticate

Checked against the endpoint by our probe on 24 Aug 2026. These are the capabilities the server advertises, not a prediction about any particular client.

Scheme	No auth
Protected-resource metadata	✕Not found Without it a client has to guess where the authorization server lives.
Anonymous access	Handshake succeeds; 54 tools listable

What the probe found

No CORS headers for browser-based clients

A cross-origin preflight came back without Access-Control-Allow-Origin, so the endpoint is reachable from native clients only — code running in a web page is stopped by the browser before a request is ever sent.

Tools

agreements_createagreements_listdatasets_createdatasets_create_from_urldatasets_deletedatasets_getdatasets_listdatasets_updatejudges_comparejudges_replaymetric_groups_createmetric_groups_deletemetric_groups_getmetric_groups_listmetric_groups_updatemetric_versions_dismissmetric_versions_listmetric_versions_publishmetrics_createmetrics_deletemetrics_getmetrics_listmetrics_suggest_variantsmetrics_updatepromptfoo_importprompts_createprompts_deleteprompts_getprompts_listprompts_publishprompts_suggest_improvementprompts_updateprovider_credentials_createprovider_credentials_deleteprovider_credentials_getprovider_credentials_listprovider_credentials_updateresponses_getresponses_listruns_createruns_deleteruns_generateruns_getruns_listruns_regraderuns_rerunruns_retry_failuresruns_updatetags_createtags_deletetags_gettags_listtags_updateusage_get

Contract history

24 Aug 2026v0.28.42first recorded contract

Get alerted when this contract changes

Depend on this server? Leave an email and get a message when a probe records a change — a tool removed, an argument newly required, an enum narrowed. Alerts are being built; signing up is what tells us to hurry.

Prefer a feed reader? This page's contract changes are also an Atom feed.

Status badge

Status for a README, from the last probe — cached an hour, so up to seven hours behind the endpoint. Links back to this page.

[![MCP status](https://mcpi.app/servers/completionkit/badge.svg)](https://mcpi.app/servers/completionkit)