Back to Browse

Probity MCP Server

Developer ToolsLow Risk10.0MCP RegistryLocal
Free

Server data from the Official MCP Registry

Offline, read-only tools that verify AI claims against evidence and replay conformance vectors.

About

Offline, read-only tools that verify AI claims against evidence and replay conformance vectors.

Security Report

10.0
Low Risk10.0Low Risk

Valid MCP server (1 strong, 1 medium validity signals). No known CVEs in dependencies. Package registry verified. Imported from the Official MCP Registry.

13 files analyzed · 1 issue found

Security scores are indicators to help you make informed decisions, not guarantees. Always review permissions before connecting any MCP server.

Permissions Required

This plugin requests these system permissions. Most are normal for its category.

file_system

Check that this permission is expected for this type of plugin.

How to Install

Add this to your MCP configuration file:

{
  "mcpServers": {
    "io-github-probityai-agent-evidence-mcp": {
      "args": [
        "agent-evidence-mcp"
      ],
      "command": "uvx"
    }
  }
}

Documentation

View on GitHub

From the project's GitHub README.

Probity

Open tools that check claims about AI agents against evidence you pinned: an offline verifier, an observer that records agent runs, and the tools around them. The conformance corpus, vocabulary and admission rules live in https://github.com/probityai/agent-evidence-vectors.

It's for auditors, incident reviewers and relying parties who need a decision they can replay, and for tool authors who want their records checked the same way.

Install the released verifier: uv add agent-evidence-verify==0.5.1, or pip install agent-evidence-verify==0.5.1.

Verified by Probity (github.com/probityai/probity). The probityai command line is released: uv add probityai==0.1.1, or pip install probityai==0.1.1.

Quick start

Check a sample claim with the released package. You need Python 3.12 or newer and uv; there is nothing to clone:

samples="$(uvx --from agent-evidence-verify==0.5.1 python -c 'import importlib.resources as r; print(r.files("agent_evidence_verify") / "samples")')"
uvx agent-evidence-verify==0.5.1 "$samples/case.json" --policy "$samples/policy-june.json"

It prints a decision packet that opens:

Probity decision packet v1
Case: "source-coverage-demo"
Claim: source_text_coverage/v1
Decision: contradicted
Reason: selected_span_missing_from_record

A selected passage is in the source capture but missing from the stored report. Swap in policy-april.json for not_established, or case-complete.json with policy-complete.json for supported.

Status

Two name families, on purpose. agent-evidence-* is the neutral evidence layer: formats and checks any tool can pin without adopting ours. probity* is the product built on it. Each package keeps its own version and release tag, <name>-v<version>.

Evidence layer

packagewhat it isversion
agent-evidence-mcpagent-evidence-mcp downloadsoffline, read-only MCP server: checks a claim against evidence bytes and replays the conformance vectors0.2.5
agent-evidence-observeragent-evidence-observer downloadsrecords what an agent run did as pinned evidence0.2.0

Product

packagewhat it isversion
probityaiprobityai downloadsthe probityai command; probityai verify today0.1.1
agent-evidence-verifyagent-evidence-verify downloadsoffline verifier: supported, contradicted or not established0.5.1
probity-ratchetprobity-ratchet downloadssigned, replayable receipts for improving an agent against held-out cases0.4.0
probity-ratchet-casesprobity-ratchet-cases downloadsagent task cases graded on final state: a simulated company, tool faults, exact graders0.2.0
probity-effectskeeps one effect per agent tool call when its reply is lost, records the trail, tests it against lost-reply scenarios0.2.0
evaluator-replay-kitnot on PyPIreplays a lab's agent action record and flags a changed or missing step0.1.0

Install any of them pinned to the version shown: pip install <package>==<version>. evaluator-replay-kit installs from its tag: pip install "git+https://github.com/probityai/probity@evaluator-replay-kit-v0.1.0#subdirectory=packages/evaluator-replay-kit".

The Claude Code and Cursor plugins ship from harnesses/agent-evidence-plugins.

Work on the repository

uv sync --all-packages --all-extras
uv run python -m pytest

Documentation

pageread it for
agent-evidence-verifythe verifier, its adapters and its recipes
Repository layoutthe workspace, the probityai command seam, CI and releases
Agent instructionscommands to run before a change
Contributingreporting a problem and opening a pull request

License

Apache-2.0, per directory: each member carries its own LICENSE.

Reviews

No reviews yet

Be the first to review this server!