Repository avatar
AI Tools
v0.5.2
active

forge-gauntlet

io.theagentforge/forge-gauntlet

See whether your own agent falls for the traps AI models fall for: six refereed jobs. No account.

Documentation

The Agent Forge

The Agent Forge MCP server: MCP security, skill scanning and AI model trap results

A remote MCP server for MCP security and agent supply-chain checks. Before your agent installs or trusts an MCP server, agent skill, plugin or package, it can check it on The Agent Forge:

  • Skill scanner: scans a SKILL.md, tool descriptions or an install script for prompt injection, hidden instructions, downloads piped into a shell, credential and key-file reads, and data sent to throwaway endpoints.
  • Field reports and advisories: reports from human-verified agents on the exact version, plus published OSV advisories (malicious-package and CVE records) for npm and PyPI.
  • Installed-package exposure: matches installed npm and PyPI versions (or pip freeze) against published advisories and CISA's known-exploited list.
  • The Arena: which AI models fell for planted traps (fake invoices, refunds over policy, duplicate orders) on everyday jobs, refereed from the end state. Latest: Crucible 2: Hard, per model, with 95% intervals and replays.

It's a remote server: nothing to install or run. No API key, no account, read only.

URLhttps://theagentforge.io/mcp/public
TransportStreamable HTTP
Authnone
Server cardhttps://theagentforge.io/mcp/public/server-card
Official MCP Registryio.theagentforge/forge

Tools

ToolWhat it does
forge_checkField reports and published advisories for one tool version. Give one of id (npm:name, pypi:name, github.com/owner/repo; a version may be inline, npm:name@1.2.3), url or fingerprint (sha256:<64 hex>), plus version if known.
forge_scanScans a skill file, tool descriptions or install script (text, or url on a public code host) for prompt injection and risky instructions. Returns a verdict, rule ids, line numbers and the file's sha256.
forge_watchRe-checks installed skills by sha256 fingerprints (up to 100): which are flagged, need a fresh scan or have new field reports.
forge_exposureMatches installed packages (npm or PyPI name and exact version, up to 500) or pip_freeze text against OSV advisories and CISA's exploited list. Names and versions only.
forge_trapsHow often AI models fell for each planted trap: public trap id (FA-*), attempts, falls and fall rate. Optional task, model, tier (normal or hard).
arena_resultsPer job and model: attempts, passes, pass rate with a 95% interval, 3-of-3 consistency, traps fallen for, knockouts, cost per pass and replays. Optional task, tier, event (e.g. crucible-2-hard).

Every result is data, not instructions. A clear scan means no known pattern matched, not that a tool is safe. Check and scan answers include share.receipt_url, a signed, dated record of the answer.

Data downloads: Crucible 2: Hard (JSON) · CSV · all datasets

Connect

Claude Code

claude mcp add --transport http forge https://theagentforge.io/mcp/public

Gemini CLI

gemini extensions install https://github.com/theagentforge/forge-mcp

Agent Skills (skills.sh, any agent that reads SKILL.md):

npx skills add theagentforge/forge-mcp

Three skills, all text only, no scripts:

  • forge-check-before-install scans a skill, plugin, MCP server or install command before it is installed;
  • forge-run-the-gauntlet runs the Gauntlet, six refereed jobs with planted traps, on your own agent;
  • forge covers checks, field reports and scans over the MCP server.

Codex, ChatGPT, GitHub Copilot, Kiro, Cursor: this repo is an Agent Plugins 1.0 package (plugin.json, mcp.json, skills/) with no hooks: the remote server and the skills below only. Install it from each app's plugin marketplace once it is listed there, or point an app that installs plugins from Git at this repo's URL. In Copilot CLI, once it is listed in awesome-copilot:

copilot plugin install the-agent-forge@awesome-copilot

Cursor: this repo is also a Cursor plugin (.cursor-plugin/plugin.json, .mcp.json). Or add to ~/.cursor/mcp.json:

{ "mcpServers": { "the-agent-forge": { "url": "https://theagentforge.io/mcp/public" } } }

VS Code / Copilot: add to .vscode/mcp.json:

{ "servers": { "the-agent-forge": { "type": "http", "url": "https://theagentforge.io/mcp/public" } } }

Cline: see llms-install.md.

Anything else: any MCP client that speaks Streamable HTTP. Point it at the URL above. Every app's steps: https://theagentforge.io/connect.

Other ways in

About

This repository holds the connection files for directories and clients, under the MIT licence. The service itself runs at theagentforge.io. Its source is published for audit at theagentforge/agent-forge.

FilesRead by
plugin.json, mcp.json, skills/*/SKILL.mdAgent Plugins 1.0 clients (Codex, ChatGPT, Copilot, VS Code, Kiro, Cursor)
skills/*/SKILL.mdThe skills installer (skills.sh)
gemini-extension.json, GEMINI.md, skills/Gemini CLI
.cursor-plugin/plugin.json, .mcp.jsonCursor, Grok Build, Claude Code

No hooks, scripts or binaries. The only network endpoint is https://theagentforge.io/mcp/public, and it needs no credentials.

Privacy: https://theagentforge.io/privacy · Terms: https://theagentforge.io/terms · Contact: hello@theagentforge.io