Leaderboard/ThumbGate
MCP ServerScored via MCP protocol probing: initialize handshake, tools/list conformance, and ping + tool invocation performance.

ThumbGate

smithery.ai/rlhf-loop/mcp-memory-gateway-v2↗

MCP Memory Gateway captures explicit structured feedback from AI coding agents, validates it against a rubric engine, and auto-promotes repeated failures into prevention rules enforced via PreToolUse hooks. Pre-action gates physically block tool calls matching known failure patterns before execution — turning past mistakes into hard constraints rather than suggestions. Supports semantic recall via LanceDB vectors, DPO/KTO export for downstream fine-tuning, and a file watcher bridge for external signal ingestion. Compatible with Claude Code, Codex, Gemini, Amp, Cursor, and OpenCode. Install with `npx mcp-memory-gateway init` or `claude mcp add rlhf -- npx -y mcp-memory-gateway serve`. MIT licensed, open source.

54/100
Operational Score
Score Breakdown
Availability30/30
Conformance10/30
Performance14/40
Key Metrics
Uptime 30d
100.0%
P95 Latency
267.9ms
Conformance
Fail
Trend
Stable
What's Being Tested
Availability
HTTP health check to the service endpoint
Responded with HTTP 401 in 445ms
ConformanceNot tested
MCP initialize handshake + tools/list
Performance
MCP ping + zero-arg tool invocation benchmarking
P95 latency: 267ms, task completion: 0%
Recent Probe Results
TimestampStatusLatencyConformance
Apr 3, 2026success445.1msPass
Apr 3, 2026success455.3msPass
Apr 3, 2026success430.8msPass
Apr 3, 2026success433.6msPass
Apr 3, 2026success436.7msPass
Apr 3, 2026success481.1msPass
Apr 3, 2026success530.7msPass
Apr 3, 2026success511.5msPass
Apr 3, 2026success168.5msPass
Apr 2, 2026success163.8msPass
Source Registries
smithery
First Seen
Mar 26, 2026
Last Seen
Apr 1, 2026
Last Probed
Apr 3, 2026