IronBee DevTools

70/100

Capped at 70: core tools not tested: blocked in sandbox; the tests add up to 93. Why scores are capped

Last tested 2026-11-13 UTC (Fresh: tested within 30 days) Connects · tools listedNo tool call tested yet No key to connect

Advisories: not yet checked

Security review: not tested

Test points add up to 93; the score is capped at 70 until a tool call passes. Not a quality or security rating. Methodology

Test points before the cap (93/100)

  • Install20/20
  • Handshake30/30
  • Maintenance25/25
  • Docs15/15
  • License3/10

Tested npm @ironbee-ai/devtools 0.53.0 (Elastic-2.0; repo link in package metadata not found on GitHub (HTTP 404)). Installed pinned with scripts off (npm --ignore-scripts) and launched: initialize and tools/list over stdio succeeded with no credentials and listed 58 tools (no tool annotations). Real calls: 0 of 3 real function calls passed. No passing real call: its Playwright browser is not installed because we skip browser downloads. Core tools not tested: 70 cap.
Tool-call test (2026-11-13 UTC, direct MCP stdio client, no LLM): fail. 0 of 3 real function calls passed. No passing real call: its Playwright browser is not installed because we skip browser downloads. Evidence: local test run, Nov 13, 2026 UTC.

Transport (tested 2026-11-13 UTC): stdio

Token cost (estimate): approx. 18579 tokens, cl100k estimate (58 tools, measured 2026-11-13 UTC, version 0.53.0). This is an estimate from our testing of the tool names, descriptions and input schemas, counted with cl100k_base.

Permissions: 20 read, 15 write (state-changing), 23 unclassified · Auth: none · Rate limit: unknown · Pricing unit: unknown

Auth: none. Rate limit: unknown. Pricing unit: unknown.

  • a11y_take-aria-snapshot — unclassified
  • a11y_take-ax-tree-snapshot — unclassified
  • content_get-as-html — read
  • content_get-as-text — read
  • content_save-as-pdf — unclassified
  • content_start-recording — write (state-changing)
  • content_stop-recording — write (state-changing)
  • content_take-screenshot — unclassified
  • debug_add-watch — write (state-changing)
  • debug_clear-probe-snapshots — write (state-changing)
  • debug_clear-probes — write (state-changing)
  • debug_get-probe-snapshots — read
  • debug_list-probes — read
  • debug_put-exceptionpoint — write (state-changing)
  • debug_put-logpoint — write (state-changing)
  • debug_put-tracepoint — write (state-changing)
  • debug_remove-probe — write (state-changing)
  • debug_resolve-source-location — read
  • debug_status — read
  • execute — unclassified
  • flush — write (state-changing)
  • interaction_click — unclassified
  • interaction_drag — unclassified
  • interaction_fill — unclassified
  • interaction_hover — unclassified
  • interaction_press-key — unclassified
  • interaction_resize-viewport — unclassified
  • interaction_resize-window — unclassified
  • interaction_scroll — unclassified
  • interaction_select — unclassified
  • navigation_go-back-or-forward — unclassified
  • navigation_go-to — unclassified
  • navigation_reload — unclassified
  • o11y_get-console-messages — read
  • o11y_get-http-requests — read
  • o11y_get-session-logs — read
  • o11y_get-session-traces — read
  • o11y_get-trace — read
  • o11y_get-trace-context — read
  • o11y_get-trace-logs — read
  • o11y_get-web-vitals — read
  • o11y_new-trace-id — unclassified
  • o11y_set-trace-context — write (state-changing)
  • react_get-component-for-element — read
  • react_get-element-for-component — read
  • scenario-add — write (state-changing)
  • scenario-delete — write (state-changing)
  • scenario-list — read
  • scenario-recorded-actions — unclassified
  • scenario-run — unclassified
  • scenario-search — read
  • scenario-update — write (state-changing)
  • secrets_list — read
  • stub_clear — write (state-changing)
  • stub_intercept-http-request — unclassified
  • stub_list — read
  • stub_mock-http-response — unclassified
  • sync_wait-for-network-idle — unclassified

handshake and tools listed without a recorded key or OAuth

Score 70/100 · Tools 58 · Token cost approx. 18,579 tokens · Compare · Last tested 2026-11-13 UTC · Version tested 0.53.0 · Package @ironbee-ai/devtools

Summary: IronBee DevTools completed an MCP handshake without credentials and exposed 58 tools.

Evidence summary

Handshake
pass
Tools listed
58
Context cost
approx. 18579 tokens, cl100k estimate (58 tools, measured 2026-11-13 UTC, version 0.53.0; an estimate) ranking · add up your servers' context cost
API key
No key to connect (handshake passed)
Tested
2026-11-13 UTC

Test results

TestResultPointsEvidence
installpass20npm install @ironbee-ai/devtools (Node 20, Linux) succeeded in 6s.
handshakepass30MCP initialize + tools/list over stdio succeeded with no credentials; 58 tools listed in 24.0s.
maintenancepass25Latest release published 6 days before test.
docspass15README over 3,000 chars; install instructions present; mcpServers config example present. Check of the package's own README (README shipped in npm package).
licensepartial3License not machine-detected as OSI (Elastic-2.0).

Local-model readiness

Token cost (estimate): approx. 18579 tokens, cl100k estimate for 58 tools · about 227% of an 8k context. This is an estimate from our testing (counted with cl100k_base).

Small-model friendly (schema heuristic, not a model result): unknown.

Not tested

Small-model task runs: Not yet tested.

What we tested and what we didn't

Tested on 2026-11-13 UTC

  • Install from the registry
  • We connected with no credentials and asked for its tool list: it listed 58 tools (Method details: MCP initialize then tools/list)
  • Maintenance signals (last push, archived/deprecated status)
  • Docs (README length, install and config example)
  • License (OSI-approved or not)
  • Token cost (estimate)

Not tested

  • Security: not audited (no code review, no permission or data-flow analysis)
  • Real tasks (no functional task runs yet)
  • Behaviour with real credentials or a real account
  • Performance, rate limits or load
  • Correctness of results beyond the listed tasks

Methodology: how we test. A high score means it installs and responds, not that giving it access to your data carries no risk.

Known security issues

Not yet checked.

Monthly roundup: MCP security issues, October 2026.

Tool list changes

Baseline recorded from the 2026-11-13 UTC test run; changes appear after the next test.

Snapshot hash (fingerprint of the tool list)

8a12fe4ee1ee: SHA-256 of the canonical tool names, descriptions and input schemas. If it changes, the tool list changed.

Feeds: RSS · JSON.

Raw test record (JSON)
{
  "name": "@ironbee-ai/devtools",
  "version": "0.53.0",
  "registry": "npm",
  "status": "working",
  "tested": "2026-11-13",
  "tools_count": 58,
  "deprecated": false,
  "archived": null,
  "tests": {
    "install": [
      "pass",
      20,
      "`npm install @ironbee-ai/devtools` (Node 20, Linux) succeeded in 6s."
    ],
    "handshake": [
      "pass",
      30,
      "MCP `initialize` + `tools/list` over stdio succeeded with no credentials; 58 tools listed in 24.0s."
    ],
    "maintenance": [
      "pass",
      25,
      "Latest release published 6 days before test."
    ],
    "docs": [
      "pass",
      15,
      "README over 3,000 chars; install instructions present; `mcpServers` config example present. Check of the package's own README (README shipped in npm package)."
    ],
    "license": [
      "partial",
      3,
      "License not machine-detected as OSI (Elastic-2.0)."
    ]
  }
}

Install

npx -y @ironbee-ai/devtools

Pin the version we tested

npx -y @ironbee-ai/devtools@0.53.0

tested 2026-11-13 UTC. Newer versions may differ and were not tested by us.

{
  "mcpServers": {
    "ironbee-devtools": {
      "command": "npx",
      "args": [
        "-y",
        "@ironbee-ai/devtools@0.53.0"
      ]
    }
  }
}

Tools listed

Showing 40 of 58 names: a11y_take-aria-snapshot, a11y_take-ax-tree-snapshot, content_get-as-html, content_get-as-text, content_save-as-pdf, content_start-recording, content_stop-recording, content_take-screenshot, debug_status, debug_resolve-source-location, debug_put-tracepoint, debug_remove-probe, debug_list-probes, debug_clear-probes, debug_put-logpoint, debug_put-exceptionpoint, debug_get-probe-snapshots, debug_clear-probe-snapshots, debug_add-watch, interaction_click, interaction_drag, interaction_fill, interaction_hover, interaction_press-key, interaction_resize-viewport, interaction_resize-window, interaction_select, interaction_scroll, navigation_go-back-or-forward, navigation_go-to, navigation_reload, o11y_get-console-messages, o11y_get-http-requests, o11y_get-web-vitals, react_get-component-for-element, react_get-element-for-component, scenario-add, scenario-update, scenario-delete, scenario-list.

Show all 58 names

a11y_take-aria-snapshot, a11y_take-ax-tree-snapshot, content_get-as-html, content_get-as-text, content_save-as-pdf, content_start-recording, content_stop-recording, content_take-screenshot, debug_status, debug_resolve-source-location, debug_put-tracepoint, debug_remove-probe, debug_list-probes, debug_clear-probes, debug_put-logpoint, debug_put-exceptionpoint, debug_get-probe-snapshots, debug_clear-probe-snapshots, debug_add-watch, interaction_click, interaction_drag, interaction_fill, interaction_hover, interaction_press-key, interaction_resize-viewport, interaction_resize-window, interaction_select, interaction_scroll, navigation_go-back-or-forward, navigation_go-to, navigation_reload, o11y_get-console-messages, o11y_get-http-requests, o11y_get-web-vitals, react_get-component-for-element, react_get-element-for-component, scenario-add, scenario-update, scenario-delete, scenario-list, scenario-search, scenario-recorded-actions, stub_clear, stub_intercept-http-request, stub_list, stub_mock-http-response, sync_wait-for-network-idle, flush, secrets_list, o11y_new-trace-id, o11y_get-trace-context, o11y_set-trace-context, o11y_get-trace, o11y_get-session-traces, o11y_get-trace-logs, o11y_get-session-logs, execute, scenario-run

Quick config

{
  "mcpServers": {
    "ironbee-devtools": {
      "command": "npx",
      "args": [
        "-y",
        "@ironbee-ai/devtools"
      ]
    }
  }
}

Add to config Opens the config generator with this server selected.

Setup

  1. Install. Run npm install @ironbee-ai/devtools (Node 20). This is the exact command we ran on 2026-11-13 UTC.
  2. Configure. Add the mcpServers entry below to your MCP client config.
  3. Verify. Restart the client and check that tools/list returns tools (58 in our test).
{
  "mcpServers": {
    "ironbee-devtools": {
      "command": "npx",
      "args": [
        "-y",
        "@ironbee-ai/devtools"
      ]
    }
  }
}

Test history

Follow this server (RSS) · Monthly changelog

FAQ

Is IronBee DevTools deprecated?

No. @ironbee-ai/devtools was not deprecated or archived when we last tested it on 2026-11-13 UTC.

What replaces IronBee DevTools?

Nothing; IronBee DevTools is not deprecated as of 2026-11-13 UTC.

Does IronBee DevTools need an API key?

No. It completed an MCP handshake with no credentials and listed 58 tools.

Embed the badge

TestedMCP: 70/100, tested 2026-11-13 UTC

Every tested server gets a free embeddable badge. It shows the current score and test date and expires after 90 days. Testing is free; payment never changes a score.

Claim this listing · Report an issue