IronBee DevTools
Capped at 70: core tools not tested: blocked in sandbox; the tests add up to 93. Why scores are capped
Test points add up to 93; the score is capped at 70 until a tool call passes. Not a quality or security rating. Methodology
Test points before the cap (93/100)
- Install20/20
- Handshake30/30
- Maintenance25/25
- Docs15/15
- License3/10
Tested npm @ironbee-ai/devtools 0.53.0 (Elastic-2.0; repo link in package metadata not found on GitHub (HTTP 404)). Installed pinned with scripts off (npm --ignore-scripts) and launched: initialize and tools/list over stdio succeeded with no credentials and listed 58 tools (no tool annotations). Real calls: 0 of 3 real function calls passed. No passing real call: its Playwright browser is not installed because we skip browser downloads. Core tools not tested: 70 cap.
Tool-call test (2026-11-13 UTC, direct MCP stdio client, no LLM): fail. 0 of 3 real function calls passed. No passing real call: its Playwright browser is not installed because we skip browser downloads. Evidence: local test run, Nov 13, 2026 UTC.
Transport (tested 2026-11-13 UTC): stdio
Token cost (estimate): approx. 18579 tokens, cl100k estimate (58 tools, measured 2026-11-13 UTC, version 0.53.0). This is an estimate from our testing of the tool names, descriptions and input schemas, counted with cl100k_base.
Permissions: 20 read, 15 write (state-changing), 23 unclassified · Auth: none · Rate limit: unknown · Pricing unit: unknown
Auth: none. Rate limit: unknown. Pricing unit: unknown.
a11y_take-aria-snapshot— unclassifieda11y_take-ax-tree-snapshot— unclassifiedcontent_get-as-html— readcontent_get-as-text— readcontent_save-as-pdf— unclassifiedcontent_start-recording— write (state-changing)content_stop-recording— write (state-changing)content_take-screenshot— unclassifieddebug_add-watch— write (state-changing)debug_clear-probe-snapshots— write (state-changing)debug_clear-probes— write (state-changing)debug_get-probe-snapshots— readdebug_list-probes— readdebug_put-exceptionpoint— write (state-changing)debug_put-logpoint— write (state-changing)debug_put-tracepoint— write (state-changing)debug_remove-probe— write (state-changing)debug_resolve-source-location— readdebug_status— readexecute— unclassifiedflush— write (state-changing)interaction_click— unclassifiedinteraction_drag— unclassifiedinteraction_fill— unclassifiedinteraction_hover— unclassifiedinteraction_press-key— unclassifiedinteraction_resize-viewport— unclassifiedinteraction_resize-window— unclassifiedinteraction_scroll— unclassifiedinteraction_select— unclassifiednavigation_go-back-or-forward— unclassifiednavigation_go-to— unclassifiednavigation_reload— unclassifiedo11y_get-console-messages— reado11y_get-http-requests— reado11y_get-session-logs— reado11y_get-session-traces— reado11y_get-trace— reado11y_get-trace-context— reado11y_get-trace-logs— reado11y_get-web-vitals— reado11y_new-trace-id— unclassifiedo11y_set-trace-context— write (state-changing)react_get-component-for-element— readreact_get-element-for-component— readscenario-add— write (state-changing)scenario-delete— write (state-changing)scenario-list— readscenario-recorded-actions— unclassifiedscenario-run— unclassifiedscenario-search— readscenario-update— write (state-changing)secrets_list— readstub_clear— write (state-changing)stub_intercept-http-request— unclassifiedstub_list— readstub_mock-http-response— unclassifiedsync_wait-for-network-idle— unclassified
handshake and tools listed without a recorded key or OAuth
Score 70/100 · Tools 58 · Token cost approx. 18,579 tokens · Compare · Last tested 2026-11-13 UTC · Version tested 0.53.0 · Package @ironbee-ai/devtools
Summary: IronBee DevTools completed an MCP handshake without credentials and exposed 58 tools.
Evidence summary
- Handshake
- pass
- Tools listed
- 58
- Context cost
- approx. 18579 tokens, cl100k estimate (58 tools, measured 2026-11-13 UTC, version 0.53.0; an estimate) ranking · add up your servers' context cost
- API key
- No key to connect (handshake passed)
- Tested
- 2026-11-13 UTC
Test results
| Test | Result | Points | Evidence |
|---|---|---|---|
| install | pass | 20 | npm install @ironbee-ai/devtools (Node 20, Linux) succeeded in 6s. |
| handshake | pass | 30 | MCP initialize + tools/list over stdio succeeded with no credentials; 58 tools listed in 24.0s. |
| maintenance | pass | 25 | Latest release published 6 days before test. |
| docs | pass | 15 | README over 3,000 chars; install instructions present; mcpServers config example present. Check of the package's own README (README shipped in npm package). |
| license | partial | 3 | License not machine-detected as OSI (Elastic-2.0). |
Local-model readiness
Token cost (estimate): approx. 18579 tokens, cl100k estimate for 58 tools · about 227% of an 8k context. This is an estimate from our testing (counted with cl100k_base).
Small-model friendly (schema heuristic, not a model result): unknown.
Not tested
Small-model task runs: Not yet tested.
What we tested and what we didn't
Tested on 2026-11-13 UTC
- Install from the registry
- We connected with no credentials and asked for its tool list: it listed 58 tools (Method details: MCP
initializethentools/list) - Maintenance signals (last push, archived/deprecated status)
- Docs (README length, install and config example)
- License (OSI-approved or not)
- Token cost (estimate)
Not tested
- Security: not audited (no code review, no permission or data-flow analysis)
- Real tasks (no functional task runs yet)
- Behaviour with real credentials or a real account
- Performance, rate limits or load
- Correctness of results beyond the listed tasks
Methodology: how we test. A high score means it installs and responds, not that giving it access to your data carries no risk.
Known security issues
Not yet checked.
Monthly roundup: MCP security issues, October 2026.
Tool list changes
Baseline recorded from the 2026-11-13 UTC test run; changes appear after the next test.
Snapshot hash (fingerprint of the tool list)
8a12fe4ee1ee: SHA-256 of the canonical tool names, descriptions and input schemas. If it changes, the tool list changed.
Raw test record (JSON)
{
"name": "@ironbee-ai/devtools",
"version": "0.53.0",
"registry": "npm",
"status": "working",
"tested": "2026-11-13",
"tools_count": 58,
"deprecated": false,
"archived": null,
"tests": {
"install": [
"pass",
20,
"`npm install @ironbee-ai/devtools` (Node 20, Linux) succeeded in 6s."
],
"handshake": [
"pass",
30,
"MCP `initialize` + `tools/list` over stdio succeeded with no credentials; 58 tools listed in 24.0s."
],
"maintenance": [
"pass",
25,
"Latest release published 6 days before test."
],
"docs": [
"pass",
15,
"README over 3,000 chars; install instructions present; `mcpServers` config example present. Check of the package's own README (README shipped in npm package)."
],
"license": [
"partial",
3,
"License not machine-detected as OSI (Elastic-2.0)."
]
}
}Install
npx -y @ironbee-ai/devtools
Pin the version we tested
npx -y @ironbee-ai/devtools@0.53.0
tested 2026-11-13 UTC. Newer versions may differ and were not tested by us.
{
"mcpServers": {
"ironbee-devtools": {
"command": "npx",
"args": [
"-y",
"@ironbee-ai/devtools@0.53.0"
]
}
}
}Tools listed
Showing 40 of 58 names: a11y_take-aria-snapshot, a11y_take-ax-tree-snapshot, content_get-as-html, content_get-as-text, content_save-as-pdf, content_start-recording, content_stop-recording, content_take-screenshot, debug_status, debug_resolve-source-location, debug_put-tracepoint, debug_remove-probe, debug_list-probes, debug_clear-probes, debug_put-logpoint, debug_put-exceptionpoint, debug_get-probe-snapshots, debug_clear-probe-snapshots, debug_add-watch, interaction_click, interaction_drag, interaction_fill, interaction_hover, interaction_press-key, interaction_resize-viewport, interaction_resize-window, interaction_select, interaction_scroll, navigation_go-back-or-forward, navigation_go-to, navigation_reload, o11y_get-console-messages, o11y_get-http-requests, o11y_get-web-vitals, react_get-component-for-element, react_get-element-for-component, scenario-add, scenario-update, scenario-delete, scenario-list.Show all 58 names
a11y_take-aria-snapshot, a11y_take-ax-tree-snapshot, content_get-as-html, content_get-as-text, content_save-as-pdf, content_start-recording, content_stop-recording, content_take-screenshot, debug_status, debug_resolve-source-location, debug_put-tracepoint, debug_remove-probe, debug_list-probes, debug_clear-probes, debug_put-logpoint, debug_put-exceptionpoint, debug_get-probe-snapshots, debug_clear-probe-snapshots, debug_add-watch, interaction_click, interaction_drag, interaction_fill, interaction_hover, interaction_press-key, interaction_resize-viewport, interaction_resize-window, interaction_select, interaction_scroll, navigation_go-back-or-forward, navigation_go-to, navigation_reload, o11y_get-console-messages, o11y_get-http-requests, o11y_get-web-vitals, react_get-component-for-element, react_get-element-for-component, scenario-add, scenario-update, scenario-delete, scenario-list, scenario-search, scenario-recorded-actions, stub_clear, stub_intercept-http-request, stub_list, stub_mock-http-response, sync_wait-for-network-idle, flush, secrets_list, o11y_new-trace-id, o11y_get-trace-context, o11y_set-trace-context, o11y_get-trace, o11y_get-session-traces, o11y_get-trace-logs, o11y_get-session-logs, execute, scenario-run
Quick config
{
"mcpServers": {
"ironbee-devtools": {
"command": "npx",
"args": [
"-y",
"@ironbee-ai/devtools"
]
}
}
}Add to config Opens the config generator with this server selected.
Setup
- Install. Run
npm install @ironbee-ai/devtools(Node 20). This is the exact command we ran on 2026-11-13 UTC. - Configure. Add the mcpServers entry below to your MCP client config.
- Verify. Restart the client and check that tools/list returns tools (58 in our test).
{
"mcpServers": {
"ironbee-devtools": {
"command": "npx",
"args": [
"-y",
"@ironbee-ai/devtools"
]
}
}
}Test history
- 2026-11-13 UTC: New
FAQ
Is IronBee DevTools deprecated?
No. @ironbee-ai/devtools was not deprecated or archived when we last tested it on 2026-11-13 UTC.
What replaces IronBee DevTools?
Nothing; IronBee DevTools is not deprecated as of 2026-11-13 UTC.
Does IronBee DevTools need an API key?
No. It completed an MCP handshake with no credentials and listed 58 tools.
Embed the badge
Every tested server gets a free embeddable badge. It shows the current score and test date and expires after 90 days. Testing is free; payment never changes a score.