Agent Device MCP (Callstack)
Capped at 70: core tools not tested: no backing service on the test box; the tests add up to 100. Why scores are capped
Test points add up to 100; the score is capped at 70 until a tool call passes. Not a quality or security rating. Methodology
Test points before the cap (100/100)
- Install20/20
- Handshake30/30
- Maintenance25/25
- Docs15/15
- License10/10
Tested npm agent-device 0.21.37 (MIT; repo callstack/agent-device). Installed pinned with scripts off (npm --ignore-scripts) and launched with `mcp`: initialize and tools/list over stdio succeeded with no credentials and listed 62 tools (no tool annotations). Real calls: 0 of 3 real function calls passed. No passing real call: no iOS/Android device, simulator or app session on the test box. Core tools not tested: 70 cap.
Tool-call test (2026-11-13 UTC, direct MCP stdio client, no LLM): fail. 0 of 3 real function calls passed. No passing real call: no iOS/Android device, simulator or app session on the test box. Evidence: local test run, Nov 13, 2026 UTC.
Transport (tested 2026-11-13 UTC): stdio
Token cost (estimate): approx. 30783 tokens, cl100k estimate (62 tools, measured 2026-11-13 UTC, version 0.21.37). This is an estimate from our testing of the tool names, descriptions and input schemas, counted with cl100k_base.
Permissions: 4 read, 5 write (state-changing), 53 unclassified · Auth: none · Rate limit: unknown · Pricing unit: unknown
Auth: none. Rate limit: unknown. Pricing unit: unknown.
action-button— unclassifiedalert— unclassifiedapp-switcher— unclassifiedapps— unclassifiedappstate— unclassifiedartifacts— unclassifiedaudio— unclassifiedback— unclassifiedbatch— unclassifiedboot— unclassifiedcapabilities— unclassifiedclick— unclassifiedclipboard— unclassifiedclose— unclassifieddebug— unclassifieddevices— unclassifieddiff— readdoctor— unclassifiedevents— unclassifiedfill— unclassifiedfind— readfocus— unclassifiedfold— unclassifiedgesture— unclassifiedget— readhardware-button— unclassifiedhelp— unclassifiedhome— unclassifiedhover— unclassifiedinstall— write (state-changing)install-from-source— write (state-changing)is— unclassifiedkeyboard— unclassifiedlogs— unclassifiedlongpress— unclassifiedmetro— unclassifiednetwork— unclassifiedopen— unclassifiedorientation— unclassifiedperf— unclassifiedpress— unclassifiedpush— write (state-changing)react-native— unclassifiedrecord— unclassifiedreinstall— unclassifiedreplay— unclassifiedscreenshot— unclassifiedscroll— unclassifiedsession— unclassifiedsettings— unclassifiedshutdown— write (state-changing)snapshot— unclassifiedswipe— unclassifiedtelephony— unclassifiedtest— unclassifiedtrace— unclassifiedtrigger-app-event— unclassifiedtv-remote— unclassifiedtype— readuninstall— write (state-changing)viewport— unclassifiedwait— unclassified
handshake and tools listed without a recorded key or OAuth
Score 70/100 · Tools 62 · Token cost approx. 30,783 tokens · Compare · Last tested 2026-11-13 UTC · Version tested 0.21.37 · Package agent-device · Repo callstack/agent-device
Summary: Agent Device MCP (Callstack) completed an MCP handshake without credentials and exposed 62 tools.
Evidence summary
- Handshake
- pass
- Tools listed
- 62
- Context cost
- approx. 30783 tokens, cl100k estimate (62 tools, measured 2026-11-13 UTC, version 0.21.37; an estimate) ranking · add up your servers' context cost
- API key
- No key to connect (handshake passed)
- Tested
- 2026-11-13 UTC
Test results
| Test | Result | Points | Evidence |
|---|---|---|---|
| install | pass | 20 | npm install agent-device (Node 20, Linux) succeeded in 0s. |
| handshake | pass | 30 | MCP initialize + tools/list over stdio succeeded with no credentials; 62 tools listed in 9.8s. |
| maintenance | pass | 25 | Repo pushed 0 days before test; 5,360 GitHub stars. |
| docs | pass | 15 | README over 3,000 chars; install instructions present; mcpServers config example present. Check of the package's own README (README shipped in npm package). |
| license | pass | 10 | MIT (OSI-approved). |
Local-model readiness
Token cost (estimate): approx. 30783 tokens, cl100k estimate for 62 tools · about 376% of an 8k context. This is an estimate from our testing (counted with cl100k_base).
Small-model friendly (schema heuristic, not a model result): unknown.
Not tested
Small-model task runs: Not yet tested.
What we tested and what we didn't
Tested on 2026-11-13 UTC
- Install from the registry
- We connected with no credentials and asked for its tool list: it listed 62 tools (Method details: MCP
initializethentools/list) - Maintenance signals (last push, archived/deprecated status)
- Docs (README length, install and config example)
- License (OSI-approved or not)
- Token cost (estimate)
Not tested
- Security: not audited (no code review, no permission or data-flow analysis)
- Real tasks (no functional task runs yet)
- Behaviour with real credentials or a real account
- Performance, rate limits or load
- Correctness of results beyond the listed tasks
Methodology: how we test. A high score means it installs and responds, not that giving it access to your data carries no risk.
Known security issues
Not yet checked.
Monthly roundup: MCP security issues, October 2026.
Tool list changes
Baseline recorded from the 2026-11-13 UTC test run; changes appear after the next test.
Snapshot hash (fingerprint of the tool list)
807dbfd97398: SHA-256 of the canonical tool names, descriptions and input schemas. If it changes, the tool list changed.
Raw test record (JSON)
{
"name": "agent-device",
"version": "0.21.37",
"registry": "npm",
"status": "working",
"tested": "2026-11-13",
"tools_count": 62,
"deprecated": false,
"archived": false,
"tests": {
"install": [
"pass",
20,
"`npm install agent-device` (Node 20, Linux) succeeded in 0s."
],
"handshake": [
"pass",
30,
"MCP `initialize` + `tools/list` over stdio succeeded with no credentials; 62 tools listed in 9.8s."
],
"maintenance": [
"pass",
25,
"Repo pushed 0 days before test; 5,360 GitHub stars."
],
"docs": [
"pass",
15,
"README over 3,000 chars; install instructions present; `mcpServers` config example present. Check of the package's own README (README shipped in npm package)."
],
"license": [
"pass",
10,
"MIT (OSI-approved)."
]
}
}Install
npx -y agent-device mcp
Pin the version we tested
npx -y agent-device@0.21.37 mcp
tested 2026-11-13 UTC. Newer versions may differ and were not tested by us.
{
"mcpServers": {
"agent-device-mcp-callstack": {
"command": "npx",
"args": [
"-y",
"agent-device@0.21.37",
"mcp"
]
}
}
}Tools listed
Showing 40 of 62 names: action-button, alert, app-switcher, apps, appstate, artifacts, audio, back, batch, boot, capabilities, click, clipboard, close, debug, devices, diff, doctor, events, fill, find, focus, fold, gesture, get, hardware-button, home, hover, install, install-from-source, is, keyboard, logs, longpress, metro, network, open, orientation, perf, press.Show all 62 names
action-button, alert, app-switcher, apps, appstate, artifacts, audio, back, batch, boot, capabilities, click, clipboard, close, debug, devices, diff, doctor, events, fill, find, focus, fold, gesture, get, hardware-button, home, hover, install, install-from-source, is, keyboard, logs, longpress, metro, network, open, orientation, perf, press, push, react-native, record, reinstall, replay, screenshot, scroll, session, settings, shutdown, snapshot, swipe, telephony, test, trace, trigger-app-event, tv-remote, type, uninstall, viewport, wait, help
Quick config
{
"mcpServers": {
"agent-device-mcp-callstack": {
"command": "npx",
"args": [
"-y",
"agent-device",
"mcp"
]
}
}
}Add to config Opens the config generator with this server selected.
Setup
- Install. Run
npm install agent-device(Node 20). This is the exact command we ran on 2026-11-13 UTC. - Configure. Add the mcpServers entry below to your MCP client config.
- Verify. Restart the client and check that tools/list returns tools (62 in our test).
{
"mcpServers": {
"agent-device-mcp-callstack": {
"command": "npx",
"args": [
"-y",
"agent-device",
"mcp"
]
}
}
}Test history
- 2026-11-13 UTC: New
Related: Best testing and QA MCP servers
FAQ
Is Agent Device MCP (Callstack) deprecated?
No. agent-device was not deprecated or archived when we last tested it on 2026-11-13 UTC.
What replaces Agent Device MCP (Callstack)?
Nothing; Agent Device MCP (Callstack) is not deprecated as of 2026-11-13 UTC.
Does Agent Device MCP (Callstack) need an API key?
No. It completed an MCP handshake with no credentials and listed 62 tools.
Embed the badge
Every tested server gets a free embeddable badge. It shows the current score and test date and expires after 90 days. Testing is free; payment never changes a score.