SmartBear MCP (official)
Context cost warning: its tools/list is about 230,507 tokens (316 tools), 703% of a 32k context window and 115% of a 200k window, before you send a single message. Load only the tools you need, or expect most of the context to go to tool definitions. Estimate from our testing of the tool names, descriptions and input schemas, counted with cl100k_base, measured 2026-11-11. How MCP context cost adds up
Capped at 70: no passing tool call yet; the tests add up to 100. Why scores are capped
Test points add up to 100; the score is capped at 70 until a tool call passes. Not a quality or security rating. Methodology
Test points before the cap (100/100)
- Install20/20
- Handshake30/30
- Maintenance25/25
- Docs15/15
- License10/10
Tested npm @smartbear/mcp 0.43.0 (MIT; repo SmartBear/smartbear-mcp). One stdio server for SmartBear products (BugSnag, Reflect, API Hub, Swagger, PactFlow, QMetry, Zephyr, Collaborator, BearQ): 316 tools listed without credentials, a large context cost. The read call bugsnag_list_projects answered that BugSnag is not configured: each product needs its own token. Core tools not tested.
Tool-call test (2026-11-11, direct MCP stdio client, no LLM): fail. 0 of 1 call passed; product tools need SmartBear product tokens. Core tools not tested. Evidence: local test run, Nov 11, 2026.
Transport (tested 2026-11-11): stdio
Token cost (estimate): approx. 230507 tokens, cl100k estimate (316 tools, measured 2026-11-11, version 0.43.0). This is an estimate from our testing of the tool names, descriptions and input schemas, counted with cl100k_base.
Permissions: 193 read, 123 write (state-changing), 0 unclassified · Auth: API key · Rate limit: unknown · Pricing unit: unknown
Auth: API key. Rate limit: unknown. Pricing unit: unknown.
bearq_chat_with_qa_lead— readbearq_delete_test_cases— write (state-changing)bearq_expand_application_model— readbearq_get_task— readbearq_get_task_status— readbearq_get_workflow_run— readbearq_list_environments— readbearq_list_workflows— readbearq_run_regression_tests— readbearq_run_test_cases— readbearq_run_tests_in_functional_areas— readbearq_run_workflow— readbearq_stop_task— readbearq_stop_workflow_run— readbearq_wait_for_task— readbugsnag_get_build— readbugsnag_get_current_project— readbugsnag_get_error— readbugsnag_get_event— readbugsnag_get_event_details_from_dashboard_url— readbugsnag_get_events_on_an_error— readbugsnag_get_network_endpoint_groupings— readbugsnag_get_release— readbugsnag_get_span_group— readbugsnag_get_trace— readbugsnag_list_project_errors— readbugsnag_list_project_event_filters— readbugsnag_list_projects— readbugsnag_list_releases— readbugsnag_list_span_groups— readbugsnag_list_spans— readbugsnag_list_trace_fields— readbugsnag_set_network_endpoint_groupings— write (state-changing)bugsnag_update_error— write (state-changing)collaborator_create_remote_system_configuration— readcollaborator_create_review— readcollaborator_delete_remote_system_configuration— readcollaborator_edit_remote_system_configuration— readcollaborator_find_review_by_id— readcollaborator_get_reviews— readcollaborator_reject_review— readcollaborator_reviewservice_action— readcollaborator_test_remote_system_configuration_connection— readcollaborator_update_remote_system_configuration_webhook— readcontract-testing_add_label_to_pacticipant— write (state-changing)contract-testing_admin_add_role_to_user— write (state-changing)contract-testing_admin_create_role— write (state-changing)contract-testing_admin_create_system_account— write (state-changing)contract-testing_admin_create_team— write (state-changing)contract-testing_admin_create_user— write (state-changing)contract-testing_admin_delete_role— write (state-changing)contract-testing_admin_delete_team— write (state-changing)contract-testing_admin_delete_user— write (state-changing)contract-testing_admin_get_role— readcontract-testing_admin_get_system_account_tokens— readcontract-testing_admin_get_team— readcontract-testing_admin_get_team_user— readcontract-testing_admin_get_user— readcontract-testing_admin_invite_users— write (state-changing)contract-testing_admin_list_permissions— readcontract-testing_admin_list_roles— readcontract-testing_admin_list_team_users— readcontract-testing_admin_list_teams— readcontract-testing_admin_list_users— readcontract-testing_admin_patch_team_users— write (state-changing)contract-testing_admin_remove_role_from_user— write (state-changing)contract-testing_admin_remove_user_from_team— write (state-changing)contract-testing_admin_reset_roles— write (state-changing)contract-testing_admin_set_team_users— write (state-changing)contract-testing_admin_set_user_roles— write (state-changing)contract-testing_admin_update_role— write (state-changing)contract-testing_admin_update_team— write (state-changing)contract-testing_admin_update_user— write (state-changing)contract-testing_can_i_deploy— readcontract-testing_check_pactflow_ai_entitlements— readcontract-testing_create_environment— write (state-changing)contract-testing_create_pacticipant— write (state-changing)contract-testing_create_secret— write (state-changing)contract-testing_create_webhook— write (state-changing)contract-testing_delete_all_integrations— write (state-changing)contract-testing_delete_branch— write (state-changing)contract-testing_delete_environment— write (state-changing)contract-testing_delete_integration— write (state-changing)contract-testing_delete_pacticipant— write (state-changing)contract-testing_delete_secret— write (state-changing)contract-testing_delete_webhook— write (state-changing)contract-testing_execute_webhook— write (state-changing)contract-testing_generate_pact_tests— readcontract-testing_get_audit_log— readcontract-testing_get_bdct_consumer_by_consumer_version— readcontract-testing_get_bdct_consumer_contract_verification_results— readcontract-testing_get_bdct_consumer_contracts— readcontract-testing_get_bdct_consumer_pact_test_results_by_consumer— readcontract-testing_get_bdct_cross-contract_verification_results— readcontract-testing_get_bdct_provider_by_consumer_version— readcontract-testing_get_bdct_provider_check_results_by_consumer— readcontract-testing_get_bdct_provider_contract— readcontract-testing_get_bdct_provider_contract_verification_results— readcontract-testing_get_bdct_x-contract_test_results_by_consumer— readcontract-testing_get_branch— readcontract-testing_get_branch_versions— readcontract-testing_get_current_user— readcontract-testing_get_currently_deployed_versions— readcontract-testing_get_currently_supported_versions— readcontract-testing_get_deployed_versions_for_version— readcontract-testing_get_environment— readcontract-testing_get_integrations_by_team— readcontract-testing_get_latest_pacticipant_version— readcontract-testing_get_metrics— readcontract-testing_get_pacticipant— readcontract-testing_get_pacticipant_label— readcontract-testing_get_pacticipant_network— readcontract-testing_get_pacticipant_version— readcontract-testing_get_pacts_for_verification— readcontract-testing_get_provider_states— readcontract-testing_get_released_versions_for_version— readcontract-testing_get_secret— readcontract-testing_get_system_preferences— readcontract-testing_get_team_metrics— readcontract-testing_get_user_preferences— readcontract-testing_get_webhook— readcontract-testing_list_api_tokens— readcontract-testing_list_branches— readcontract-testing_list_deployed_or_released_versions— readcontract-testing_list_environment_versions— readcontract-testing_list_environments— readcontract-testing_list_integrations— readcontract-testing_list_labels— readcontract-testing_list_pacticipant_versions— readcontract-testing_list_pacticipants— readcontract-testing_list_pacticipants_by_label— readcontract-testing_list_secrets— readcontract-testing_list_webhooks— readcontract-testing_matrix— readcontract-testing_patch_pacticipant— write (state-changing)contract-testing_publish_consumer_contracts— write (state-changing)contract-testing_publish_provider_contract— write (state-changing)contract-testing_record_deployment— write (state-changing)contract-testing_record_release— write (state-changing)contract-testing_regenerate_api_token— write (state-changing)contract-testing_remove_label_from_pacticipant— write (state-changing)contract-testing_review_pact_tests— readcontract-testing_test_execute_webhooks— write (state-changing)contract-testing_update_environment— write (state-changing)contract-testing_update_pacticipant— write (state-changing)contract-testing_update_pacticipant_version— write (state-changing)contract-testing_update_secret— write (state-changing)contract-testing_update_webhook— write (state-changing)qmetry_bulk_update_test_case_execution_status— write (state-changing)qmetry_bulk_update_test_run_udfs— write (state-changing)qmetry_create_cycle— write (state-changing)qmetry_create_defect_or_issue— write (state-changing)qmetry_create_release— write (state-changing)qmetry_create_requirement— write (state-changing)qmetry_create_test_case— write (state-changing)qmetry_create_test_suite— write (state-changing)qmetry_execute_quality_gate_report— readqmetry_export_html_report— write (state-changing)qmetry_fetch_api_call_quota— readqmetry_fetch_automation_status— readqmetry_fetch_builds— readqmetry_fetch_cascade_child_values— readqmetry_fetch_defects_or_issues— readqmetry_fetch_executions_by_test_suite— readqmetry_fetch_issue_details— readqmetry_fetch_issue_executions— readqmetry_fetch_issues_linked_to_test_case— readqmetry_fetch_linked_issues_of_test_case_run— readqmetry_fetch_platforms— readqmetry_fetch_qmetry_list_projects— readqmetry_fetch_qmetry_project_info— readqmetry_fetch_quality_gate_configuration— readqmetry_fetch_releases_and_cycles— readqmetry_fetch_requirement_details— readqmetry_fetch_requirements— readqmetry_fetch_requirements_linked_to_test_case— readqmetry_fetch_test_case_details— readqmetry_fetch_test_case_executions— readqmetry_fetch_test_case_runs_by_test_suite_run— readqmetry_fetch_test_case_steps— readqmetry_fetch_test_case_steps_with_udf— readqmetry_fetch_test_case_version_details— readqmetry_fetch_test_cases— readqmetry_fetch_test_cases_linked_to_requirement— readqmetry_fetch_test_cases_linked_to_test_suite— readqmetry_fetch_test_run_udf_metadata— readqmetry_fetch_test_run_udf_values— readqmetry_fetch_test_suite_details— readqmetry_fetch_test_suites— readqmetry_fetch_test_suites_for_test_case— readqmetry_fetch_udf_layout— readqmetry_import_automation_test_results— readqmetry_link_issues_to_testcase_run— write (state-changing)qmetry_link_platforms_to_test_suite— write (state-changing)qmetry_link_requirements_to_testcase— write (state-changing)qmetry_link_test_case_to_issues— write (state-changing)qmetry_link_test_cases_to_test_suite— write (state-changing)qmetry_requirements_linked_test_cases_to_test_suite— write (state-changing)qmetry_set_qmetry_project_info— write (state-changing)qmetry_update_cycle— write (state-changing)qmetry_update_issue— write (state-changing)qmetry_update_requirement— write (state-changing)qmetry_update_test_case— write (state-changing)qmetry_update_test_suite— write (state-changing)qtm4j_create_test_case— write (state-changing)qtm4j_create_test_cycle— write (state-changing)qtm4j_get_automation_history— readqtm4j_get_linked_bugs_of_test_case_execution— readqtm4j_get_linked_bugs_of_test_step_execution— readqtm4j_get_linked_requirements— readqtm4j_get_linked_requirements_for_test_cycle— readqtm4j_get_linked_test_cases_for_requirement— readqtm4j_get_projects— readqtm4j_get_test_steps— readqtm4j_link_bugs_to_test_case_execution— write (state-changing)qtm4j_link_bugs_to_test_step_execution— write (state-changing)qtm4j_link_requirements_to_test_case— write (state-changing)qtm4j_link_requirements_to_test_cycle— write (state-changing)qtm4j_link_test_cases_to_requirement— write (state-changing)qtm4j_link_test_cases_to_test_cycle— write (state-changing)qtm4j_search_linked_test_cases_in_test_cycle— readqtm4j_search_test_cases— readqtm4j_search_test_cycles— readqtm4j_set_project_context— write (state-changing)qtm4j_start_new_execution— write (state-changing)qtm4j_unlink_requirements_from_test_case— write (state-changing)qtm4j_unlink_requirements_from_test_cycle— write (state-changing)qtm4j_unlink_test_cases_from_requirement— write (state-changing)qtm4j_unlink_test_cases_from_test_cycle— write (state-changing)qtm4j_update_test_case— write (state-changing)qtm4j_update_test_case_execution— write (state-changing)qtm4j_update_test_cycle— write (state-changing)qtm4j_update_test_step_execution— write (state-changing)qtm4j_upload_automation_result— write (state-changing)reflect_add_prompt_step— write (state-changing)reflect_add_segment— write (state-changing)reflect_cancel_suite_execution— readreflect_connect_to_session— write (state-changing)reflect_create_segment— write (state-changing)reflect_create_test— write (state-changing)reflect_delete_previous_step— write (state-changing)reflect_execute_suite— readreflect_get_screenshot— readreflect_get_suite_execution_status— readreflect_get_test_detail— readreflect_get_test_status— readreflect_list_segments— readreflect_list_suite_executions— readreflect_list_suites— readreflect_list_tests— readreflect_run_test— readswagger_create_api_from_prompt— write (state-changing)swagger_create_documentation_page— write (state-changing)swagger_create_or_update_api— write (state-changing)swagger_create_portal— write (state-changing)swagger_create_portal_product— write (state-changing)swagger_create_table_of_contents— write (state-changing)swagger_delete_portal_product— write (state-changing)swagger_delete_table_of_contents— write (state-changing)swagger_get_api_definition— readswagger_get_document— readswagger_get_portal— readswagger_get_portal_product— readswagger_list_organizations— readswagger_list_portal_product_sections— readswagger_list_portal_products— readswagger_list_portals— readswagger_list_table_of_contents— readswagger_patch_api— write (state-changing)swagger_publish_portal_product— write (state-changing)swagger_resolve_organization_portal— write (state-changing)swagger_scan_api_standardization— readswagger_scan_api_standardization_from_registry— readswagger_search_apis_and_domains— readswagger_standardize_api— write (state-changing)swagger_update_document— write (state-changing)swagger_update_portal— write (state-changing)swagger_update_portal_product— write (state-changing)swagger_validate_api— readzephyr_create_folder— write (state-changing)zephyr_create_test_case— write (state-changing)zephyr_create_test_case_issue_link— write (state-changing)zephyr_create_test_case_steps— write (state-changing)zephyr_create_test_case_web_link— write (state-changing)zephyr_create_test_cycle— write (state-changing)zephyr_create_test_cycle_issue_link— write (state-changing)zephyr_create_test_cycle_web_link— write (state-changing)zephyr_create_test_execution— write (state-changing)zephyr_create_test_execution_issue_link— write (state-changing)zephyr_create_test_script— write (state-changing)zephyr_get_environments— readzephyr_get_folders— readzephyr_get_issue_link_test_cases— readzephyr_get_priorities— readzephyr_get_project— readzephyr_get_projects— readzephyr_get_statuses— readzephyr_get_test_case— readzephyr_get_test_case_links— readzephyr_get_test_case_steps— readzephyr_get_test_cases— readzephyr_get_test_cycle— readzephyr_get_test_cycle_links— readzephyr_get_test_cycles— readzephyr_get_test_cycles_linked_to_a_jira_issue— readzephyr_get_test_execution— readzephyr_get_test_execution_links— readzephyr_get_test_execution_steps— readzephyr_get_test_executions— readzephyr_get_test_executions_linked_to_a_jira_issue— readzephyr_get_test_plans— readzephyr_get_test_script— readzephyr_update_test_case— write (state-changing)zephyr_update_test_cycle— write (state-changing)zephyr_update_test_execution— write (state-changing)zephyr_update_test_execution_steps— write (state-changing)
listing-flags calls_need_key or auth_kind
Score 70/100 · Tools 316 · Token cost approx. 230,507 tokens · Compare · Last tested 2026-11-11 · Version tested 0.43.0 · Package @smartbear/mcp · Repo SmartBear/smartbear-mcp
Summary: SmartBear MCP (official) completed an MCP handshake without credentials and exposed 316 tools.
Evidence summary
- Handshake
- pass
- Tools listed
- 316
- Context cost
- approx. 230507 tokens, cl100k estimate (316 tools, measured 2026-11-11, version 0.43.0; an estimate) ranking · add up your servers' context cost
- API key
- Connects without a key; tool calls need one
- Tested
- 2026-11-11
Test results
| Test | Result | Points | Evidence |
|---|---|---|---|
| install | pass | 20 | npm install @smartbear/mcp (Node 20, Linux) succeeded in 7s. |
| handshake | pass | 30 | MCP initialize + tools/list over stdio succeeded with no credentials; 316 tools listed in 10.7s. |
| maintenance | pass | 25 | Repo pushed 1 days before test; 44 GitHub stars. |
| docs | pass | 15 | README over 3,000 chars; install instructions present; mcpServers config example present. Check of the package's own README (README shipped in npm package). |
| license | pass | 10 | MIT (OSI-approved). |
Local-model readiness
Token cost (estimate): approx. 230507 tokens, cl100k estimate for 316 tools · about 2814% of an 8k context. This is an estimate from our testing (counted with cl100k_base).
Small-model friendly (schema heuristic, not a model result): unknown.
Not tested
Small-model task runs: Not yet tested.
What we tested and what we didn't
Tested on 2026-11-11
- Install from the registry
- We connected with no credentials and asked for its tool list: it listed 316 tools (Method details: MCP
initializethentools/list) - Maintenance signals (last push, archived/deprecated status)
- Docs (README length, install and config example)
- License (OSI-approved or not)
- Token cost (estimate)
Not tested
- Security: not audited (no code review, no permission or data-flow analysis)
- Real tasks (no functional task runs yet)
- Behaviour with real credentials or a real account
- Performance, rate limits or load
- Correctness of results beyond the listed tasks
Methodology: how we test. A high score means it installs and responds, not that giving it access to your data carries no risk.
Known security issues
Checked on 2026-11-11 for version 0.43.0 against OSV, GitHub advisories, GitHub repository advisories. Scope: the package itself; dependencies not scanned.
No published advisories found in OSV and GitHub advisories for @smartbear/mcp 0.43.0 as of 2026-11-11. This is not a security audit.
Monthly roundup: MCP security issues, October 2026.
Tool list changes
Unchanged since the previous snapshot (latest 2026-11-11).
Snapshot hash (fingerprint of the tool list)
9fb7542d9611: SHA-256 of the canonical tool names, descriptions and input schemas. If it changes, the tool list changed.
Raw test record (JSON)
{
"name": "@smartbear/mcp",
"version": "0.43.0",
"registry": "npm",
"status": "working",
"tested": "2026-11-11",
"tools_count": 316,
"deprecated": false,
"archived": false,
"tests": {
"install": [
"pass",
20,
"`npm install @smartbear/mcp` (Node 20, Linux) succeeded in 7s."
],
"handshake": [
"pass",
30,
"MCP `initialize` + `tools/list` over stdio succeeded with no credentials; 316 tools listed in 10.7s."
],
"maintenance": [
"pass",
25,
"Repo pushed 1 days before test; 44 GitHub stars."
],
"docs": [
"pass",
15,
"README over 3,000 chars; install instructions present; `mcpServers` config example present. Check of the package's own README (README shipped in npm package)."
],
"license": [
"pass",
10,
"MIT (OSI-approved)."
]
}
}Install
npx -y @smartbear/mcp
Pin the version we tested
npx -y @smartbear/mcp@0.43.0
tested 2026-11-11. Newer versions may differ and were not tested by us.
{
"mcpServers": {
"smartbear-mcp": {
"command": "npx",
"args": [
"-y",
"@smartbear/mcp@0.43.0"
]
}
}
}Tools listed
bearq_chat_with_qa_lead, bearq_delete_test_cases, bearq_expand_application_model, bearq_get_task, bearq_get_task_status, bearq_get_workflow_run, bearq_list_environments, bearq_list_workflows, bearq_run_regression_tests, bearq_run_test_cases, bearq_run_tests_in_functional_areas, bearq_run_workflow, bearq_stop_task, bearq_stop_workflow_run, bearq_wait_for_task, bugsnag_get_build, bugsnag_get_current_project, bugsnag_get_error, bugsnag_get_event, bugsnag_get_event_details_from_dashboard_url, bugsnag_get_events_on_an_error, bugsnag_get_network_endpoint_groupings, bugsnag_get_release, bugsnag_get_span_group, bugsnag_get_trace, bugsnag_list_project_errors, bugsnag_list_project_event_filters, bugsnag_list_projects, bugsnag_list_releases, bugsnag_list_span_groups, bugsnag_list_spans, bugsnag_list_trace_fields, bugsnag_set_network_endpoint_groupings, bugsnag_update_error, collaborator_create_remote_system_configuration, collaborator_create_review, collaborator_delete_remote_system_configuration, collaborator_edit_remote_system_configuration, collaborator_find_review_by_id, collaborator_get_reviews
Tool history: captured Nov 11, 2026. All tool history.
Quick config
{
"mcpServers": {
"smartbear-mcp": {
"command": "npx",
"args": [
"-y",
"@smartbear/mcp"
]
}
}
}Add to config Opens the config generator with this server selected.
Setup
- Install. Run
npm install @smartbear/mcp(Node 20). This is the exact command we ran on 2026-11-11. - Configure. Add the mcpServers entry below to your MCP client config.
- Verify. Restart the client and check that tools/list returns tools (316 in our test).
{
"mcpServers": {
"smartbear-mcp": {
"command": "npx",
"args": [
"-y",
"@smartbear/mcp"
]
}
}
}Test history
- 2026-11-11: New
Related: Troubleshooting: Timeout, no response
FAQ
Is SmartBear MCP deprecated?
No. @smartbear/mcp was not deprecated or archived when we last tested it on 2026-11-11.
What replaces SmartBear MCP?
Nothing; SmartBear MCP (official) is not deprecated as of 2026-11-11.
Does SmartBear MCP need an API key?
It connects and lists 316 tools without a key, but its tool calls need one.
Embed the badge
Every tested server gets a free embeddable badge. It shows the current score and test date and expires after 90 days. Testing is free; payment never changes a score.