{"_id":"@speakeasy-api/docs-mcp-eval","_rev":"31-09418f197d4b0ece22a784ab6a7d5c37","name":"@speakeasy-api/docs-mcp-eval","dist-tags":{"latest":"0.19.1"},"versions":{"0.1.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.1.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.1.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"8bfc254615f093fbad3f2c7f649c7f6d681d3c66","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.1.0.tgz","fileCount":23,"integrity":"sha512-VbYUWaC6/WokaOYDpsTSf+85WYaRLYd3OVaxAHHNZilWCjD21ls702fhHh/pSP+Q2h9IoBLWB/gqLkuaS1MFrA==","signatures":[{"sig":"MEUCIGnpT7tbK1qVOSZN4F6BLad2L4CUzic/RIzl+BhAWc58AiEA8XasI5iZL6sOr+yQCvyBSiRIl9oEqeZIs6pB1+WWtKk=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"unpackedSize":84752},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.1.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},"_resolved":"/private/var/folders/jg/_xpyb539541b73pvh13r_5gr0000gn/T/43006451df3f667f9c39fc624f5aa2d4/speakeasy-api-docs-mcp-eval-0.1.0.tgz","_integrity":"sha512-VbYUWaC6/WokaOYDpsTSf+85WYaRLYd3OVaxAHHNZilWCjD21ls702fhHh/pSP+Q2h9IoBLWB/gqLkuaS1MFrA==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.9.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"25.6.1","dependencies":{"commander":"^13.1.0","@modelcontextprotocol/sdk":"^1.26.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.1.0_1771972552222_0.7869365114024316","host":"s3://npm-registry-packages-npm-production"}},"0.2.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.2.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.2.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"bd46085b6f6c4d3a42d6fedd0550388ce1b527fe","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.2.0.tgz","fileCount":27,"integrity":"sha512-PEvrSwTdpHcxcz7yUZO2CuitBxMKPOUEhT1X6SpaC95tEHlItwfN0HMDlY1h9XRhpOUsBZPwxaQ4IoqKuLFO7Q==","signatures":[{"sig":"MEYCIQCjdxQJ1zQrqkv3nSCGxvCQkMmpbyw4F6arLbM3hnxdKQIhAJoqgxQtJMQWxifljHfpA5fP9jODnCvNqkAAtayhbz2k","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"unpackedSize":111539},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.2.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},"_resolved":"/private/var/folders/jg/_xpyb539541b73pvh13r_5gr0000gn/T/c00bc2bd91f00eed5982148a682653c7/speakeasy-api-docs-mcp-eval-0.2.0.tgz","_integrity":"sha512-PEvrSwTdpHcxcz7yUZO2CuitBxMKPOUEhT1X6SpaC95tEHlItwfN0HMDlY1h9XRhpOUsBZPwxaQ4IoqKuLFO7Q==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.9.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"25.6.1","dependencies":{"commander":"^13.1.0","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.2.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.2.0_1772035680385_0.02428710050780114","host":"s3://npm-registry-packages-npm-production"}},"0.2.1":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.2.1","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.2.1","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"35c41117a92904d8f5910f14955aac051a3d770d","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.2.1.tgz","fileCount":27,"integrity":"sha512-+GFeKdavtxDLvG3ONKeBvGDqeuWLRty867NLDmEn6BeSj/Ps8p1YY2J4UXsJArOB3DTkmjy7lyFmdFmKr99eRw==","signatures":[{"sig":"MEUCIQD042NUTxMqGGlVQZ5bNTe20JOuXvuB9jMq98IitXh4IgIgLJNix2KqLPtCyoiAXMk17YHf+s1jxbhubYJK3ZCvro0=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.2.1","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":111539},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.2.1.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/fc22a9db17256ce66d7eccf9c40074ae/speakeasy-api-docs-mcp-eval-0.2.1.tgz","_integrity":"sha512-+GFeKdavtxDLvG3ONKeBvGDqeuWLRty867NLDmEn6BeSj/Ps8p1YY2J4UXsJArOB3DTkmjy7lyFmdFmKr99eRw==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"commander":"^13.1.0","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.2.1"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.2.1_1772066547791_0.38432549601391686","host":"s3://npm-registry-packages-npm-production"}},"0.3.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.3.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.3.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"f90f39239418e229842b71a77baf25c0aa90261e","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.3.0.tgz","fileCount":63,"integrity":"sha512-vU5xOwQOvpVl7ZPpdI+jkO0ywMKG4ovcTLWFC8syW71agjzxnE+lasVp8mXIEs6NZtmkoKlDyGbdveuEepUJWQ==","signatures":[{"sig":"MEYCIQD6ErJ4I3Ny5+8ktObEG01XXGQ3CnoF+QgYY8kS17nvUQIhAMzw8/EazMOlMYe97FxZlRVS7yxKTIC0buJYYhZaEMAY","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.3.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":258911},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.3.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/aafb9c507d6ba1cf95dbed4c834cea04/speakeasy-api-docs-mcp-eval-0.3.0.tgz","_integrity":"sha512-vU5xOwQOvpVl7ZPpdI+jkO0ywMKG4ovcTLWFC8syW71agjzxnE+lasVp8mXIEs6NZtmkoKlDyGbdveuEepUJWQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.3.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.3.0_1772196816650_0.8100797761498404","host":"s3://npm-registry-packages-npm-production"}},"0.4.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.4.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.4.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"dc3d3749880478b88d7885b748d3e58e6032e5bd","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.4.0.tgz","fileCount":63,"integrity":"sha512-VMAsVUZ311AbeRFE4y0WOdJhaaCA74jyp1bo7mm5WXEGEQVw1DVJiEcDwSXEOY8ch/EExOZHRZ13WuX1AVrcZQ==","signatures":[{"sig":"MEUCIQCl6EiWdqc0fxLBj7LvF/Y/Llw22b6h62XvhlA1RiqisAIgPdzGqRTwA9X65IiPozrY6S8Hv9m5ynTqHhoxUjLVbuU=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.4.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":259717},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.4.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/40d656716ca15a3a10720fde1d827289/speakeasy-api-docs-mcp-eval-0.4.0.tgz","_integrity":"sha512-VMAsVUZ311AbeRFE4y0WOdJhaaCA74jyp1bo7mm5WXEGEQVw1DVJiEcDwSXEOY8ch/EExOZHRZ13WuX1AVrcZQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.4.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.4.0_1772207017931_0.4813949220084346","host":"s3://npm-registry-packages-npm-production"}},"0.4.1":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.4.1","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.4.1","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"8d356a6a02ff49c3f6fee8827de70a39bf423d0d","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.4.1.tgz","fileCount":63,"integrity":"sha512-U+orZv0vc1RXzVSMTQLTwy7kcw5hIIC/ycwbC0aR+ZNJ0CDxQnQVO0Zz0d0FQbSwQSXmjRelHD2lju7hraPBfQ==","signatures":[{"sig":"MEUCIBMeRfmM92rjrGYPdBfd7KdJ1lIUmWeBad0eGn4I7TiZAiEAkXHhXUeV6Th1+cQx9PnyvKhugnjvAuQ6QvG/h85MFdI=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.4.1","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":259717},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.4.1.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/e0592c2774fe86333587bf50a4c26495/speakeasy-api-docs-mcp-eval-0.4.1.tgz","_integrity":"sha512-U+orZv0vc1RXzVSMTQLTwy7kcw5hIIC/ycwbC0aR+ZNJ0CDxQnQVO0Zz0d0FQbSwQSXmjRelHD2lju7hraPBfQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.4.1","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.4.1_1772213694972_0.18203508069091012","host":"s3://npm-registry-packages-npm-production"}},"0.4.2":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.4.2","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.4.2","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"f3b049b0739ac111396778299d7e904e8009773f","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.4.2.tgz","fileCount":63,"integrity":"sha512-bP2Har1vqddkqVBQlc+aD5GQSvS5p0AQvE00Lh6GVE/YBhAqk6WfIT296duPRwhiE5i2PNpX42mfMjXrsKOKaQ==","signatures":[{"sig":"MEUCIQDMDWEJVmjGm9aIdErnuv5dXkPr1cnigp4SJOuYw6/79gIgJDAt4XUyX1U+KxCSMiGeQhdM/vlpWT8rBwmNwAHQ6wU=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.4.2","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":259717},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.4.2.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/b803f41a152d2d6e53f5120f3bd84a89/speakeasy-api-docs-mcp-eval-0.4.2.tgz","_integrity":"sha512-bP2Har1vqddkqVBQlc+aD5GQSvS5p0AQvE00Lh6GVE/YBhAqk6WfIT296duPRwhiE5i2PNpX42mfMjXrsKOKaQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.4.2","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.4.2_1772214797623_0.09974849421489762","host":"s3://npm-registry-packages-npm-production"}},"0.5.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.5.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.5.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"ba21bf3dbe3d0a95440fc86ffe222f2d83b2d79f","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.5.0.tgz","fileCount":75,"integrity":"sha512-dQXeSg0I8IW81Kw02ROgFMRF4QD2uAX8vL3CGi+x1gIegiYRRXapv8AggQMY8Sm/zRKFjYYjvcdKnvFSQP/4HA==","signatures":[{"sig":"MEUCIQDZlV6M34BWynhY/ZedTRFtgteIEHQlA2V2XS+s+XAhTwIgTMqFRuU0M2OJGEUxYEwYnU8G1RoLR+5w5g+tErdGOCs=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.5.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":327655},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.5.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/a4b8770e75db4a3032d72de3b97e0fe0/speakeasy-api-docs-mcp-eval-0.5.0.tgz","_integrity":"sha512-dQXeSg0I8IW81Kw02ROgFMRF4QD2uAX8vL3CGi+x1gIegiYRRXapv8AggQMY8Sm/zRKFjYYjvcdKnvFSQP/4HA==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.5.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.5.0_1772223110943_0.687622853207398","host":"s3://npm-registry-packages-npm-production"}},"0.6.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.6.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.6.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"3b77c0aa69c01e5468169be57db6ef840667deb6","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.6.0.tgz","fileCount":75,"integrity":"sha512-yrpM+P2NoZtphmdZhk3KrGDLDLxmbcwyRtVVorRFi8xqsVpPP4yBIJ3jAvPpAGYES3jp4QAxj603OqfXFhzKuA==","signatures":[{"sig":"MEYCIQCj82p1DrY5krknVahdjnuvK56Et7smWSiCn+XvhwE/UAIhAIosPZigxI5li/tq6l/jCsIfWfl6UyphtucgcKPpsNbU","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.6.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":327655},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.6.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/f56758afdee39766a52d0f6e7ac10a44/speakeasy-api-docs-mcp-eval-0.6.0.tgz","_integrity":"sha512-yrpM+P2NoZtphmdZhk3KrGDLDLxmbcwyRtVVorRFi8xqsVpPP4yBIJ3jAvPpAGYES3jp4QAxj603OqfXFhzKuA==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.6.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.6.0_1772229973943_0.8493126034049494","host":"s3://npm-registry-packages-npm-production"}},"0.7.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.7.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.7.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"c20fdd7f5194e9d1b06f8b0138af07dff5e2f01d","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.7.0.tgz","fileCount":75,"integrity":"sha512-V77obawnPtAkNXTbEy+qkfPEWx+anBu27l/ti5T7ok+fBIJCTSvO17Tj4a7RdZFIxulcXAs6smuaUikvWkQiUg==","signatures":[{"sig":"MEUCIFPs8BU9js/sBwYQui3cttOvJnebwzpeHRKsteKw9FOMAiEA/mqHs0Vdy1LSr64XY35PMnW4KlBwACSHwclKaE0c5tU=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.7.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":327471},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.7.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/9ace67e400ff63b28419dc6966d9cb76/speakeasy-api-docs-mcp-eval-0.7.0.tgz","_integrity":"sha512-V77obawnPtAkNXTbEy+qkfPEWx+anBu27l/ti5T7ok+fBIJCTSvO17Tj4a7RdZFIxulcXAs6smuaUikvWkQiUg==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.7.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.7.0_1772372995097_0.23288211991843433","host":"s3://npm-registry-packages-npm-production"}},"0.8.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.8.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.8.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"2615c8c61c360a535f7dceccffd1aff9e4c74c32","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.8.0.tgz","fileCount":75,"integrity":"sha512-KbnT/0GdFPRrG4k9LTwb9ZAMnOKqY3dXTY1D6lshFzlj4l/GukDJ3vwU+fkyWe1hsRYXW5VvW3jknUp4J6JVGw==","signatures":[{"sig":"MEYCIQCpyUssPikftRp4nfjqfQ3oFQBZXH84RUwEk7xNv26QwwIhAIY/H3X2B+Y5dBRY2Z3tuUbIDSVcgrvPa08uv988T95I","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.8.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":327471},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.8.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/4afeb4b93a9164ed3f56cc083ddb1d6f/speakeasy-api-docs-mcp-eval-0.8.0.tgz","_integrity":"sha512-KbnT/0GdFPRrG4k9LTwb9ZAMnOKqY3dXTY1D6lshFzlj4l/GukDJ3vwU+fkyWe1hsRYXW5VvW3jknUp4J6JVGw==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.8.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.8.0_1772445363390_0.02270578112007149","host":"s3://npm-registry-packages-npm-production"}},"0.9.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.9.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.9.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"a63e2ca0bfff540e08d4a38644c2d2508315023b","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.9.0.tgz","fileCount":79,"integrity":"sha512-7MVHcfqOpvhSVwXMIA/GOwRHKODiWYVCM89WGyhZ0o0FHhOj7AmtcMmxhv1nQ0VR+WwGB7Tg8xmJHHxFZCn91w==","signatures":[{"sig":"MEUCIHt9tLI/oyuNSbAiGGCeNAO/SHhprYYlkOokkiv7/5ZfAiEA10ikhmMNulbMeBAfYGSSD8NSWHuZq8pTWJl2j+SeRos=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.9.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":388431},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.9.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/bbc65b4c3fe31d2b1025470d24794cbf/speakeasy-api-docs-mcp-eval-0.9.0.tgz","_integrity":"sha512-7MVHcfqOpvhSVwXMIA/GOwRHKODiWYVCM89WGyhZ0o0FHhOj7AmtcMmxhv1nQ0VR+WwGB7Tg8xmJHHxFZCn91w==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.9.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.9.0_1772472043188_0.582589127769864","host":"s3://npm-registry-packages-npm-production"}},"0.10.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.10.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.10.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"2b57013fdc848423c1ffa3a97486eb4e6aa7f88b","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.10.0.tgz","fileCount":79,"integrity":"sha512-MAMEeQmLCW3P1NGJo1qPnNUEVkht7DeGcMswaA8a+q1g5fBF4dB6+rh7InalhoShTO4vExDYWcE9gqR6LQ2Rtg==","signatures":[{"sig":"MEUCIQCewX3TEGWuZ2TU7warrKIIa6ptws4l49/TyMSbQJs6dgIgfGkPC1kLqPajXFMaAzgUCsJVzpBpvflWgOjaetLr5z4=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.10.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":392400},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.10.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/8c8973231a527865adbf6f1c9bc6e123/speakeasy-api-docs-mcp-eval-0.10.0.tgz","_integrity":"sha512-MAMEeQmLCW3P1NGJo1qPnNUEVkht7DeGcMswaA8a+q1g5fBF4dB6+rh7InalhoShTO4vExDYWcE9gqR6LQ2Rtg==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.10.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.10.0_1772475453032_0.4258706126298697","host":"s3://npm-registry-packages-npm-production"}},"0.11.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.11.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.11.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"e0c6ebc61e30c6ea72a0b34149858deff54c6e64","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.11.0.tgz","fileCount":79,"integrity":"sha512-Zo31qZ20+8SVhFIFezDenM1zYzodwJxmW/erD1QxiqmQ5VXFQF+rmXegLI57Aq2BDQh7Bv5MQ5qaqpb63f11uQ==","signatures":[{"sig":"MEYCIQCcB+KFPm5lvClwFVm9kuMYLPXCpHJGFKbmT9eNREyPTgIhAP+fui8u3ApY3uDFgQeSyJEJBPhCOxbsNV0Vsb8s6fXK","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.11.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":403209},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.11.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/132e26b5c612edc2ab58670b6f5de93d/speakeasy-api-docs-mcp-eval-0.11.0.tgz","_integrity":"sha512-Zo31qZ20+8SVhFIFezDenM1zYzodwJxmW/erD1QxiqmQ5VXFQF+rmXegLI57Aq2BDQh7Bv5MQ5qaqpb63f11uQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.11.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.11.0_1772555636288_0.8061165259028524","host":"s3://npm-registry-packages-npm-production"}},"0.12.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.12.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.12.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"6f0fec44fd4d235f8f06a1e266e14e39cd59fa87","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.12.0.tgz","fileCount":83,"integrity":"sha512-czuGwT60xHag4cqs4Wb7SSoSkaZQbcqgHUF3DQUH6/6JowjfUEwRqQiIxbemlNXdYsL64BTllvHFy0arssS9wQ==","signatures":[{"sig":"MEYCIQC29mG31nId/8nGw1U+e/zaOYyrx4qJNKOsyH+wdz2+bQIhAKxoCEoDOBzhYacjXcG0gO02VrExuwxNHK4AxuEHCf1l","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.12.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":432319},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.12.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/a63932f19496a580fe922aedcd04daae/speakeasy-api-docs-mcp-eval-0.12.0.tgz","_integrity":"sha512-czuGwT60xHag4cqs4Wb7SSoSkaZQbcqgHUF3DQUH6/6JowjfUEwRqQiIxbemlNXdYsL64BTllvHFy0arssS9wQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-core":"0.12.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.12.0_1772566524075_0.17850290036069905","host":"s3://npm-registry-packages-npm-production"}},"0.12.1":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.12.1","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.12.1","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"15e647b715c0162ab7e1bc79d97c79b27f43b205","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.12.1.tgz","fileCount":83,"integrity":"sha512-aWyS/IgYHx34IcOvWQLb36FCcBFdFAE1MKcyoAe8Rrj9S3SaDW2AleqYp921JWHEM92AtsC2xg3zuKvK6tQj/g==","signatures":[{"sig":"MEUCIQC05c0I5qsoBqGwZa9rBAOXmp9Yb5bhMjSR4/i8LntdFAIgFYoN/AffHwhV+36wbFKXU/Zn+9jGs9/VvqTHw1Xe6tY=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.12.1","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":435887},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.12.1.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/4e5ed638e48d3f485f35e81e6b005530/speakeasy-api-docs-mcp-eval-0.12.1.tgz","_integrity":"sha512-aWyS/IgYHx34IcOvWQLb36FCcBFdFAE1MKcyoAe8Rrj9S3SaDW2AleqYp921JWHEM92AtsC2xg3zuKvK6tQj/g==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.12.1","@speakeasy-api/docs-mcp-core":"0.12.1","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.12.1_1772586332346_0.7303285080273638","host":"s3://npm-registry-packages-npm-production"}},"0.13.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.13.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.13.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"8ef7d71cf2960fc653cac94359ed693c0977626a","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.13.0.tgz","fileCount":83,"integrity":"sha512-JKQAt4b4yeb4yPx1OOSREmu6kA/uif/5t43hFD2JsDKTA7P3BadBKzF6g0zcbhujQx4h9688jHqNTOoVsgyAWA==","signatures":[{"sig":"MEQCIAxuTTkWm8QmAGZZIwLSku2sYNlUpNK8/0E2Ma5GrViwAiAJv/KkwT/yN4qxqTxIUa5wCBKVvyG+DrRazwkezc0AMA==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.13.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436829},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.13.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/277db3cf4d2e3e4954649749a454e76f/speakeasy-api-docs-mcp-eval-0.13.0.tgz","_integrity":"sha512-JKQAt4b4yeb4yPx1OOSREmu6kA/uif/5t43hFD2JsDKTA7P3BadBKzF6g0zcbhujQx4h9688jHqNTOoVsgyAWA==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.13.0","@speakeasy-api/docs-mcp-core":"0.13.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.13.0_1772661658263_0.20778031330773694","host":"s3://npm-registry-packages-npm-production"}},"0.14.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.14.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.14.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"98ce3a62fef5cb682fd86ed997192c4d60e923be","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.14.0.tgz","fileCount":83,"integrity":"sha512-uD4mve83+WXIvVvNvGheQOFLunVDmnBGDmiyllU+2B5MptL0NxAKn0sV2nO6iL/9peuMKu3Fg5BYDG3bXJhnIQ==","signatures":[{"sig":"MEYCIQCnQ/FBRA41YPQ3F2RVh73dGXxOT+9gaxXpeupSj7DzhAIhANrcAesybXFlyZ7Va6tUsjxXmvtIPZd9tnTo9LguMYfN","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.14.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436829},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.14.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src test","test":"vitest run","build":"tsc -p tsconfig.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/735bd6a1b27e86bc588f36799416820b/speakeasy-api-docs-mcp-eval-0.14.0.tgz","_integrity":"sha512-uD4mve83+WXIvVvNvGheQOFLunVDmnBGDmiyllU+2B5MptL0NxAKn0sV2nO6iL/9peuMKu3Fg5BYDG3bXJhnIQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.14.0","@speakeasy-api/docs-mcp-core":"0.14.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.14.0_1772666604679_0.01834270738795185","host":"s3://npm-registry-packages-npm-production"}},"0.15.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.15.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.15.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"85ad4c779832fcbc390756cdefd16a410e3659e4","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.15.0.tgz","fileCount":83,"integrity":"sha512-Tf4j9Gwru1D54g6pZUwOEpun5wsKf3fhwLGqvkuyGoCQUHZq//AVJrOvuLZfmA9mq2qhIvcLXNzevTy1sPHBiw==","signatures":[{"sig":"MEUCIQDOUb5sMlJX/UXirBK1upULYnzKCt9jbl8nPQ16tbKO3gIgX+nV1wGy7AXqa8xjHDmyvxRObb6gLEe4Sqys8Ds0m88=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.15.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436830},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.15.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/04ef7fcdc2d85abd637ebb4605706255/speakeasy-api-docs-mcp-eval-0.15.0.tgz","_integrity":"sha512-Tf4j9Gwru1D54g6pZUwOEpun5wsKf3fhwLGqvkuyGoCQUHZq//AVJrOvuLZfmA9mq2qhIvcLXNzevTy1sPHBiw==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.15.0","@speakeasy-api/docs-mcp-core":"0.15.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.15.0_1773132254247_0.41709755905157686","host":"s3://npm-registry-packages-npm-production"}},"0.15.1":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.15.1","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.15.1","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"ac59840f66b48a9cb433f859141408ad2dfa69c5","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.15.1.tgz","fileCount":83,"integrity":"sha512-Nbwr6SElcYq1Io+pZa/kdS4JMTXiELscw4BnBcv5FLts7Yxe0lOIX9zhr+DCSWpBWKcxO2gwOCuuNhy9uzcOxQ==","signatures":[{"sig":"MEQCIDta76JugmdasAFh54hgyztUa9wQFjeJkSh1YokgbnA8AiBa5rmlYmlRfeYeNI07up0F9/9ligDeMCFbZI/A5m588A==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.15.1","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436830},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.15.1.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/990489062d315c2a0d2c3fcc140a26b7/speakeasy-api-docs-mcp-eval-0.15.1.tgz","_integrity":"sha512-Nbwr6SElcYq1Io+pZa/kdS4JMTXiELscw4BnBcv5FLts7Yxe0lOIX9zhr+DCSWpBWKcxO2gwOCuuNhy9uzcOxQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.15.1","@speakeasy-api/docs-mcp-core":"0.15.1","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.15.1_1773136825584_0.8319459632193797","host":"s3://npm-registry-packages-npm-production"}},"0.16.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.16.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.16.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"6d934d29167c011d7745b8d69ff392d7e7ea9051","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.16.0.tgz","fileCount":83,"integrity":"sha512-xGQP0m4HzeD1BFQgqWydK9XwgVjnN+8g7YF6i79J8op039XhmsTcYP1eaMIXQUPfvgffm7zbdWF/79QfA4ntmw==","signatures":[{"sig":"MEQCIGYsdK+QC3Iux9RUR5Q6TffUMoGKpwMPgYizIV8MXvMZAiA+7SI3GtQewi8BmKPMFHc2/4J8eT0eCVbEyYv6O5Q8Wg==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.16.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436830},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.16.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/a9771859b14d460ae1f232bb3662cd2f/speakeasy-api-docs-mcp-eval-0.16.0.tgz","_integrity":"sha512-xGQP0m4HzeD1BFQgqWydK9XwgVjnN+8g7YF6i79J8op039XhmsTcYP1eaMIXQUPfvgffm7zbdWF/79QfA4ntmw==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.16.0","@speakeasy-api/docs-mcp-core":"0.16.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.16.0_1773148974171_0.42052549805070827","host":"s3://npm-registry-packages-npm-production"}},"0.16.1":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.16.1","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.16.1","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"a10287b3469c5bc0c22b4ae85791222219235bdd","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.16.1.tgz","fileCount":83,"integrity":"sha512-ZTIlYa2kct2PAeEDsHYDn7ql7Bb2HelQxyRTofj7VcGI1KEheNoTDNjBqotByJE2bnetLq62RgO3K3Nhb7s9Ug==","signatures":[{"sig":"MEUCIQCx0YD1jz0ICFWuc8CcEhneg2sKfmp7dyJUks4hxtdZhQIgWAosRlIRYXI/srCIMi+yx3WVtFGrCyput3spXubR7uo=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.16.1","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436830},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.16.1.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/ae48141c59ada10d846e8a40e340dbb1/speakeasy-api-docs-mcp-eval-0.16.1.tgz","_integrity":"sha512-ZTIlYa2kct2PAeEDsHYDn7ql7Bb2HelQxyRTofj7VcGI1KEheNoTDNjBqotByJE2bnetLq62RgO3K3Nhb7s9Ug==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.16.1","@speakeasy-api/docs-mcp-core":"0.16.1","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.16.1_1773150643242_0.36324576149598586","host":"s3://npm-registry-packages-npm-production"}},"0.16.2":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.16.2","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.16.2","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"f12ba187d139bf3e055bf7b0996186065925beb3","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.16.2.tgz","fileCount":83,"integrity":"sha512-mbqWUxZVRYH+OGxIRBYhQIeUkGo7jkTGwnZXZYhHR63CrzMKSDwbmjqVYYOxWjO/1UsEWLARQ9AHnbn8EsqR1w==","signatures":[{"sig":"MEUCID6EBFs9QYKFqi5Um23b1bo8BURklFC4IwDthC8iCQvnAiEA3FEtnHyGIFrM/fJS3jlSMtfmta0RTUHr3ZUYHHRdqu4=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.16.2","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436830},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.16.2.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/562402ed48c3f49391aaa9836d45cb0b/speakeasy-api-docs-mcp-eval-0.16.2.tgz","_integrity":"sha512-mbqWUxZVRYH+OGxIRBYhQIeUkGo7jkTGwnZXZYhHR63CrzMKSDwbmjqVYYOxWjO/1UsEWLARQ9AHnbn8EsqR1w==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.16.2","@speakeasy-api/docs-mcp-core":"0.16.2","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.16.2_1773152669040_0.9827788147539269","host":"s3://npm-registry-packages-npm-production"}},"0.16.3":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.16.3","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.16.3","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"4165af3c700ba62d6a8d328552a2f7eda0de5b70","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.16.3.tgz","fileCount":83,"integrity":"sha512-KJgpLwZKc4x/S60OsY91QErOZfFN7qkvhL5vvElt/vl+O9AOBZPafhqvypg9foB/W+XoVrqi2adAcVAV0k4J0g==","signatures":[{"sig":"MEQCIC3Rx1o+HJvyga69kwdusrTaO5L25TOkL0DOEEMEdD74AiB+TLZA+hO+xXv9vaysoMLfRp3YXxveqv/dCHatFtunvw==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.16.3","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436830},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.16.3.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/47811276cc1ad2c362183c88a78ea039/speakeasy-api-docs-mcp-eval-0.16.3.tgz","_integrity":"sha512-KJgpLwZKc4x/S60OsY91QErOZfFN7qkvhL5vvElt/vl+O9AOBZPafhqvypg9foB/W+XoVrqi2adAcVAV0k4J0g==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.11.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.22.0","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.16.3","@speakeasy-api/docs-mcp-core":"0.16.3","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.16.3_1773253898952_0.425940122047606","host":"s3://npm-registry-packages-npm-production"}},"0.17.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.17.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.17.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"alex-speakeasy","email":"alex.martin@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"db743a11a9e29258acf8006a0d1585b1873c0d2c","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.17.0.tgz","fileCount":83,"integrity":"sha512-2YTNcI29YcwTrzvBMDNYFmxissmo+B0GNqFb/lRk47bg5QA+O8w6M5Rbce1J86hBPwC/MKe1Id2kRyrIIHNpzg==","signatures":[{"sig":"MEUCIQCwA5ncG8j7l5liuwSQH1Hpbwy/QVQa2m7q+Ny+XNQv4QIgb/12JG16GJmVhXOczVmR/RJI99p51EZ/v0NDxhDumEU=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.17.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436830},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.17.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/231b41cf0b776552f0490f3ed3772d70/speakeasy-api-docs-mcp-eval-0.17.0.tgz","_integrity":"sha512-2YTNcI29YcwTrzvBMDNYFmxissmo+B0GNqFb/lRk47bg5QA+O8w6M5Rbce1J86hBPwC/MKe1Id2kRyrIIHNpzg==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.18.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.23.1","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.17.0","@speakeasy-api/docs-mcp-core":"0.17.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.17.0_1785187215382_0.5083329344776886","host":"s3://npm-registry-packages-npm-production"}},"0.17.1":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.17.1","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.17.1","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"alex-speakeasy","email":"alex.martin@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"1beefd3fe403e85b2fcee4f33418d4f080477f86","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.17.1.tgz","fileCount":83,"integrity":"sha512-4Dd2PXpjoRJz0deM4RJ+9O/xmF8cRXtZBNFfEcrFV+GCsjs2Ad2anvrUmOITz/+I5lPLbV8qOOcK+MCe5b/jRQ==","signatures":[{"sig":"MEUCIBBvy73Uq1lYAkF1D6CoCqTjIZ0o9BDoi9G16sIsdnc2AiEA8WTGEXNJU+4Cc8BJdaRAWjnO1Atw419UiDydid5JoUA=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.17.1","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436830},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.17.1.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/5edca2776992935952ffbc6f298f0832/speakeasy-api-docs-mcp-eval-0.17.1.tgz","_integrity":"sha512-4Dd2PXpjoRJz0deM4RJ+9O/xmF8cRXtZBNFfEcrFV+GCsjs2Ad2anvrUmOITz/+I5lPLbV8qOOcK+MCe5b/jRQ==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.19.0","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.23.1","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@modelcontextprotocol/sdk":"^1.26.0","@speakeasy-api/docs-mcp-cli":"0.17.1","@speakeasy-api/docs-mcp-core":"0.17.1","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.17.1_1785522150932_0.36294416066324153","host":"s3://npm-registry-packages-npm-production"}},"0.18.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.18.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.18.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"alex-speakeasy","email":"alex.martin@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"9407afc68d3eb04fdcafbc97b589a96f6616da42","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.18.0.tgz","fileCount":83,"integrity":"sha512-SVXUJvAewB6ojDZgslitnzo7hEQb1zp2zptjx+tRxyw80vSw8Kp5DR5mpwRr91cnkPlswp2sGXnrA7t1NytByA==","signatures":[{"sig":"MEYCIQD8wsK+mQ0iQVrdxBayPFQD+P4oqFcj7tjR1RVugsIiEgIhAL58mZo8uDoP4bYMhzFx1dVndg1GTaLPAolycqlfLwbH","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.18.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436812},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.18.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/fe39bea0ed97cb372675e142ddf3ca03/speakeasy-api-docs-mcp-eval-0.18.0.tgz","_integrity":"sha512-SVXUJvAewB6ojDZgslitnzo7hEQb1zp2zptjx+tRxyw80vSw8Kp5DR5mpwRr91cnkPlswp2sGXnrA7t1NytByA==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.19.1","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.23.2","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@speakeasy-api/docs-mcp-cli":"0.18.0","@modelcontextprotocol/client":"^2.0.0","@speakeasy-api/docs-mcp-core":"0.18.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.18.0_1788488785598_0.8842756622742709","host":"s3://npm-registry-packages-npm-production"}},"0.19.0":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.19.0","author":{"url":"https://speakeasy.com","name":"Speakeasy","email":"info@speakeasy.com"},"license":"AGPL-3.0-only","_id":"@speakeasy-api/docs-mcp-eval@0.19.0","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"alex-speakeasy","email":"alex.martin@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"dist":{"shasum":"563ffe39e5c171b6b3b88749a6acc2bdb55f7e80","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.19.0.tgz","fileCount":83,"integrity":"sha512-p1USwltIWX+UdQns02Z8ojwmlOSQbAijlnKAgC7PcyovSkJANSYefWazxibeCWFjsMtKX5pUQabSCp8WHhgbnw==","signatures":[{"sig":"MEYCIQCBWRI4sLOn7icrzHwo3P9x3TdWdmuugQ5rEojjSXBIKgIhAPBgA0VxzKoOdCW8tTOdo87yvzS5aQsvCp1+3TT4lfKo","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.19.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":436812},"main":"dist/index.js","type":"module","_from":"file:speakeasy-api-docs-mcp-eval-0.19.0.tgz","types":"dist/index.d.ts","engines":{"node":">=22.0.0"},"exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"scripts":{"lint":"eslint src","test":"vitest run","build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit"},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"_resolved":"/tmp/a58a0d6ac9b1b0619dfd5890038d253f/speakeasy-api-docs-mcp-eval-0.19.0.tgz","_integrity":"sha512-p1USwltIWX+UdQns02Z8ojwmlOSQbAijlnKAgC7PcyovSkJANSYefWazxibeCWFjsMtKX5pUQabSCp8WHhgbnw==","repository":{"url":"git+https://github.com/speakeasy-api/docs-mcp.git","type":"git","directory":"packages/eval"},"_npmVersion":"11.19.1","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","directories":{},"_nodeVersion":"22.23.2","dependencies":{"yaml":"^2.7.0","dotenv":"^16.4.7","commander":"^13.1.0","cli-highlight":"^2.1.11","@speakeasy-api/docs-mcp-cli":"0.19.0","@modelcontextprotocol/client":"^2.0.0","@speakeasy-api/docs-mcp-core":"0.19.0","@anthropic-ai/claude-agent-sdk":"^0.1.0"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/docs-mcp-eval_0.19.0_1788527973664_0.17993817355718655","host":"s3://npm-registry-packages-npm-production"}},"0.19.1":{"name":"@speakeasy-api/docs-mcp-eval","version":"0.19.1","description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","license":"AGPL-3.0-only","type":"module","author":{"name":"Speakeasy","email":"info@speakeasy.com","url":"https://speakeasy.com"},"repository":{"type":"git","url":"git+https://github.com/speakeasy-api/docs-mcp.git","directory":"packages/eval"},"homepage":"https://github.com/speakeasy-api/docs-mcp","bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"bin":{"docs-mcp-eval":"dist/bin.js"},"main":"dist/index.js","types":"dist/index.d.ts","exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js"}},"engines":{"node":">=22.0.0"},"dependencies":{"@anthropic-ai/claude-agent-sdk":"^0.1.0","@modelcontextprotocol/client":"^2.0.0","cli-highlight":"^2.1.11","commander":"^13.1.0","dotenv":"^16.4.7","yaml":"^2.7.0","@speakeasy-api/docs-mcp-cli":"0.19.1","@speakeasy-api/docs-mcp-core":"0.19.1"},"scripts":{"build":"tsc -p tsconfig.build.json","typecheck":"tsc -p tsconfig.json --noEmit","test":"vitest run","lint":"eslint src"},"_id":"@speakeasy-api/docs-mcp-eval@0.19.1","_integrity":"sha512-zYJY7lhfq4ZL8tsW18h3g5O3zPi1O8mZDg1gVYWldy5frfgnNXSQO+Y/U41yb5xLUj9yE/On8KvDLplCunwpsw==","_resolved":"/tmp/5644670367601d246840a352df284751/speakeasy-api-docs-mcp-eval-0.19.1.tgz","_from":"file:speakeasy-api-docs-mcp-eval-0.19.1.tgz","_nodeVersion":"22.23.2","_npmVersion":"11.19.1","dist":{"integrity":"sha512-zYJY7lhfq4ZL8tsW18h3g5O3zPi1O8mZDg1gVYWldy5frfgnNXSQO+Y/U41yb5xLUj9yE/On8KvDLplCunwpsw==","shasum":"e830cd61b089f76c204505b1c7254ff78d30dc0d","tarball":"https://registry.npmjs.org/@speakeasy-api/docs-mcp-eval/-/docs-mcp-eval-0.19.1.tgz","fileCount":83,"unpackedSize":436812,"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@speakeasy-api%2fdocs-mcp-eval@0.19.1","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEQCIHcB8pyNrHBHDVDn6jxDxuqe8/lu/WCaKH+19vk5EJPEAiArRh8bBk5jVeqFijtpTrhCCsQZBCzatKFZwsV8ufIwXQ=="}]},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:c4dfe5b7-5ac9-43dc-a5bd-b5c494a08728"}},"directories":{},"maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"alex-speakeasy","email":"alex.martin@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/docs-mcp-eval_0.19.1_1788529797833_0.4806109813577817"},"_hasShrinkwrap":false}},"time":{"created":"2026-02-24T22:35:52.092Z","modified":"2026-09-04T13:49:58.298Z","0.1.0":"2026-02-24T22:35:52.373Z","0.2.0":"2026-02-25T16:08:00.548Z","0.2.1":"2026-02-26T00:42:27.936Z","0.3.0":"2026-02-27T12:53:36.789Z","0.4.0":"2026-02-27T15:43:38.073Z","0.4.1":"2026-02-27T17:34:55.136Z","0.4.2":"2026-02-27T17:53:17.794Z","0.5.0":"2026-02-27T20:11:51.116Z","0.6.0":"2026-02-27T22:06:14.079Z","0.7.0":"2026-03-01T13:49:55.294Z","0.8.0":"2026-03-02T09:56:03.523Z","0.9.0":"2026-03-02T17:20:43.342Z","0.10.0":"2026-03-02T18:17:33.218Z","0.11.0":"2026-03-03T16:33:56.438Z","0.12.0":"2026-03-03T19:35:24.218Z","0.12.1":"2026-03-04T01:05:32.539Z","0.13.0":"2026-03-04T22:00:58.448Z","0.14.0":"2026-03-04T23:23:24.855Z","0.15.0":"2026-03-10T08:44:14.382Z","0.15.1":"2026-03-10T10:00:25.729Z","0.16.0":"2026-03-10T13:22:54.354Z","0.16.1":"2026-03-10T13:50:43.393Z","0.16.2":"2026-03-10T14:24:29.206Z","0.16.3":"2026-03-11T18:31:39.091Z","0.17.0":"2026-07-27T21:20:15.528Z","0.17.1":"2026-07-31T18:22:31.063Z","0.18.0":"2026-09-04T02:26:25.727Z","0.19.0":"2026-09-04T13:19:33.799Z","0.19.1":"2026-09-04T13:49:57.968Z"},"bugs":{"url":"https://github.com/speakeasy-api/docs-mcp/issues"},"author":{"name":"Speakeasy","email":"info@speakeasy.com","url":"https://speakeasy.com"},"license":"AGPL-3.0-only","homepage":"https://github.com/speakeasy-api/docs-mcp","repository":{"type":"git","url":"git+https://github.com/speakeasy-api/docs-mcp.git","directory":"packages/eval"},"description":"Evaluation and benchmarking harness for docs-mcp search quality metrics","maintainers":[{"name":"thomasrooneyspeakeasy","email":"thomas@speakeasyapi.dev"},{"name":"tristanspeakeasy","email":"tristan@speakeasyapi.dev"},{"name":"simplesagar","email":"sagar@speakeasyapi.dev"},{"name":"walker-speakeasy","email":"walker@speakeasy.com"},{"name":"alex-speakeasy","email":"alex.martin@speakeasy.com"},{"name":"adam-speakeasy","email":"adam@speakeasy.com"},{"name":"david-speakeasy","email":"david@speakeasy.com"},{"name":"daniel-speakeasy","email":"daniel@speakeasy.com"},{"name":"ghaidar-speakeasy","email":"georges@speakeasyapi.dev"}],"readme":"# @speakeasy-api/docs-mcp-eval\n\nEvaluation and benchmarking harness for [Speakeasy Docs MCP](https://github.com/speakeasy-api/docs-mcp).\n\n**Beta.** Part of the [`docs-mcp`](https://github.com/speakeasy-api/docs-mcp) monorepo.\n\n## Installation\n\n```bash\nnpm install -g @speakeasy-api/docs-mcp-eval\n```\n\n## Eval Types\n\n### Search-Quality Eval (`run`)\n\nMeasures retrieval quality metrics (MRR, NDCG, precision, latency) by driving the MCP server directly via stdio JSON-RPC.\n\n```bash\ndocs-mcp-eval run --cases ./cases.json \\\n  --server-command \"docs-mcp-server --index-dir ./index\"\n```\n\n- **Recall\\@K** — fraction of expected chunks found in the top-K results\n- **MRR** (Mean Reciprocal Rank) — how early the first relevant result appears\n- **Precision\\@K** — fraction of top-K results that are relevant\n- **Delta reports** — side-by-side comparison between evaluation runs\n\nSee [docs/eval.md](https://github.com/speakeasy-api/docs-mcp/blob/main/docs/eval.md) for the full search-quality eval specification.\n\n### Agent Eval (`agent-eval`)\n\nEnd-to-end evaluation that spawns an AI coding agent with docs-mcp tools, runs it against a prompt, and evaluates assertions on the output. Validates the full stack — from search quality to how well a real model uses the tools.\n\nSupports multiple agent providers:\n\n| Provider | Flag | Backend | Prerequisites |\n|----------|------|---------|---------------|\n| Anthropic | `--provider anthropic` | `@anthropic-ai/claude-agent-sdk` | `ANTHROPIC_API_KEY` |\n| OpenAI Codex | `--provider openai` | `codex exec --json` (CLI spawn) | `OPENAI_API_KEY` + [`codex`](https://github.com/openai/codex) on PATH |\n| Auto (default) | `--provider auto` | Detected from env | Whichever key is set |\n\n```bash\n# Claude (default when ANTHROPIC_API_KEY is set)\ndocs-mcp-eval agent-eval --suite acmeauth\n\n# OpenAI Codex\ndocs-mcp-eval agent-eval --suite dub-go --provider openai\n\n# Custom scenario file\ndocs-mcp-eval agent-eval --scenarios ./my-scenarios.json --docs-dir ./my-docs\n```\n\nSupports `contains`, `not_contains`, `matches`, and `script` assertions, per-scenario docs sources (local path or git clone), auto-built index caching, and trend comparison against prior runs.\n\nSee [docs/agent-eval.md](https://github.com/speakeasy-api/docs-mcp/blob/main/docs/agent-eval.md) for the full agent eval specification.\n\n## License\n\n[AGPL-3.0](https://github.com/speakeasy-api/docs-mcp/blob/main/LICENSE)\n","readmeFilename":"README.md"}