{"_id":"@cyberlangke/tokkit-servicenow-ai","name":"@cyberlangke/tokkit-servicenow-ai","dist-tags":{"latest":"1.11.0"},"versions":{"1.11.0":{"name":"@cyberlangke/tokkit-servicenow-ai","version":"1.11.0","description":"ServiceNow-AI tokenizer families for tokkit.","type":"module","main":"./dist/index.cjs","module":"./dist/index.js","types":"./dist/index.d.ts","exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js","require":"./dist/index.cjs"}},"scripts":{"build":"tsup","dev":"tsup --watch"},"dependencies":{"@cyberlangke/tokkit-core":"1.11.0"},"publishConfig":{"access":"public"},"repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"homepage":"https://github.com/1cyberlangke1/tokkit#readme","bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"author":{"name":"cyberlangke"},"license":"MIT","gitHead":"fb7187dc8870eb5afcde91c8822dc84e0d491a22","_id":"@cyberlangke/tokkit-servicenow-ai@1.11.0","_nodeVersion":"24.14.0","_npmVersion":"11.9.0","dist":{"integrity":"sha512-766flawrvec0eb9GaLBOYCRVeYka9U6jhOvayYMDDGmPXuC/9TE0UBEr8r2/z5jH2HfipzF8746Na/cIEEVkog==","shasum":"9db8e19e16942b25629500a57241570bab8a86e9","tarball":"https://registry.npmjs.org/@cyberlangke/tokkit-servicenow-ai/-/tokkit-servicenow-ai-1.11.0.tgz","fileCount":10,"unpackedSize":4241291,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEUCIQCE07jT3SbPiu0IPaL1pcw+Szs4Tal//dm8DpPpL/UUcwIgBNQuTvGP/T3Xra/qLJ1ctgpBYhWizmo/VIJTBroJWYk="}]},"_npmUser":{"name":"cyberlangke","email":"3531702083@qq.com"},"directories":{},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/tokkit-servicenow-ai_1.11.0_1775044060910_0.27005697363598236"},"_hasShrinkwrap":false}},"time":{"created":"2026-04-01T11:47:40.825Z","1.11.0":"2026-04-01T11:47:41.232Z","modified":"2026-04-01T11:47:41.438Z"},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"description":"ServiceNow-AI tokenizer families for tokkit.","homepage":"https://github.com/1cyberlangke1/tokkit#readme","repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"author":{"name":"cyberlangke"},"bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"license":"MIT","readme":"# @cyberlangke/tokkit-servicenow-ai\n\nServiceNow-AI 官方文本 tokenizer 的 tokkit 子包。\n\n当前内置 family：\n\n- `apriel-5b`\n  - 覆盖 `ServiceNow-AI/Apriel-5B-Base`\n  - 也聚合当前确认完全复用同一 tokenizer 的 `ServiceNow-AI/Apriel-5B-Instruct`\n\n当前不纳入：\n\n- `ServiceNow-AI/Apriel-Nemotron-15b-Thinker`\n- `ServiceNow-AI/Apriel-H1-15b-Thinker-SFT`\n- `ServiceNow-AI/AprielGuard`\n\n说明：\n\n- `ServiceNow-AI/Apriel-5B-Base` 与 `ServiceNow-AI/Apriel-5B-Instruct` 的 `tokenizer.json` SHA256 一致，因此收口到同一个 `apriel-5b` family。\n- `ServiceNow-AI/Apriel-Nemotron-15b-Thinker` 虽然公开 `tokenizer.json`，但当前 hash 命中现有 `mistral-nemo`，同时它属于 Nemotron 派生线，不作为当前官方主线文本 LLM 包的一部分。\n- `ServiceNow-AI/Apriel-H1-15b-Thinker-SFT` 是 SFT 模型，不纳入当前公开支持范围。\n- `ServiceNow-AI/AprielGuard` 是 guard 模型，不属于当前主线文本 LLM 范围。\n\n## 使用方法\n\n```bash\nnpm install @cyberlangke/tokkit-servicenow-ai\n```\n\n```ts\nimport { getTokenizer } from \"@cyberlangke/tokkit-servicenow-ai\"\n\nconst base = await getTokenizer(\"apriel-5b\")\nconst instruct = await getTokenizer(\"ServiceNow-AI/Apriel-5B-Instruct\")\n\nconsole.log(base.encode(\"Hello, ServiceNow!\"))\nconsole.log(instruct.encode(\"Hello, ServiceNow!\"))\n```\n","readmeFilename":"README.md","_rev":"1-7c40dd1fdcd14b9d74817eb5149f9644"}