{"_id":"@cyberlangke/tokkit-swiss-ai","name":"@cyberlangke/tokkit-swiss-ai","dist-tags":{"latest":"1.11.0"},"versions":{"1.11.0":{"name":"@cyberlangke/tokkit-swiss-ai","version":"1.11.0","description":"swiss-ai tokenizer families for tokkit.","type":"module","main":"./dist/index.cjs","module":"./dist/index.js","types":"./dist/index.d.ts","exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js","require":"./dist/index.cjs"}},"scripts":{"build":"tsup","dev":"tsup --watch"},"dependencies":{"@cyberlangke/tokkit-core":"1.11.0"},"publishConfig":{"access":"public"},"repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"homepage":"https://github.com/1cyberlangke1/tokkit#readme","bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"author":{"name":"cyberlangke"},"license":"Apache-2.0","gitHead":"6d7b164cdcb511e7f5815e7278708c780b05d938","_id":"@cyberlangke/tokkit-swiss-ai@1.11.0","_nodeVersion":"24.14.1","_npmVersion":"11.11.0","dist":{"integrity":"sha512-ZFBJ7RteBSxFG72Px7FoqX21MD6dKcD7LkgnFR+tX+IpI/6zrGwnQxwPIyX6dnPL7YoSoSunV3rE1MeS2bOHiQ==","shasum":"fc494aac08d4f0b8e84bb8720d7d08b45474bb80","tarball":"https://registry.npmjs.org/@cyberlangke/tokkit-swiss-ai/-/tokkit-swiss-ai-1.11.0.tgz","fileCount":12,"unpackedSize":8491154,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEUCIFH8mXj8KQ9HxTKHU3cCc2zpoLgpD8r+1LbqYrc7WXUtAiEA41ogXgzznaw6sGhy7cfF53I+kzvL+uVR+8pNUNj8iyQ="}]},"_npmUser":{"name":"cyberlangke","email":"3531702083@qq.com"},"directories":{},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/tokkit-swiss-ai_1.11.0_1775231017324_0.31364781822464805"},"_hasShrinkwrap":false}},"time":{"created":"2026-04-03T15:43:37.198Z","1.11.0":"2026-04-03T15:43:37.684Z","modified":"2026-04-03T15:43:37.844Z"},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"description":"swiss-ai tokenizer families for tokkit.","homepage":"https://github.com/1cyberlangke1/tokkit#readme","repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"author":{"name":"cyberlangke"},"bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"license":"Apache-2.0","readme":"# @cyberlangke/tokkit-swiss-ai\n\nswiss-ai 官方 Apertus 文本 tokenizer 的 tokkit 子包。\n\n当前内置 family：\n\n- `apertus`\n  - 覆盖 `swiss-ai/Apertus-8B-2509`\n  - 也聚合当前确认完全复用同一 tokenizer 的 `swiss-ai/Apertus-70B-2509`\n- `apertus-instruct`\n  - 覆盖 `swiss-ai/Apertus-8B-Instruct-2509`\n  - 也聚合当前确认完全复用同一 tokenizer 的 `swiss-ai/Apertus-70B-Instruct-2509`\n\n说明：\n\n- 当前纳入范围只包含 `swiss-ai` 官方组织下公开可下载 `tokenizer.json` 的 Apertus 文本主线。\n- `Apertus-8B-2509` 与 `Apertus-70B-2509` 的 `tokenizer.json` SHA256 一致，因此收口到同一个 `apertus` family。\n- `Apertus-8B-Instruct-2509` 与 `Apertus-70B-Instruct-2509` 的 `tokenizer.json` SHA256 一致，因此收口到同一个 `apertus-instruct` family。\n\n## 使用方法\n\n```bash\nnpm install @cyberlangke/tokkit-swiss-ai\n```\n\n```ts\nimport { getTokenizer } from \"@cyberlangke/tokkit-swiss-ai\"\n\nconst base = await getTokenizer(\"swiss-ai/Apertus-70B-2509\")\nconst instruct = await getTokenizer(\"apertus-instruct\")\n\nconsole.log(base === instruct)\n```\n","readmeFilename":"README.md","_rev":"1-b5287067bca608187f0f724c6a00b62d"}