{"_id":"@cyberlangke/tokkit-ai21labs","name":"@cyberlangke/tokkit-ai21labs","dist-tags":{"latest":"1.11.0"},"versions":{"1.11.0":{"name":"@cyberlangke/tokkit-ai21labs","version":"1.11.0","description":"ai21labs tokenizer families for tokkit.","type":"module","main":"./dist/index.cjs","module":"./dist/index.js","types":"./dist/index.d.ts","exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js","require":"./dist/index.cjs"}},"scripts":{"build":"tsup","dev":"tsup --watch"},"dependencies":{"@cyberlangke/tokkit-core":"1.11.0"},"publishConfig":{"access":"public"},"repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"homepage":"https://github.com/1cyberlangke1/tokkit#readme","bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"author":{"name":"cyberlangke"},"license":"Apache-2.0","gitHead":"6d7b164cdcb511e7f5815e7278708c780b05d938","_id":"@cyberlangke/tokkit-ai21labs@1.11.0","_nodeVersion":"24.14.0","_npmVersion":"11.9.0","dist":{"integrity":"sha512-NzDbOwJL6zs3op7bBrMLsPM/XE7OMLk1JxjyfpuqTXQoSi7TIxrVQC/haRDUn1k7Z9+x/lmBxlCZwRgF1Rqt1w==","shasum":"a229a939b2855df433c05c44d851e6efe4288f17","tarball":"https://registry.npmjs.org/@cyberlangke/tokkit-ai21labs/-/tokkit-ai21labs-1.11.0.tgz","fileCount":12,"unpackedSize":3990158,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEYCIQCFDA1qu/SDDHKTc79eCjI3PxKbOknTZkk2yg+IoUgxOgIhANLp9pB3lh1qtbFQvYQ4XYuIOCrzJjG4FI/8xr0PxhUt"}]},"_npmUser":{"name":"cyberlangke","email":"3531702083@qq.com"},"directories":{},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/tokkit-ai21labs_1.11.0_1775230075979_0.4698684763192036"},"_hasShrinkwrap":false}},"time":{"created":"2026-04-03T15:27:55.895Z","1.11.0":"2026-04-03T15:27:56.230Z","modified":"2026-04-03T15:27:56.415Z"},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"description":"ai21labs tokenizer families for tokkit.","homepage":"https://github.com/1cyberlangke1/tokkit#readme","repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"author":{"name":"cyberlangke"},"bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"license":"Apache-2.0","readme":"# @cyberlangke/tokkit-ai21labs\n\nai21labs 官方 Jamba 文本 tokenizer 的 tokkit 子包。\n\n当前内置 family：\n\n- `jamba2`\n  - 覆盖 `ai21labs/AI21-Jamba2-Mini`\n  - 也聚合当前确认完全复用同一 tokenizer 的 `ai21labs/AI21-Jamba2-3B`\n  - 也聚合当前确认完全复用同一 tokenizer 的 `ai21labs/AI21-Jamba-Reasoning-3B`\n- `jamba-v0.1`\n  - 覆盖 `ai21labs/Jamba-v0.1`\n\n当前不纳入：\n\n- `ai21labs/AI21-Jamba-Mini-1.5`\n- `ai21labs/AI21-Jamba-Large-1.5`\n- `ai21labs/AI21-Jamba-Mini-1.6`\n- `ai21labs/AI21-Jamba-Large-1.6`\n- `ai21labs/AI21-Jamba-Mini-1.7`\n- `ai21labs/AI21-Jamba-Large-1.7`\n- `ai21labs/AI21-Jamba2-Mini-FP8`\n- `ai21labs/AI21-Jamba-Reasoning-3B-GGUF`\n- `ai21labs/Jamba-tiny-random`\n\n说明：\n\n- 当前纳入范围只包含 `ai21labs` 官方组织下公开可下载、`apache-2.0` 且非 gated 的文本主线。\n- `AI21-Jamba-Mini/Large-1.5~1.7` 当前仍是 `gated: auto`，并且模型卡许可证为 `other`，因此不纳入这一批。\n- `AI21-Jamba2-Mini`、`AI21-Jamba2-3B`、`AI21-Jamba-Reasoning-3B` 的 `tokenizer.json` SHA256 一致，因此收口到同一个 `jamba2` family。\n- `AI21-Jamba2-Mini-FP8`、`AI21-Jamba-Reasoning-3B-GGUF` 属于发布格式衍生物，不作为独立支持目标。\n- `Jamba-tiny-random` 是测试用途随机模型，不作为公开支持目标。\n\n## 使用方法\n\n```bash\nnpm install @cyberlangke/tokkit-ai21labs\n```\n\n```ts\nimport { getTokenizer } from \"@cyberlangke/tokkit-ai21labs\"\n\nconst jamba2 = await getTokenizer(\"ai21labs/AI21-Jamba-Reasoning-3B\")\nconst legacy = await getTokenizer(\"jamba-v0.1\")\n\nconsole.log(jamba2 !== legacy)\n```\n","readmeFilename":"README.md","_rev":"1-76b0ce2bd49bb25299cdfa2cc541257d"}