{"_id":"@cyberlangke/tokkit-inclusionai","name":"@cyberlangke/tokkit-inclusionai","dist-tags":{"latest":"1.11.0"},"versions":{"1.11.0":{"name":"@cyberlangke/tokkit-inclusionai","version":"1.11.0","description":"inclusionAI tokenizer families for tokkit.","type":"module","main":"./dist/index.cjs","module":"./dist/index.js","types":"./dist/index.d.ts","exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js","require":"./dist/index.cjs"}},"scripts":{"build":"npm run build --workspace @cyberlangke/tokkit-core && npm run build --workspace @cyberlangke/tokkit-qwen && tsup","dev":"tsup --watch"},"dependencies":{"@cyberlangke/tokkit-core":"1.11.0","@cyberlangke/tokkit-qwen":"1.11.0"},"publishConfig":{"access":"public"},"repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"homepage":"https://github.com/1cyberlangke1/tokkit#readme","bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"author":{"name":"cyberlangke"},"license":"SEE LICENSE IN LICENSE","gitHead":"de50f3bca1ea0a91101b2c7ae9c80c49ec003513","_id":"@cyberlangke/tokkit-inclusionai@1.11.0","_nodeVersion":"24.14.1","_npmVersion":"11.11.0","dist":{"integrity":"sha512-w9v5vkTQsV6AvuuU0sCe7kuG0587gqkpMZZoEYfk4+RI4BUBVov6C9IKtoP9iRJEorQjZ/7tMdFcONuBqdodyQ==","shasum":"63d107b256296a8a1868262edc0ff221fdea5bcf","tarball":"https://registry.npmjs.org/@cyberlangke/tokkit-inclusionai/-/tokkit-inclusionai-1.11.0.tgz","fileCount":32,"unpackedSize":39140113,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEQCIHZGX2M6Vf/4rLNUfzyY1GmWo8Y7btDsuvbi7LDdPtviAiBW6ttZRMG3dCZOcNudqU0DdlK3nRIf0gyLx40GeMZa4w=="}]},"_npmUser":{"name":"cyberlangke","email":"3531702083@qq.com"},"directories":{},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/tokkit-inclusionai_1.11.0_1775097175037_0.8740961420687148"},"_hasShrinkwrap":false}},"time":{"created":"2026-04-02T02:32:54.938Z","1.11.0":"2026-04-02T02:32:55.955Z","modified":"2026-04-02T02:32:56.168Z"},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"description":"inclusionAI tokenizer families for tokkit.","homepage":"https://github.com/1cyberlangke1/tokkit#readme","repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"author":{"name":"cyberlangke"},"bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"license":"SEE LICENSE IN LICENSE","readme":"# @cyberlangke/tokkit-inclusionai\n\ninclusionAI 官方文本模型的 tokkit 子包。\n\n当前纳入的官方主线模型：\n\n- 新 family：\n  - `inclusionAI/LLaDA2.0-mini`\n  - `inclusionAI/LLaDA2.0-flash`\n  - `inclusionAI/LLaDA2.1-mini`\n  - `inclusionAI/LLaDA2.1-flash`\n  - `inclusionAI/LLaDA-MoE-7B-A1B-Base`\n  - `inclusionAI/Ring-2.5-1T`\n  - `inclusionAI/Ling-2.5-1T`\n  - `inclusionAI/Ling-mini-2.0`\n  - `inclusionAI/Ling-flash-2.0`\n  - `inclusionAI/Ling-1T`\n  - `inclusionAI/Ring-mini-2.0`\n  - `inclusionAI/Ling-flash-base-2.0`\n  - `inclusionAI/Ring-flash-2.0`\n  - `inclusionAI/Ring-1T`\n- 复用现有 `qwen` family：\n  - `inclusionAI/GroveMoE-Base`\n  - `inclusionAI/Qwen3-32B-AWorld`\n  - `inclusionAI/AReaL-SEA-235B-A22B`\n  - `inclusionAI/GroveMoE-Inst`\n  - `inclusionAI/AReaL-boba-2-14B-Open`\n  - `inclusionAI/AReaL-boba-2-8B-Open`\n  - `inclusionAI/AReaL-boba-2-32B`\n  - `inclusionAI/AReaL-boba-2-8B`\n  - `inclusionAI/AReaL-boba-2-14B`\n\n当前不纳入：\n\n- `preview` / `distill` / `linear` / `CAP` / `exp` 后缀对象\n- `FP8` / `GPTQ` / `AWQ` / `GGUF` / 其他量化衍生发布\n- 早期 `Ling-lite*`、`Ling-plus*`、`Ling-Coder-lite*`、`Ring-lite*` 历史线\n\n说明：\n\n- `Qwen3-32B-AWorld`、`AReaL-*`、`GroveMoE-Inst` 当前与已支持的 `qwen3` family 完全一致。\n- `GroveMoE-Base` 当前与已支持的 `qwen2.5` family 完全一致。\n- `LLaDA2.0` / `2.1` / `LLaDA-MoE-7B-A1B-Base` 当前共享同一组 tokenizer，因此统一收口到 `llada2`。\n- `Ling` / `Ring` 当前主线里还存在多组不同 tokenizer，当前按官方 hash 分组拆成 `ring-2.5-1t`、`ling-2`、`ring-mini-2.0`、`ring-flash-2.0`、`ring-1t`。\n\n## 使用方法\n\n```bash\nnpm install @cyberlangke/tokkit-inclusionai\n```\n\n```ts\nimport { getEncoding } from \"@cyberlangke/tokkit-inclusionai\"\n\nconst llada = await getEncoding(\"inclusionAI/LLaDA2.1-mini\")\nconst qwenAlias = await getEncoding(\"inclusionAI/Qwen3-32B-AWorld\")\n\nconsole.log(llada.encode(\"Hello, inclusionAI\"))\nconsole.log(qwenAlias.encode(\"Hello, AWorld\"))\n```\n","readmeFilename":"README.md","_rev":"1-e6ef610f73569c081fd724cfc7aa8a4b"}