{"_id":"@cyberlangke/tokkit-internlm","name":"@cyberlangke/tokkit-internlm","dist-tags":{"latest":"1.11.0"},"versions":{"1.11.0":{"name":"@cyberlangke/tokkit-internlm","version":"1.11.0","description":"InternLM tokenizer families for tokkit.","type":"module","main":"./dist/index.cjs","module":"./dist/index.js","types":"./dist/index.d.ts","exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js","require":"./dist/index.cjs"}},"scripts":{"build":"tsup","dev":"tsup --watch"},"dependencies":{"@cyberlangke/tokkit-core":"1.11.0","@cyberlangke/tokkit-h2oai":"1.11.0"},"publishConfig":{"access":"public"},"repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"homepage":"https://github.com/1cyberlangke1/tokkit#readme","bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"author":{"name":"cyberlangke"},"license":"Apache-2.0","gitHead":"333b52fef4a228c52906fa5d3412435d4f8aff67","_id":"@cyberlangke/tokkit-internlm@1.11.0","_nodeVersion":"24.14.0","_npmVersion":"11.9.0","dist":{"integrity":"sha512-EQJeMALA4JDcZy2pA9xmxruVWZbOKolefKQUxGkARMwN46KF7HsiB409LFuNrmxJf8y1W2FSQqV+Zl+T0dDieg==","shasum":"d803a1be696f11e765db76d84864a62439b3d100","tarball":"https://registry.npmjs.org/@cyberlangke/tokkit-internlm/-/tokkit-internlm-1.11.0.tgz","fileCount":16,"unpackedSize":9981257,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEQCIBxGOKFvVTm+3hyK9VXJiG9EtoX6JHcIquuCV13UqNxXAiAYR2LNWeWdtJQ4yJXtpCW5BKR51moxNv+OkFFEi63jCA=="}]},"_npmUser":{"name":"cyberlangke","email":"3531702083@qq.com"},"directories":{},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/tokkit-internlm_1.11.0_1775021018341_0.8047285256482604"},"_hasShrinkwrap":false}},"time":{"created":"2026-04-01T05:23:38.260Z","1.11.0":"2026-04-01T05:23:38.765Z","modified":"2026-04-01T05:23:38.984Z"},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"description":"InternLM tokenizer families for tokkit.","homepage":"https://github.com/1cyberlangke1/tokkit#readme","repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"author":{"name":"cyberlangke"},"bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"license":"Apache-2.0","readme":"# @cyberlangke/tokkit-internlm\n\nInternLM 官方文本 tokenizer 的 tokkit 子包。\n\n当前内置范围：\n\n- `internlm2.5-1.8b`\n  - 覆盖 `internlm/internlm2_5-1_8b`\n- `internlm2.5-20b`\n  - 覆盖 `internlm/internlm2_5-20b`\n- `internlm/AlchemistCoder-L-7B`\n  - 复用现有 `danube` family\n\n说明：\n\n- 当前只纳入许可证明确兼容且可公开下载标准 BPE `tokenizer.json` 的官方文本模型。\n- `internlm3-8b-instruct` 当前只有 `tokenizer.model`，不在本仓库当前 BPE 主线范围内。\n- `internlm2_5-7b` 许可证信号不够稳定，当前不默认纳入。\n","readmeFilename":"README.md","_rev":"1-53be67b200adbf284c6e67a31195a1ef"}