{"_id":"@cyberlangke/tokkit-upstage","name":"@cyberlangke/tokkit-upstage","dist-tags":{"latest":"1.11.0"},"versions":{"1.11.0":{"name":"@cyberlangke/tokkit-upstage","version":"1.11.0","description":"Upstage tokenizer families for tokkit.","type":"module","main":"./dist/index.cjs","module":"./dist/index.js","types":"./dist/index.d.ts","exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js","require":"./dist/index.cjs"}},"scripts":{"build":"tsup","dev":"tsup --watch"},"dependencies":{"@cyberlangke/tokkit-core":"1.11.0"},"publishConfig":{"access":"public"},"repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"homepage":"https://github.com/1cyberlangke1/tokkit#readme","bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"author":{"name":"cyberlangke"},"license":"SEE LICENSE IN LICENSE","gitHead":"e31bf2583a3cbcaf7af704dbfe6759316061b875","_id":"@cyberlangke/tokkit-upstage@1.11.0","_nodeVersion":"24.14.0","_npmVersion":"11.9.0","dist":{"integrity":"sha512-bAxa5z+7HefDEp/yETXs0WIwMsiVRssxPID1xwQnGjfZzK0YBvBpKQjy7w0UyZnwj/GRCaCrX9TLT9r8Ipz/aQ==","shasum":"474c521fd199444c89a231306d9dd72d79003cdc","tarball":"https://registry.npmjs.org/@cyberlangke/tokkit-upstage/-/tokkit-upstage-1.11.0.tgz","fileCount":12,"unpackedSize":1700742,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEUCIQDiz33SRSdH8nkIusxFVuQFT1Agvo2FL5Lv+DGhBszthQIgC+DQr3h8Ek6DyG8ZjSv3ImETBgrURsxBJN4WqCEWAP0="}]},"_npmUser":{"name":"cyberlangke","email":"3531702083@qq.com"},"directories":{},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/tokkit-upstage_1.11.0_1774934025795_0.6409121339798729"},"_hasShrinkwrap":false}},"time":{"created":"2026-03-31T05:13:45.726Z","1.11.0":"2026-03-31T05:13:46.025Z","modified":"2026-03-31T05:13:46.194Z"},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"description":"Upstage tokenizer families for tokkit.","homepage":"https://github.com/1cyberlangke1/tokkit#readme","repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"author":{"name":"cyberlangke"},"bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"license":"SEE LICENSE IN LICENSE","readme":"# @cyberlangke/tokkit-upstage\n\nUpstage 官方文本 tokenizer 的 tokkit 子包。\n\n当前内置 family：\n\n- `solar`\n  - 覆盖 `upstage/SOLAR-10.7B-v1.0`\n  - 也聚合当前确认完全复用同一 tokenizer 的 `upstage/TinySolar-248m-4k`\n- `solar-pro`\n  - 覆盖 `upstage/solar-pro-preview-instruct`\n\n当前不纳入：\n\n- `upstage/SOLAR-10.7B-Instruct-v1.0`\n- `upstage/Solar-Open-100B`\n- `upstage/solar-pro-preview-pretrained`\n- `upstage/TinySolar-248m-4k-py`\n- `upstage/TinySolar-248m-4k-py-instruct`\n- `upstage/TinySolar-248m-4k-code-instruct`\n- `upstage/llama-*`\n- `upstage/Llama-2-70b-instruct`\n- `upstage/SOLAR-0-70b-*`\n\n## 使用方法\n\n```bash\nnpm install @cyberlangke/tokkit-upstage\n```\n\n```ts\nimport { getTokenizer } from \"@cyberlangke/tokkit-upstage\"\n\nconst solar = await getTokenizer(\"solar\")\nconst solarPro = await getTokenizer(\"upstage/solar-pro-preview-instruct\")\n\nconsole.log(solar.encode(\"Hello, Upstage!\"))\nconsole.log(solarPro.encode(\"Hello, Upstage!\"))\n```\n","readmeFilename":"README.md","_rev":"1-21fbecadcc9020df60bd0a23d304ff4b"}