{"_id":"@cyberlangke/tokkit-essentialai","name":"@cyberlangke/tokkit-essentialai","dist-tags":{"latest":"1.11.0"},"versions":{"1.11.0":{"name":"@cyberlangke/tokkit-essentialai","version":"1.11.0","description":"EssentialAI tokenizer families for tokkit.","type":"module","main":"./dist/index.cjs","module":"./dist/index.js","types":"./dist/index.d.ts","exports":{".":{"types":"./dist/index.d.ts","import":"./dist/index.js","require":"./dist/index.cjs"}},"scripts":{"build":"tsup","dev":"tsup --watch"},"dependencies":{"@cyberlangke/tokkit-core":"1.11.0"},"publishConfig":{"access":"public"},"repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"homepage":"https://github.com/1cyberlangke1/tokkit#readme","bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"author":{"name":"cyberlangke"},"license":"Apache-2.0","gitHead":"4e452d4115310642a84d74894fa0b099bace22d1","_id":"@cyberlangke/tokkit-essentialai@1.11.0","_nodeVersion":"24.14.0","_npmVersion":"11.9.0","dist":{"integrity":"sha512-QwVPdPw9TwsEXE4Kf3LV3emHrzhSfiMVe5cngsoYxjN7Pc+jqKiT8L9YFrWu92P37ud9TlnwmunXbIUcwKuXww==","shasum":"4dbc2928c6a2c4c655d3fe72b283fc1ab02379ca","tarball":"https://registry.npmjs.org/@cyberlangke/tokkit-essentialai/-/tokkit-essentialai-1.11.0.tgz","fileCount":10,"unpackedSize":4101951,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEYCIQDi59wEJLd/qY8ZTafxzskpJdfpOymH7rcYvxq9C9ZlIAIhAM5qZ32ufzhHV3yOxpM9kIhpe16cvnFFIIRtIAMPzTpJ"}]},"_npmUser":{"name":"cyberlangke","email":"3531702083@qq.com"},"directories":{},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/tokkit-essentialai_1.11.0_1775036671164_0.4786484720947972"},"_hasShrinkwrap":false}},"time":{"created":"2026-04-01T09:44:31.001Z","1.11.0":"2026-04-01T09:44:31.486Z","modified":"2026-04-01T09:44:31.779Z"},"maintainers":[{"name":"cyberlangke","email":"3531702083@qq.com"}],"description":"EssentialAI tokenizer families for tokkit.","homepage":"https://github.com/1cyberlangke1/tokkit#readme","repository":{"type":"git","url":"git+https://github.com/1cyberlangke1/tokkit.git"},"author":{"name":"cyberlangke"},"bugs":{"url":"https://github.com/1cyberlangke1/tokkit/issues"},"license":"Apache-2.0","readme":"# @cyberlangke/tokkit-essentialai\n\nEssentialAI 官方文本 tokenizer 的 tokkit 子包。\n\n当前内置 family：\n\n- `rnj-1`\n  - 覆盖 `EssentialAI/rnj-1`\n  - 也聚合当前确认完全复用同一 tokenizer 的 `EssentialAI/rnj-1-instruct`\n\n当前不纳入：\n\n- `EssentialAI/eai-distill-0.5b`\n- `EssentialAI/rnj-1-instruct-GGUF`\n\n说明：\n\n- `EssentialAI/rnj-1` 与 `EssentialAI/rnj-1-instruct` 的 `tokenizer.json` SHA256 一致，因此收口到同一个 `rnj-1` family。\n- `EssentialAI/eai-distill-0.5b` 属于 distill 线，当前不作为公开支持目标。\n- `GGUF` 当前只视为发布格式衍生物，不作为独立支持目标。\n\n## 使用方法\n\n```bash\nnpm install @cyberlangke/tokkit-essentialai\n```\n\n```ts\nimport { getTokenizer } from \"@cyberlangke/tokkit-essentialai\"\n\nconst base = await getTokenizer(\"rnj-1\")\nconst instruct = await getTokenizer(\"EssentialAI/rnj-1-instruct\")\n\nconsole.log(base === instruct)\n```\n","readmeFilename":"README.md","_rev":"1-64d7d2b709e4235f40d1317217bf6116"}