{"_id":"gpt3-tokenizer","_rev":"9-05a3816bfe15070e9b8b216121f222b8","name":"gpt3-tokenizer","dist-tags":{"latest":"1.1.5"},"versions":{"1.0.0":{"name":"gpt3-tokenizer","version":"1.0.0","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"main":"dist/index.js","typings":"dist/index.d.ts","engines":{"node":">=10"},"scripts":{"start":"tsdx watch","build":"tsdx build","test":"tsdx test","lint":"tsdx lint","prepare":"tsdx build","size":"size-limit","analyze":"size-limit --why"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.esm.js","size-limit":[{"path":"dist/gpt3-tokenizer.cjs.production.min.js","limit":"10 KB"},{"path":"dist/gpt3-tokenizer.esm.js","limit":"10 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^7.0.5","husky":"^7.0.4","size-limit":"^7.0.5","tsdx":"^0.14.1","tslib":"^2.3.1","typescript":"^4.5.4"},"dependencies":{"array-keyed-map":"^2.1.2"},"description":"Congrats! You just saved yourself hours of work by bootstrapping this project with TSDX. Let’s get you oriented with what’s here and how to use it.","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.0.0","dist":{"shasum":"dc819f6bfcf672ecdd9d850a741e0197dadcfe86","integrity":"sha512-Q++nyEJiHymyWZn+7vxxNU4s6Yt7H3doYhdHb+H8XhjORmundkkyXsyhmDMI4ZgzDIPNzHkx7Dae+JWWXTenEg==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.0.0.tgz","fileCount":22,"unpackedSize":12403777,"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v3.0.13\r\nComment: https://openpgpjs.org\r\n\r\nwsFcBAEBCAAQBQJhycXpCRA9TVsSAnZWagAAHscP/068OH1sJWduGkn7D2Fy\nI2HpWNW8wRYk18KDI+LhYVVWKKggqHxUCVgN5JdVOWgmZtDzlSmC0SM03os4\nCpbOKD5Fuo9+AabD2EnDtcqyAwtkG+wRrlmMjF+Ehtv36BPilN0YumI9NUnv\n+vHvxwdqf+od+GAjYVw5lFNdhNlvOig59/2Sa/dCpKFoJC21AP7EZEix5GEH\nsiG5XDu2luvcqUX0wxevf13FU6drWQPUMGCqQ5MrkQiTi7BZehveeugy7h2C\n7viQ+8u23TQcQDaCMkNEO5LpuQc0ku2RZ4QTk6D8MZ2nZ5gWrtZutP6huht8\nKRyAf/MIsO5pY1BgqgK3ACaxGSxBTULNHWODNMsrl3Qf538/Zq+DLb2C9rl2\nRrDypdyXfRdDv8cAeoJDX3ShNnkWzkmitC7D6uEMn6JJYCMOls5OUUN4nxgI\nGl0LIDzQ2JtFzcMTULh4jvRnCn/tRbvwldhiggOTILwHQhdVWWZ8qZoge/NI\njH0yDFm2zXxHWtnE7I8tvLIuyYBJa8WHf/0sOf8pPk2enzqOsjtQBkYY34yG\nUoKDm4YXpCoVvAH/f1Zy0FnBaBOCXgRxs3r0SNQaN92i+WhmU9mSBAC6aMeF\nYGZSj6E82KisVoa5lyrihrIDq5+plC0rKwy0eBu/I9ODovHWAZr/rTOnKw8I\n54CT\r\n=F5us\r\n-----END PGP SIGNATURE-----\r\n","signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEUCIEyc5/a2VX7ifrosa83lzLLT8AZt/CLOhX4VQHApcjSaAiEAz/QvjCCSjSF1kJPJlodoSAqHO8f5EpuDRTx+8F3OfPU="}]},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.0.0_1640613352821_0.4582896786036774"},"_hasShrinkwrap":false},"1.0.1":{"name":"gpt3-tokenizer","version":"1.0.1","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"},"main":"dist/index.js","typings":"dist/index.d.ts","engines":{"node":">=10"},"scripts":{"start":"tsdx watch","build":"tsdx build","test":"tsdx test","lint":"tsdx lint","prepare":"tsdx build","size":"size-limit","analyze":"size-limit --why"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.esm.js","size-limit":[{"path":"dist/gpt3-tokenizer.cjs.production.min.js","limit":"10 KB"},{"path":"dist/gpt3-tokenizer.esm.js","limit":"10 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^7.0.5","husky":"^7.0.4","size-limit":"^7.0.5","tsdx":"^0.14.1","tslib":"^2.3.1","typescript":"^4.5.4"},"dependencies":{"array-keyed-map":"^2.1.2"},"description":"This is a TypeScript tokenizer for OpenAI's GPT-3 model. Including support for `gpt3` and `codex` tokenization.","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.0.1","dist":{"shasum":"83415acb366622f7f733ad92d0b1f9c0aa016315","integrity":"sha512-peXx4oA/mv9IA4WK4XoB6qQyAoet9LG1skLvH1zoocxCJ5R+mD5h4OAcyucWd6sH5L1dP8ZCt7g+rdfl679rBg==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.0.1.tgz","fileCount":22,"unpackedSize":12401678,"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v3.0.13\r\nComment: https://openpgpjs.org\r\n\r\nwsFcBAEBCAAQBQJhycgOCRA9TVsSAnZWagAA3CoP+wfZ+RFvDPGkoqj/aoXd\nM03DUXqxROGFFlR1/S06oKDJx5ZLuC9ANj+oWZIBt8cparDlkkHDK1StjMrP\nOpg+DI722T77h3PDoBY99D9vqCsmAqVz+VLZ3HEq/ZY/WRpnBo0yj2ZcZhXj\nuNTVRu+i+gwIDzOIgCX8NP6HtE9j8cqIrWkkNCBlsurNnjeLw398LIKZBzyL\n55c7/7jqtH1uo0p8WTtxe4El9467vuMLdK88ZjPnSn5SqZCCAGRd8vxKBMG7\nvCtW2d5TOo9TGr33BOs96pzjTHdc2XoqD5DnmORSneDdQ2BcuSXRN+4aN4aE\nSzIClWLS8c13/ucUkXRPPbecw3qB8dyIP2rGXEmMzeXDU6mcO160K6+WTwkS\n7D5Aix6/pFS4IqLBtgzQC0Vb5FhKcQN33/jPGieiwWTzE6mKV2G8YDyseOEy\nd0CfTQnlBXYKd5buw96YYqXPlLMeS5G6dZmQpXzgHh1volJZ5dkd1PGg/Ugn\n09Dgpq7j6bbZQz9ebpJkBa6Cngb6Qz2Qxl8/U4RDGsKOTlydnfwLBHzmdoEP\nD2tHYIqy0VpguNZKZSnqWO3WDfMrRMI2gfSevuRy5ng7PQeB6mYz3fc81OZq\n/m9ZU9tvisxZV1ljGbeiQXDZYvMHKFnyIwTgYqBl8WS5bT+w2/M6F5xP4qkH\nW8YX\r\n=HRWn\r\n-----END PGP SIGNATURE-----\r\n","signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEUCIGl+0pk4KUhU1AzeVWxEhRocbHX4mE/9aDV9O35yD8EWAiEAvJkAgcHk4J2YA22khlo/Jjstf1jBS4rbjqx1sd1S5Dg="}]},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.0.1_1640613901876_0.17755060163732872"},"_hasShrinkwrap":false},"1.0.2":{"name":"gpt3-tokenizer","version":"1.0.2","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"},"main":"dist/index.js","typings":"dist/index.d.ts","engines":{"node":">=10"},"scripts":{"start":"tsdx watch","build":"tsdx build","test":"tsdx test","lint":"tsdx lint","prepare":"tsdx build","size":"size-limit","analyze":"size-limit --why"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.esm.js","size-limit":[{"path":"dist/gpt3-tokenizer.cjs.production.min.js","limit":"10 KB"},{"path":"dist/gpt3-tokenizer.esm.js","limit":"10 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^7.0.5","husky":"^7.0.4","size-limit":"^7.0.5","tsdx":"^0.14.1","tslib":"^2.3.1","typescript":"^4.5.4"},"dependencies":{"array-keyed-map":"^2.1.2"},"description":"This is a TypeScript tokenizer for OpenAI's GPT-3 model. Including support for `gpt3` and `codex` tokenization.","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.0.2","dist":{"shasum":"d46fce73f658f91b8473c45f9b3ea899ac37b796","integrity":"sha512-5z7ZEUsprUTB8gNgQdfQqU7oYzFa1Pv8+uu3Xnz6jL1kXcPEFnVorIvxJSwUd5C1VAUMixJhFEffXmguLoDEGQ==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.0.2.tgz","fileCount":22,"unpackedSize":11896815,"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v3.0.13\r\nComment: https://openpgpjs.org\r\n\r\nwsFcBAEBCAAQBQJhyc4TCRA9TVsSAnZWagAAROgP/RPsPNTIzhEJ7GWCdCn0\nc4TemznN2cM7D0/K4j1McgauBCoGgVyqej51MMQfPJ6Qb0GRQYDsXAP2KprL\n0Hxp7VtBKF/w4IetjX24//vQPOMI4+qHKhOqV8yLVrHj7VWMWey4f7VWbBIj\naLwVhYQg/CvLy/4javWJcicQq0eLjb+zz7MTfkvAv8QQHQXSvmaqEYzwTk00\nWHv5Y31xv4mKZqSKKUwDwHq5vuTyaIocJWx6pjRtHqElFUqsbEdwwxybCBmE\nYVIJSvoGXoA8yXBkuR+yo9N9xa+3oJGr5QVpxBZGOO0wp6V+s7ZX/sE4XgIv\nEDlQ4Td6x7wYsi82EJW0ZpkfhURHoUs7FzESlem0qsMiv8xjmvjpNjlKax94\n71P09ivpfnID1J5JHmDNGKBoC+nOh7ty0OSb/YsqtW172gBAc0MYJY8kfCjb\nNslDZf7bjhLlOis1KseoEh9hydm31Sz7rRxNp0wsxQUsM1oWmySaD8BMmM3X\nCxCR83gbSp7qaZI+NmgIDLNpt1xOAfoc9A19P6yqNexXHfEir2Vbv6gaWSUq\nh/k/rk1vRh4hm+cDHexASIzq8kIHAheg8XwO2ZUdXS4CLV/tj/6b9/AVEvTD\npyaplSDN5bgc5wd/PtU1ZFlzGfp49Sj8LIJxLnWKHl/vwT63h/ZJ5vz15cFS\njHTW\r\n=xPfh\r\n-----END PGP SIGNATURE-----\r\n","signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEYCIQDi/TlUGtAwTObw5WVk+HifFdyI4uljIV9QfMDg0JxKbQIhAKAEfIDiYEJxAyACic8qqNTCTROwPkPhiseqKlK2eNg8"}]},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.0.2_1640615443612_0.3351297767931334"},"_hasShrinkwrap":false},"1.1.0":{"name":"gpt3-tokenizer","version":"1.1.0","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"},"main":"dist/index.js","browser":"dist-browser/gpt3-tokenizer.js","typings":"dist/index.d.ts","engines":{"node":">=12"},"scripts":{"start":"tsdx watch","build":"npm run build:browser && tsdx build","build:browser":"rimraf dist-browser && tsdx build --target browser --format esm","test":"tsdx test","lint":"tsdx lint","prepare":"tsdx build","size":"size-limit"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.esm.js","size-limit":[{"path":"dist-browser/gpt3-tokenizer.js","limit":"1024 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^7.0.5","husky":"^7.0.4","rimraf":"^3.0.2","size-limit":"^7.0.5","tsdx":"^0.14.1","tslib":"^2.3.1","typescript":"^4.5.4"},"dependencies":{"array-keyed-map":"^2.1.2"},"description":"This is a TypeScript tokenizer for OpenAI's GPT-3 model. Including support for `gpt3` and `codex` tokenization.","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.1.0","dist":{"shasum":"0d5a69717e6387360aa9903ad93597e81d5a99dc","integrity":"sha512-YsQrnj6wWTeGZD77g+FsWoSddFRiG6orPXvA2c+R1F4YkTxflh+7WEsus3vEPVL7GutqtkAFlhAMsMUZAAStFQ==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.1.0.tgz","fileCount":15,"unpackedSize":1620365,"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v3.0.13\r\nComment: https://openpgpjs.org\r\n\r\nwsFcBAEBCAAQBQJiCx+UCRA9TVsSAnZWagAApHIP/1nGD07bEOFm/pFQhGwE\nSEUdF+Vs1B82Ql+siGEtV2cdmPkpfvUkiJkj2FMMCFIOUM2QHOKhYFS15K2X\nL/JGUfqw+70wo7u8yKoyn1DG0SeVAX8/bvVrCzWivKT0Mi+7gyyAWoEmRSDa\n5bMfjRPJ0+m0au0aLo/qgaPG+9uygfv9kS+M1YWsw3digPdULaRLnfwurE9t\nr5aKQag88j6akbFmYxSOw5rC1RingsVrN0wasQ51Ps2iFDQXe5SQVxxNlm0x\nEorqiBpoS8x3yd8QfGf8ltrnnMvVPQrNs5E3faiy47ELJoslQcOlzY6WlSIZ\n5yQz9UxqlRKgzmNlViPSBqJvNhWqdLRUSSbpCBdHlnJ+DPKf3qsJ8YabZqFZ\nBDFl9JgljyZ0AdptHbTSiu9DTmN2uh2/P1SHVsOSsiM6nZM4yMycaf1O/XyM\nNIb2+laMIypilEk/lx1kekS97Kdy5Rxva8Rb71RwT6vtEWdZGrCeDHeYeny6\nX9dECNCI43wCiBEWFQExkzMcBlrlqiOJG0J6dDRUskDNHg4UHKietwr6b0X0\nKBnSt33J0J6RdKLiHyGA6deRr8xxtEDaa0NZD1j9/WlyVeA2WY27WNVvqwNb\n2QFwaWq9QJ1TXPdsxaC2r1ppfeKMBPQFKtvZzXgC6BWHfHrwVKspdF67EVrw\nIciA\r\n=FB7U\r\n-----END PGP SIGNATURE-----\r\n","signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEUCIQDT2TwSfm9GXol70oKbOUFjX87U8Z1wMmyHUyPOGRcigQIgb/x2+zfVsqeCEbNnYu/Xy0b1PA1sXwtzCsi4Q2LlzU8="}]},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.1.0_1644896147963_0.9470870265482871"},"_hasShrinkwrap":false},"1.1.1":{"name":"gpt3-tokenizer","version":"1.1.1","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"},"main":"dist/index.js","browser":"dist-browser/gpt3-tokenizer.js","typings":"dist/index.d.ts","engines":{"node":">=12"},"scripts":{"start":"tsdx watch","build":"npm run build:browser && tsdx build","build:browser":"rimraf dist-browser && tsdx build --target browser --format esm","test":"tsdx test","lint":"tsdx lint","prepare":"npm run build","size":"size-limit"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.esm.js","size-limit":[{"path":"dist-browser/gpt3-tokenizer.js","limit":"1024 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^7.0.5","husky":"^7.0.4","rimraf":"^3.0.2","size-limit":"^7.0.5","tsdx":"^0.14.1","tslib":"^2.3.1","typescript":"^4.5.4"},"dependencies":{"array-keyed-map":"^2.1.2"},"description":"This is a TypeScript tokenizer for OpenAI's GPT-3 model. Including support for `gpt3` and `codex` tokenization.","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.1.1","dist":{"shasum":"2d7861c23b6ace92ab6223cea8bc6a82bc5b3124","integrity":"sha512-Fg3JaI9Q43J4RHvCt915Y6mZUk67c0eXlxJrXrWxm64rDi1D2WEHAv21802JsGr/o71beULVnA90GUoBpS75RA==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.1.1.tgz","fileCount":29,"unpackedSize":11906180,"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v3.0.13\r\nComment: https://openpgpjs.org\r\n\r\nwsFcBAEBCAAQBQJiCyASCRA9TVsSAnZWagAAlJ0P/RbX4UNXN4UtsvSIkZL8\njv9uDm9WDfLNnojwl1OXuyctQRdvC7HuyKEYTQxdA8K+iU43ENBA8dH/ePz3\nYrohJJRSr0qV5Zfv/0GmjzNLDdqsOZqCcYjZr6Uiq6ZJHuU75B8qiVp1NfQS\nowDxH6odF6qGxn7ag4C8NUGmfwQJD6gNRzMq3Vub4qb4iWtU0yjiIMeQ6Vi/\nN7zIOciwTKbRrUvedp79jlK8uNxRPbuM8aZTbGVsSPJi+KpT3qo38gPiTU8h\n9RdqADUZg89512f7vH0MZpjwogJUx2EPcq9pyFbWLFJZ/k/Hmx/Chk5QLFvS\nXmzXs/OrniP3cSglyCBlzUDOYZXupgEL33J1JFVoc1izEYdFIlCKuwSa1E9b\nXQD8Or+EnOrUj+3ZZTLp5nAWxuuG2jxrWiBq/wL9nTY4VwaTSVc/6RO0SqQ2\nHmxrwrdx4oAxxiBDKF5RQ+gSorIrfqojwUz9t/pCXu+OnsiNnnJGYu9XCpq4\nMk1nseZNsMm83Zy/jH1FBNJCyERkgkO8Wg+hnArJyHpuzY9ZxP82zflRzspW\npAyQZZZpTHRZiNNjF3dJvrKOkMwDVXN+YauLEa0GCWr6dn1tTZKpaVyDUoEH\n0GT83jHH+7RiBq9xELc8nlkK636LrcUmu7m2PYjAXW6TMc0lxHPzVkcjVUd7\nJ0qZ\r\n=tidl\r\n-----END PGP SIGNATURE-----\r\n","signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEUCIQDGXE0afSHEYtf4wqFtFCoX2BHGAkyspnwIxM2mbfxINQIgZoDwXF+0Ya9/Z7QAeoJSEnGH+m/V64RsWUI/Dtzh5yY="}]},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.1.1_1644896273760_0.6203857012911029"},"_hasShrinkwrap":false},"1.1.2":{"name":"gpt3-tokenizer","version":"1.1.2","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"},"main":"dist/index.js","browser":"dist-browser/gpt3-tokenizer.js","typings":"dist/index.d.ts","engines":{"node":">=12"},"scripts":{"start":"tsdx watch","build":"npm run build:browser && tsdx build --target node --format cjs","build:browser":"rimraf dist-browser && tsdx build --target browser --format esm","test":"tsdx test","lint":"tsdx lint","prepare":"npm run build","size":"size-limit"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.esm.js","size-limit":[{"path":"dist-browser/gpt3-tokenizer.js","limit":"1024 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^7.0.5","husky":"^7.0.4","rimraf":"^3.0.2","size-limit":"^7.0.5","tsdx":"^0.14.1","tslib":"^2.3.1","typescript":"^4.5.4"},"dependencies":{"array-keyed-map":"^2.1.2"},"description":"This is a TypeScript tokenizer for OpenAI's GPT-3 model. Including support for `gpt3` and `codex` tokenization.","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.1.2","dist":{"shasum":"cb49b417ebaa6a4381da49c680925630752c735f","integrity":"sha512-pPvRHcjkTpFLnu/gdFNYJVP8MBwzuOzBgVlAicN+y5tpOJBaE1vUy8vcwNmmyKu0MB6qjCSwP3RznjC8mI+OFQ==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.1.2.tgz","fileCount":39,"unpackedSize":11799993,"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v3.0.13\r\nComment: https://openpgpjs.org\r\n\r\nwsFcBAEBCAAQBQJiCyH1CRA9TVsSAnZWagAA31UQAJ4BBKiTrqvkWxJL9igC\nicuyJl36ibYvMrxHMJnCl+8BJd9JUi2awlOAmX0k7V7QJVvqbd1FXYv6JC3G\nMklEN2AMwB1rOkuUDjOEAij1LXg7jFpMkO+3xf3BMAKkKdx71Nhxj3dZOGEs\nJWSbVE0MDo7juurTELP65qZLKqjgR+lKK01hMOcUvlG06vJTrfRGHrI6ziYd\nOGn4gMUDhl/2zJMTsPzZaEsJdJAFDsWC1PP1qZ9zexCT7cca/fTLEln03PS+\nFZpgc+7krXVBNF2UNLn4sM9+II2hv3pjgD9vIdyvVo3e2kSuUQQGjE2MDZ5d\nPHyRJG7jENcUGOaGhWF782f1e8iwHrSa41o7GYK5hmhRBnjGUiudZ4KGkhQ1\nTP84a9w1pzNlWQKZ4arjVurdQrnzfrs82bRSuoLG8K6sIpK+CnJ8sYpHqCDC\na27rM2y8ZNuIta0I/iqJDU6DT8KA1DKonIJc0Inq1JE+l0FEaHaNpwcsdAbE\nZWspH2E0mlu9fMTVVkVosCza0zjWVms3NXOVUhsAwcfXqjBNvDL81+flwiAf\nqCuL4Ou5SXRaWAPFfD3l7FRWZTpqvRaWY1KwqFIqcXOOhRxS3Ti9gjoVfqzd\nD3YaHOkn5xU6o2FhEmkGmI3LIutkfKCED9evvI+8JIJlCzcJteVh/GSatMOF\nlwvd\r\n=tnoD\r\n-----END PGP SIGNATURE-----\r\n","signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEQCICQN+ZOWy77xtYYDNocPdzaOEGg+BhUVpchOOg2IFu1mAiB/wWqzDQXwdpSFx8sKvj39up6cxi1mGba/it318dEECg=="}]},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.1.2_1644896756925_0.09459420911945338"},"_hasShrinkwrap":false},"1.1.3":{"name":"gpt3-tokenizer","version":"1.1.3","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"},"main":"dist/index.js","browser":"dist-browser/gpt3-tokenizer.js","typings":"dist/index.d.ts","engines":{"node":">=12"},"scripts":{"start":"tsdx watch","build":"npm run build:browser && tsdx build --target node --format cjs","build:browser":"rimraf dist-browser && tsdx build --target browser --format esm","test":"tsdx test","lint":"tsdx lint","prepare":"npm run build","size":"size-limit"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.cjs.production.min.js","size-limit":[{"path":"dist-browser/gpt3-tokenizer.js","limit":"1024 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^7.0.5","husky":"^7.0.4","rimraf":"^3.0.2","size-limit":"^7.0.5","tsdx":"^0.14.1","tslib":"^2.3.1","typescript":"^4.5.4"},"dependencies":{"array-keyed-map":"^2.1.2"},"description":"This is a isomorphic TypeScript tokenizer for OpenAI's GPT-3 model. Including support for `gpt3` and `codex` tokenization. It should work in both NodeJS and Browser environments. ## Usage","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.1.3","dist":{"shasum":"a0347d9c5d9e1d19852176502f2082cc6dabdf3a","integrity":"sha512-LFoyG3PIiUN0eFxjFxJ0aR1rZtPkuwSRY7RqLbNcPNdIJQp5YX9aIUNmrtvUJZeXbi2JylP4kJv1yQXA5nqqGA==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.1.3.tgz","fileCount":39,"unpackedSize":11799947,"signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEYCIQDMBId3UWQNg9lhchQW8dt9fsZJt9pt4FQc8KwXWbFCDgIhAIWfwFMwAbpU5BzJoXYPfLroBgc+ojhyZy55bNNwCGpx"}],"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v4.10.10\r\nComment: https://openpgpjs.org\r\n\r\nwsFzBAEBCAAGBQJjCiZDACEJED1NWxICdlZqFiEECWMYAoorWMhJKdjhPU1b\r\nEgJ2VmrFyA//SKlIUQsedzgDWfiKWPzO2ckRELwx0YMtO2BwkvIZPbvgsSsB\r\ngb3T43anXuxPhaERth/FbgDIYzPL/PTyyA+8rVVSIx6FmMbpAO1HG6oF13bL\r\n7A7LOquHd6lHKAvzYaZ9R9K/ocd1qFAslOH4c5/+4l2zdNf6XTM/ryhlEdWR\r\n+eJ+JYL6FQX/RsbjeR6Ob7xK8j+EhoSB53RvShoFuvPgWYPY+TNbEG14Y4tx\r\nobpykasvW+d1mRkrbetZuIQGi5+0YwBZADPXOsz26cMfsLY2w8U3JsVmgimW\r\nyUz1/xIumsdDJ+qQ+QGRG4sZUu8iO2jJE4hNkpKluSwc9XXO2tk1+1cpCIfc\r\nUFOYATnSS9kLrQLJjxZTu1+bWNYlaxabk+KafUOOEB1yZBw/zg2aZVHFEpuF\r\nWPir56zyup2X1qOFVy6gJGGtwZ7dckjW/jE649uqakF3ttINiIYqzCFbKDZf\r\nT8zqvPiyVCiRNaneQvfYOXassmjaeEITZuTlcYIDZaHIhLj0ejDZVDzUsem4\r\n3IR8lWFSYDr4p5EaPVoiROzAIhSwlIA0g+6UI0ZB62lADeKULaJvzeNz1hBK\r\n8/m9EG7glqjc+vkOzaBA1aZ7a3i045E3LQaAXJUx2wqXuelTXniqyjUXrgxa\r\n+nULt4Qn1WSyDx11zquO6iMjuvZ/Ws7Xjug=\r\n=jbCf\r\n-----END PGP SIGNATURE-----\r\n"},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.1.3_1661609539697_0.5932015780113957"},"_hasShrinkwrap":false},"1.1.4":{"name":"gpt3-tokenizer","version":"1.1.4","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"},"main":"dist/index.js","browser":"dist-browser/gpt3-tokenizer.js","typings":"dist/index.d.ts","engines":{"node":">=12"},"scripts":{"start":"tsdx watch","build":"npm run build:browser && tsdx build --target node --format cjs","build:browser":"rimraf dist-browser && tsdx build --target browser --format esm","test":"tsdx test","lint":"tsdx lint","prepare":"npm run build","size":"size-limit"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.cjs.production.min.js","size-limit":[{"path":"dist-browser/gpt3-tokenizer.js","limit":"1024 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^7.0.5","husky":"^7.0.4","rimraf":"^3.0.2","size-limit":"^7.0.5","tsdx":"^0.14.1","tslib":"^2.3.1","typescript":"^4.5.4"},"dependencies":{"array-keyed-map":"^2.1.2"},"description":"This is a isomorphic TypeScript tokenizer for OpenAI's GPT-3 model. Including support for `gpt3` and `codex` tokenization. It should work in both NodeJS and Browser environments. ## Usage","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.1.4","dist":{"shasum":"987e896c57fa59a1f58a88e3a74b5913425d6fe3","integrity":"sha512-qfkRgE9ZvJjx9vWD0/R3xdH35SCINykliIF0+OP9BObiqwGhJA8BWs3laHyhNA92OPCwlQLhCxQuWjYMeyqAUw==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.1.4.tgz","fileCount":39,"unpackedSize":11800136,"signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEUCICKNFuyW06g/wMSmhzBoQKcHdJJdQ8324QQCYpEOFuugAiEAn8qM/+eu8MFCdfSbNlgxXnIAiGhoJe4N5rUrF8vX8KQ="}],"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v4.10.10\r\nComment: https://openpgpjs.org\r\n\r\nwsFzBAEBCAAGBQJjfcZ9ACEJED1NWxICdlZqFiEECWMYAoorWMhJKdjhPU1b\r\nEgJ2VmoGBA/+L/1CfEnPE2QqhyuGoe6E6sZI91Unx1vxpLTT24kFAU7aLdei\r\nwHZJYU2zNKkoQJ3ohryMc8yPbRxu1UA93CAwcjwaHetsy2ha0Xl2v/2mR8ZW\r\ne7tfsDbO1HRGGC2TU98FH1sRb9BT+B2IzsEbat/2gjeOIHTjKvE5VAS2OmIh\r\n+Hg5cmGfltKcUWzbZufIxOBBX9OsJo9bxjaX6GE7+oizUAzInLmprmBo+Gtw\r\ni8xqQQj5NRA/3EtjvIAHIiiYmgsWjpnmFkOHeJaMmQcOnafZ8lMZP7hca5Mw\r\n/Xviwo1BP6zHED1ybDE59KsRsk/HVtQv/PA/nlxlPS6gcLgCoFpTeNMaImRP\r\n1eEI6SNBvJhO0AuScIKU1r5GBfKWKWujAVpJMpGTTi4rd3/9TLX2LfOAQslh\r\nIesXtoaDYSvEDntIR/xd2vxGirabHbz4oo/xd12qEl6blaDpf2O9jWnCRw73\r\nbQe59t4HKjLL6Bi2Xsnik7sFhzDLSqL0QHGrFrDfoLGGQKO+Yc7KWVyPeuAW\r\n33NTy2dVQtvuqPfUtoMQBVTZLSNylrRrltg2kJlyg5v9Igp7PuijZtDk/vh9\r\np9b/5jehBb/sitqebQxZnjZ3Zd1zHbuzLfnIR3M9jOo/Y0aMqLIPyUWqrLBh\r\n+qyhXgKUl3aemPV1JM1iJizBvfnWiIvIJw4=\r\n=uAI3\r\n-----END PGP SIGNATURE-----\r\n"},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.1.4_1669187197267_0.4109250429131095"},"_hasShrinkwrap":false},"1.1.5":{"name":"gpt3-tokenizer","version":"1.1.5","license":"MIT","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"},"main":"dist/index.js","browser":"dist-browser/gpt3-tokenizer.js","typings":"dist/index.d.ts","engines":{"node":">=12"},"scripts":{"start":"tsdx watch","build":"npm run build:browser && tsdx build --target node --format cjs","build:browser":"rimraf dist-browser && tsdx build --target browser --format esm","test":"tsdx test","lint":"tsdx lint","prepare":"npm run build","size":"size-limit"},"peerDependencies":{},"husky":{"hooks":{"pre-commit":"tsdx lint"}},"prettier":{"printWidth":80,"semi":true,"singleQuote":true,"trailingComma":"es5"},"module":"dist/gpt3-tokenizer.cjs.production.min.js","size-limit":[{"path":"dist-browser/gpt3-tokenizer.js","limit":"1024 KB"}],"devDependencies":{"@size-limit/preset-small-lib":"^8.1.2","husky":"^8.0.3","rimraf":"^4.1.2","size-limit":"^8.1.2","tsdx":"^0.14.1","tslib":"^2.5.0","typescript":"^4.9.4"},"dependencies":{"array-keyed-map":"^2.1.3"},"description":"[![Build](https://github.com/botisan-ai/gpt3-tokenizer/actions/workflows/main.yml/badge.svg)](https://github.com/botisan-ai/gpt3-tokenizer/actions/workflows/main.yml) [![NPM Version](https://img.shields.io/npm/v/gpt3-tokenizer.svg)](https://www.npmjs.com/","licenseText":"MIT License\n\nCopyright (c) 2021 Simon Liang\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.","_id":"gpt3-tokenizer@1.1.5","dist":{"shasum":"79e5f96c435daf9c41a81117411ebce3bf475e78","integrity":"sha512-O9iCL8MqGR0Oe9wTh0YftzIbysypNQmS5a5JG3cB3M4LMYjlAVvNnf8LUzVY9MrI7tj+YLY356uHtO2lLX2HpA==","tarball":"https://registry.npmjs.org/gpt3-tokenizer/-/gpt3-tokenizer-1.1.5.tgz","fileCount":39,"unpackedSize":11800993,"signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEQCIEz8/S6LGrBLESMO5hI7ATBGWbh+pGgxHT7QcHjhTMgxAiA42UOd1uXdBxUTrVYZzpRwW4/a7DTn3XDZI03d2A4sxg=="}],"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v4.10.10\r\nComment: https://openpgpjs.org\r\n\r\nwsFzBAEBCAAGBQJj0033ACEJED1NWxICdlZqFiEECWMYAoorWMhJKdjhPU1b\r\nEgJ2Vmo2Qg//aGYkWyc931AJRDv+AyjE4Gf6AhEXKDZyloR6z93NZBbUxCvz\r\nrue+nuhN3xT99+GoMXvoYd77buoLpe0HzCPtCax3k4tCVsfDU9O6r626DWfq\r\nVvcPaB06tfyyLuX8yw80i6c/lJkvo2KlSzZXYSwD05SqAQnYscvKiIiBiHv1\r\n66DdNFjpHW3j/uHUWaFXngNZV7rccA758eruQwghR9H933fq42iEdryrcUn7\r\nXV6COx+5bOZ3HgYUeY7fzsqwnwxRZiRRTW7D/MjrFRKwDvsQ1JaFdjDQpuPz\r\n2fVCqe6/wxVlmW3otbfA3FvXFNEiH5CiwcwJ+l/DKlE4RU+17uE6xPtprfLj\r\nsNmiEVaUD5JlMNY6feGtsEbgD29iRNG+LUd99JSxBZ1aUdznW2WItBckwTBt\r\nuCfbhds/Rlb1T8UmQT92BHf+pDhvnkdsyyxp0xYzKdRWe5QM8j3zXSPm3t1h\r\nLDY7vmoQiXH0ykrsQArbJYhBvV9WKw1uYP2zTetv+WNViC35ntqAUQ+u2IuP\r\nE6LMzWtnaAwlmsDTPWAivryBiFxEliG3TRDKS2WsDatVa3mc2edtXE8d2qhA\r\n+VDuD8kMQpiZNPme1TlmUeMiuYxr+SrKt3T+Fd8C3GngrroP6DP1YvnIPhPz\r\nA87KB64d94hJOe1y4HDhluex36H7NJLNsnM=\r\n=a1Av\r\n-----END PGP SIGNATURE-----\r\n"},"_npmUser":{"name":"lhr0909","email":"simon@divby0.io"},"directories":{},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/gpt3-tokenizer_1.1.5_1674792439241_0.09698290794229791"},"_hasShrinkwrap":false}},"time":{"created":"2021-12-27T13:55:52.754Z","1.0.0":"2021-12-27T13:55:53.076Z","modified":"2023-01-27T04:07:19.652Z","1.0.1":"2021-12-27T14:05:02.203Z","1.0.2":"2021-12-27T14:30:43.882Z","1.1.0":"2022-02-15T03:35:48.220Z","1.1.1":"2022-02-15T03:37:54.026Z","1.1.2":"2022-02-15T03:45:57.169Z","1.1.3":"2022-08-27T14:12:19.954Z","1.1.4":"2022-11-23T07:06:37.527Z","1.1.5":"2023-01-27T04:07:19.476Z"},"maintainers":[{"name":"lhr0909","email":"simon@divby0.io"}],"description":"[![Build](https://github.com/botisan-ai/gpt3-tokenizer/actions/workflows/main.yml/badge.svg)](https://github.com/botisan-ai/gpt3-tokenizer/actions/workflows/main.yml) [![NPM Version](https://img.shields.io/npm/v/gpt3-tokenizer.svg)](https://www.npmjs.com/","author":{"name":"Simon Liang","email":"simon@x-tech.io"},"license":"MIT","readme":"# GPT3 Tokenizer\n\n[![Build](https://github.com/botisan-ai/gpt3-tokenizer/actions/workflows/main.yml/badge.svg)](https://github.com/botisan-ai/gpt3-tokenizer/actions/workflows/main.yml)\n[![NPM Version](https://img.shields.io/npm/v/gpt3-tokenizer.svg)](https://www.npmjs.com/package/gpt3-tokenizer)\n[![NPM Downloads](https://img.shields.io/npm/dt/gpt3-tokenizer.svg)](https://www.npmjs.com/package/gpt3-tokenizer)\n\nThis is a isomorphic TypeScript tokenizer for OpenAI's GPT-3 model. Including support for `gpt3` and `codex` tokenization. It should work in both NodeJS and Browser environments.\n## Usage\n\nFirst, install:\n\n```shell\nyarn add gpt3-tokenizer\n```\n\nIn code:\n\n```typescript\nimport GPT3Tokenizer from 'gpt3-tokenizer';\n\nconst tokenizer = new GPT3Tokenizer({ type: 'gpt3' }); // or 'codex'\nconst str = \"hello 👋 world 🌍\";\nconst encoded: { bpe: number[]; text: string[] } = tokenizer.encode(str);\nconst decoded = tokenizer.decode(encoded.bpe);\n```\n\n## Reference\n\nThis library is based on the following:\n- [OpenAI Tokenizer Page Source](https://beta.openai.com/tokenizer?view=bpe)\n- [gpt-3-encoder](https://github.com/latitudegames/GPT-3-Encoder)\n\nThe main difference between this library and gpt-3-encoder is that this library supports both `gpt3` and `codex` tokenization (The dictionary is taken directly from OpenAI so the tokenization result is on par with the OpenAI Playground). Also Map API is used instead of JavaScript objects, especially the `bpeRanks` object, which should see some performance improvement.\n\n## License\n\n[MIT](./LICENSE)\n","readmeFilename":"README.md","repository":{"type":"git","url":"https://github.com/xanthous-tech/gpt3-tokenizer.git"}}