{"_id":"utf8-stream","_rev":"7-c599e1125137489172babb7e6389bca8","name":"utf8-stream","description":"buffer utf8 characters that would otherwise span chunk boundaries","dist-tags":{"latest":"0.0.0"},"versions":{"0.0.0":{"name":"utf8-stream","version":"0.0.0","description":"buffer utf8 characters that would otherwise span chunk boundaries","main":"index.js","dependencies":{"readable-stream":"~1.0.2"},"devDependencies":{"chunky":"~0.0.0","through":"~2.3.4","tape":"~1.0.4"},"scripts":{"test":"tape test/*.js"},"repository":{"type":"git","url":"git://github.com/substack/utf8-stream.git"},"homepage":"https://github.com/substack/utf8-stream","keywords":["utf8","unicode","chunk","boundary","encoding","buffer","toString"],"author":{"name":"James Halliday","email":"mail@substack.net","url":"http://substack.net"},"license":"MIT","readme":"# utf8-stream\n\nbuffer utf8 characters that would otherwise span chunk boundaries\n\n[![build status](https://secure.travis-ci.org/substack/utf8-stream.png)](http://travis-ci.org/substack/utf8-stream)\n\n# example\n\nHere we'll write some chinese characters at random byte offsets:\n\n``` js\nvar utf8Stream = require('utf8-stream');\nvar through = require('through');\n\nvar u8 = utf8Stream();\nu8.pipe(through(function (buf) {\n    var s = buf.toString('utf8');\n    this.queue(s.split('').join('\\n') + '\\n');\n})).pipe(process.stdout);\n\nu8.write(Buffer([ 0xe9, 0x81 ]));\nu8.write(Buffer([ 0x99, 0xe9, 0x81, 0xa0, 0xe6 ]));\nu8.write(Buffer([ 0x9c, 0xaa, 0xe4, 0xbe ]));\nu8.write(Buffer([ 0x86, 0xe7, 0x9a, 0x84, 0xe4, 0xba, 0x8b ]));\nu8.write(Buffer([ 0xe4, 0xbb, 0xb6 ]));\nu8.end();\n```\n\nInside the `through(function (buf) {})`, each `buf` will never span a utf8\nmulti-byte character so we can just call `.toString('utf8')`.\n\noutput:\n\n```\n遙\n遠\n未\n來\n的\n事\n件\n```\n\n# methods\n\n``` js\nvar utf8Stream = require('utf8-stream')\n```\n\n## var u8 = utf8Stream()\n\nReturn a through stream `u8` that will never emit a chunk that spans a utf8\nmulti-byte character.\n\n# install\n\nWith [npm](https://npmjs.org) do:\n\n```\nnpm install utf8-stream\n```\n\n# license\n\nMIT\n","readmeFilename":"readme.markdown","bugs":{"url":"https://github.com/substack/utf8-stream/issues"},"_id":"utf8-stream@0.0.0","dist":{"shasum":"05ce4107fceaf893a2c838fe63a1d423455c1fc4","tarball":"https://registry.npmjs.org/utf8-stream/-/utf8-stream-0.0.0.tgz","integrity":"sha512-X92xJPYQcFbRH4IaCH7zUEc8JLgGlIum7JFvo3AVTCaxMrJKEMrpoEkmE3P2NV0nALyM/rDHqIW628jt+BCO+w==","signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEYCIQDCzqo2K+J4KEaEGWfInSbiq+SqRkfbkguQfA6biRgz2QIhAI4EOEU3VHzYaFT4/cunDw3ojE8K0k4XUXQkmGQ5IOQH"}]},"_from":".","_npmVersion":"1.3.0","_npmUser":{"name":"substack","email":"mail@substack.net"},"maintainers":[{"name":"substack","email":"mail@substack.net"}],"directories":{}}},"readme":"# utf8-stream\n\nbuffer utf8 characters that would otherwise span chunk boundaries\n\n[![build status](https://secure.travis-ci.org/substack/utf8-stream.png)](http://travis-ci.org/substack/utf8-stream)\n\n# example\n\nHere we'll write some chinese characters at random byte offsets:\n\n``` js\nvar utf8Stream = require('utf8-stream');\nvar through = require('through');\n\nvar u8 = utf8Stream();\nu8.pipe(through(function (buf) {\n    var s = buf.toString('utf8');\n    this.queue(s.split('').join('\\n') + '\\n');\n})).pipe(process.stdout);\n\nu8.write(Buffer([ 0xe9, 0x81 ]));\nu8.write(Buffer([ 0x99, 0xe9, 0x81, 0xa0, 0xe6 ]));\nu8.write(Buffer([ 0x9c, 0xaa, 0xe4, 0xbe ]));\nu8.write(Buffer([ 0x86, 0xe7, 0x9a, 0x84, 0xe4, 0xba, 0x8b ]));\nu8.write(Buffer([ 0xe4, 0xbb, 0xb6 ]));\nu8.end();\n```\n\nInside the `through(function (buf) {})`, each `buf` will never span a utf8\nmulti-byte character so we can just call `.toString('utf8')`.\n\noutput:\n\n```\n遙\n遠\n未\n來\n的\n事\n件\n```\n\n# methods\n\n``` js\nvar utf8Stream = require('utf8-stream')\n```\n\n## var u8 = utf8Stream()\n\nReturn a through stream `u8` that will never emit a chunk that spans a utf8\nmulti-byte character.\n\n# install\n\nWith [npm](https://npmjs.org) do:\n\n```\nnpm install utf8-stream\n```\n\n# license\n\nMIT\n","maintainers":[{"email":"nopersonsmodules@gmail.com","name":"nopersonsmodules"}],"time":{"modified":"2022-11-08T10:41:29.670Z","created":"2013-07-19T12:13:29.379Z","0.0.0":"2013-07-19T12:13:31.083Z"},"author":{"name":"James Halliday","email":"mail@substack.net","url":"http://substack.net"},"repository":{"type":"git","url":"git://github.com/substack/utf8-stream.git"}}