{"_id":"tokenize-whitespace","_rev":"3-0c2e4a5ce648ff71093bd18f6645a617","name":"tokenize-whitespace","description":"Tokenize a string into words and whitespace tokens","dist-tags":{"latest":"0.0.1"},"versions":{"0.0.1":{"name":"tokenize-whitespace","version":"0.0.1","description":"Tokenize a string into words and whitespace tokens","main":"index.js","scripts":{"test":"ava"},"repository":{"type":"git","url":"git+https://github.com/radiovisual/tokenize-whitespace.git"},"files":["index.js"],"keywords":["token","whitespace","tokenize","string","str","words","space"],"author":{"name":"Michael Wuergler","email":"senjudev@gmail.com","url":"http://numetriclabs.com"},"license":"MIT","bugs":{"url":"https://github.com/radiovisual/tokenize-whitespace/issues"},"homepage":"https://github.com/radiovisual/tokenize-whitespace#readme","devDependencies":{"ava":"^0.7.0"},"gitHead":"9cebf53fdfad5d5ac5dadfdd4638c487222050bf","_id":"tokenize-whitespace@0.0.1","_shasum":"3c207ab58948113225246285200563e3b4b5c6ff","_from":".","_npmVersion":"3.3.6","_nodeVersion":"5.0.0","_npmUser":{"name":"radiovisual","email":"senjudev@gmail.com"},"dist":{"shasum":"3c207ab58948113225246285200563e3b4b5c6ff","tarball":"https://registry.npmjs.org/tokenize-whitespace/-/tokenize-whitespace-0.0.1.tgz","integrity":"sha512-OxbdMHTjVs0ccBMfjo1v5OH6bq8yhydewCd9n6xihgtZvI3wSqR00EsM86DjELLl6VtMkY2z99r5q+uNW79E+Q==","signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEQCIGJe0wgKYWI482ppzBvPRFjTkRYNhgqWuEzns5eYlLRGAiBluGuPL96z0Pxi3xKmPp9GogIGy41UowHc72zNCZ/s4g=="}]},"maintainers":[{"name":"radiovisual","email":"senjudev@gmail.com"}]}},"readme":"# tokenize-whitespace [![Build Status](https://travis-ci.org/radiovisual/tokenize-whitespace.svg)](https://travis-ci.org/radiovisual/tokenize-whitespace)\n\n> Tokenize a string into words and whitespace tokens\n\n## Installation\n\n```\n$ npm install --save tokenize-whitespace\n```\n\n## Usage\n\n```js\nvar tokenizeWhiteSpace = require('tokenize-whitespace');\n\nvar str = '\\tString \\nwith \\nwhitespace \\rchars';\n\n// Get an Array of tokens\ntokenizeWhitespace(str);\n```\n\nOutput:\n\n```js\n[ { text: '\\t',         type: 'HORIZONTALTAB',  length: 1  },\n  { text: 'String',     type: 'WORD',           length: 6  },\n  { text: ' ',          type: 'SPACE',          length: 1  },\n  { text: '\\n',         type: 'LINEFEED',       length: 1  },\n  { text: 'with',       type: 'WORD',           length: 4  },\n  { text: ' ',          type: 'SPACE',          length: 1  },\n  { text: '\\n',         type: 'LINEFEED',       length: 1  },\n  { text: 'whitespace', type: 'WORD',           length: 10 },\n  { text: ' ',          type: 'SPACE',          length: 1  },\n  { text: '\\r',         type: 'CARRIAGERETURN', length: 1  },\n  { text: 'chars',      type: 'WORD',           length: 5  } \n]\n```\n\n## Relevant Whitespace\n\nCurrently, this module only tokenizes the following whitespace characters:\n- `HORIZONTALTAB` => `'\\t'`\n- `LINEFEED` => `'\\n'`\n- `VERTICALTAB` => `'\\v'`\n- `FORMFEED` => `'\\f'`\n- `CARRIAGERETURN` => `'\\r'`\n- `SPACE` => `' '`\n\nPlease [open an issue](https://github.com/radiovisual/tokenize-whitespace/issues) or [submit a pull request](https://github.com/radiovisual/tokenize-whitespace/compare?expand=1) if you would like to see more whitespace character support.\n\n## License \n\nMIT @ [Michael Wuergler](http://numetriclabs.com)","maintainers":[{"name":"radiovisual","email":"senjudev@gmail.com"}],"time":{"modified":"2022-06-27T18:04:56.490Z","created":"2015-12-05T16:45:49.768Z","0.0.1":"2015-12-05T16:45:49.768Z"},"homepage":"https://github.com/radiovisual/tokenize-whitespace#readme","keywords":["token","whitespace","tokenize","string","str","words","space"],"repository":{"type":"git","url":"git+https://github.com/radiovisual/tokenize-whitespace.git"},"author":{"name":"Michael Wuergler","email":"senjudev@gmail.com","url":"http://numetriclabs.com"},"bugs":{"url":"https://github.com/radiovisual/tokenize-whitespace/issues"},"license":"MIT","readmeFilename":"README.md"}