{"_id":"@adibenmatdev/web-auto-extractor","_rev":"10-22b0bb5b24ec4f7090741f2479e23498","name":"@adibenmatdev/web-auto-extractor","dist-tags":{"latest":"1.1.0"},"versions":{"1.0.1":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.1","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.1","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"b9334240ffb2ef6b8c8c9e6cb75faaa648518711","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.1.tgz","fileCount":12,"integrity":"sha512-oR+xDaVpEOVHO7EVXZI/+iwVMSF10OzzGE0sBmELhhx5M3hVOUWs7zDGIsXGpQlvZ9xVWgLhnsAmAmfh1kzJcg==","signatures":[{"sig":"MEUCIHEtHtPtD61/YbZdce7vfEi6mEL30oojoss1KKSrjsWEAiEA+VBkpG59irWJKAVMaxrcHErln2gx32TE7MmzSui9ud4=","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17074,"npm-signature":"-----BEGIN PGP SIGNATURE-----\r\nVersion: OpenPGP.js v3.0.13\r\nComment: https://openpgpjs.org\r\n\r\nwsFcBAEBCAAQBQJh3xiDCRA9TVsSAnZWagAA5csP+wU7XIR8EjfWSwXfDnos\nBb/dpspkiLEp+LphG1MqthK7pN48LltYJmAVXko4rEyD25VnnVwtYTa8eMDg\nnhW7/rPRdFO8Wf5qwttLGKB3FVQ5Iiljwgdpqh/cICSRWg90TOzbfmIT9WCK\nEJ9lPy9oKn5SpGAMkSjO62MU7dvH5TUWRBKTga3BtxcBIXpWN/3DYOl9JYfq\ngzlYZYOK4BOZ5DD+0nDuExo1WXUnJdOEj5D/R8zo1bq11mHFfUvYcxaO32hk\nouYJLfKSF2YJVBAKso8UK2bq9Wm5Tlh5GsTaGDqM2M6SpEJhk4uPUbgdP+Q5\nG1aEv2Zr6qXybohjYuvwn6+943vZwSvRKJf+bQZFfj7WvEBkcn4XGbV9yaef\nBFdzPTZQnE69G6SBlmAQV0BxDEXf7lpeJewBV4ucTSqYnVfo1g1cYkNOuHks\n4jMRvXWgC3KQGr9/SUyjr3nAN48bZHd+Cn5F5XIALt7yZXK7XO018lGmI1Z1\nIjwEOamxPZgVqP0qAb7Z/k2WzXRFkLJmdMPKrkA/hPWtLFO8OxzKMmqWbSO8\nGitpBOloImE50GdrwhlNDa6Np+J2cqr/TPYOqE74l3o/4s6CmzrEfuu5HLGm\nbzc3Eff3EZeRDNGw9UBjvg9oEiReSniZtBzapOgx0rWszUK7d2kpwFsO8wEl\nhe76\r\n=CZtB\r\n-----END PGP SIGNATURE-----\r\n"},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"b04c67d4418fddfe0295ac2145b3606e067f75cc","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run test && npm run build"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"6.14.11","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"14.16.0","dependencies":{"cheerio":"^0.22.0","jsonrepair":"^2.2.1","htmlparser2":"^3.9.1","babel-polyfill":"^6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.1_1642010755778_0.8610922236444494","host":"s3://npm-registry-packages"}},"1.0.2":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.2","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.2","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"87de061904987fb46a5491a77e863b632afafa99","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.2.tgz","fileCount":12,"integrity":"sha512-PbnhpkCEEKOQhIYO/apbyU3nwfpHm2QPDGkhRe0Y8vWzhqxpBk9s5G82bpEdGbrGaxkPKb3qAUE63ywnJCBbeQ==","signatures":[{"sig":"MEUCIDMI0fkwZSbKqYvEZsvfdhOI8bnSI4lFLuQ0iT7XJXDeAiEAjRi93tKATztj0Zp6hiQ4GLKphm89vEPuFzyJIgPohUA=","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17445},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"01e3f28f530ed00efe105b890b6071ed1f35372e","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run test && npm run build"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"9.6.7","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"18.17.0","dependencies":{"cheerio":"^1.0.0-rc.12","jsonrepair":"^3.7.0","htmlparser2":"^3.9.1","babel-polyfill":"^6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.2_1714313111333_0.016567443491284584","host":"s3://npm-registry-packages"}},"1.0.3":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.3","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.3","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"3d13a03c8c7481b215103d9b52a44f2ee2589127","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.3.tgz","fileCount":12,"integrity":"sha512-LZkJ9fmCl4fKmI6xB858jq84UBDko3dInPZEFNSIdTbyvPP3ijiIzbbLsTaRZU75zeIzU3d0jkgsbzWRHTWxDg==","signatures":[{"sig":"MEUCIBt59Z2ZaIgh4Jb+mQVzLJIPdSlg9Jtmr1fURKrKZJXsAiEAiyBfeMyUO6uL2NxOmwH9D5d1rOqVCRAlsMrHIqmA0A4=","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17320},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"01e3f28f530ed00efe105b890b6071ed1f35372e","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run test && npm run build"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"9.6.7","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"18.17.0","dependencies":{"cheerio":"^1.0.0-rc.12","jsonrepair":"^3.7.0","htmlparser2":"^3.9.1","babel-polyfill":"^6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.3_1714313798190_0.6145238788954059","host":"s3://npm-registry-packages"}},"1.0.4":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.4","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.4","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"5baabbcde14ea7a67e93a4ce80834c7566c458f9","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.4.tgz","fileCount":12,"integrity":"sha512-U9nd4vvhgGpn2ufL8wHpTctB8isg0dQhiDgKqSBUYL68z4Q9HmBkW09aPqf6O+K/29DUyjQwZeXxcCOnVPwjHw==","signatures":[{"sig":"MEUCIETrObj+yAojMrIEVX5U31lxsuiHBrpBSm1HL8GtGcijAiEA6iqBEmUpL0FP1Q5sQC051JZoI8zQWGw2ey4QvNUH6Yg=","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17316},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"0b6838e212f365362f7596daa22c6da732a3bf48","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run test && npm run build"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"7.19.1","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"16.20.2","dependencies":{"cheerio":"1.0.0-rc.12","jsonrepair":"3.7.0","htmlparser2":"3.9.1","babel-polyfill":"6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.4_1723562378751_0.6564944658355998","host":"s3://npm-registry-packages"}},"1.0.5":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.5","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.5","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"e4d3a0863695656bfc40cb1efc33e2f1be6fbab8","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.5.tgz","fileCount":12,"integrity":"sha512-0390hpnZ2xNQ6JVWxE0lJcq6908V47sp/4fKIToWMnDctqlw7dWybUWhG3MYabMEaI5z4nTC7kZOPSqoBaLHYw==","signatures":[{"sig":"MEYCIQDye53177BBR7BqWfs119Yt/JqQ++AD5Hns9yz+r4SWxwIhAOsYX45Tt8qM4hAb1Q1PhXsfjvJXlAH10EsTd5Ij/iOc","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17388},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"452a255658c37d5cfc1ad850213ae70d0ef6aca5","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run test && npm run build"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"7.19.1","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"16.20.2","dependencies":{"cheerio":"1.0.0-rc.12","jsonrepair":"3.7.0","htmlparser2":"3.9.1","babel-polyfill":"6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","@babel/register":"^7.24.6","@babel/preset-env":"^7.25.3","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.5_1723993130619_0.36164784625944835","host":"s3://npm-registry-packages"}},"1.0.6":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.6","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.6","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"f3518f16149a78529d3a1d8c0602de6a551cd6c7","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.6.tgz","fileCount":12,"integrity":"sha512-HUGrhScD/kT63Xx1cYSSn5nl500Z575nDu5DMS5ZgF8HjOX9oDKGkHXIDWkPmAFLNeFT70Oimpo9+b1mnOMj2w==","signatures":[{"sig":"MEYCIQDyPMcJFFNYCm1xUB6oLxXYFLpHKiP/kCqa/1rmDyie2gIhAK3SAQQkvHwzFZUUccemg93npsM/hDvxm4F6to/VDiG7","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17388},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"452a255658c37d5cfc1ad850213ae70d0ef6aca5","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run test && npm run build"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"7.19.1","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"16.20.2","dependencies":{"cheerio":"1.0.0-rc.12","jsonrepair":"3.7.0","htmlparser2":"3.9.1","babel-polyfill":"6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","@babel/register":"^7.24.6","@babel/preset-env":"^7.25.3","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.6_1723993525668_0.7716235926988377","host":"s3://npm-registry-packages"}},"1.0.7":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.7","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.7","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"0a6a307b7e9da4b10148c36238a0dddc95b34911","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.7.tgz","fileCount":12,"integrity":"sha512-bfu8pfIO/FQpJTqUr+i0doCRC+Ql6IXrh5yHrPLiI/NU5tR/W5s6GvC+o123ocstyPxX/NJBpAC/iTHs6CsiBg==","signatures":[{"sig":"MEQCIHFxMMlqBsFwg3YCe9yhhrgb//EWqDrSNVpZGdo3opBFAiBM+10iP8a7X6wNQDuj2773agsyNHlpDmnzybwGYAM2cQ==","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17394},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"452a255658c37d5cfc1ad850213ae70d0ef6aca5","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run build && npm run test"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"7.19.1","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"16.20.2","dependencies":{"cheerio":"1.0.0-rc.12","jsonrepair":"3.7.0","htmlparser2":"3.9.1","babel-polyfill":"6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","@babel/register":"^7.24.6","@babel/preset-env":"^7.25.3","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.7_1723993692210_0.5540969188116824","host":"s3://npm-registry-packages"}},"1.0.8":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.8","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.8","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"d18292adcebd4c66fa7009bc574d838ccbd3e79c","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.8.tgz","fileCount":12,"integrity":"sha512-taVplHU92XBxd/6MeCsdr9L6seqderpaLMu+B37V8DmMXfzLlDrQ4cbqWPwCJ2KvdrQfPDqcJ10MFht2REthEQ==","signatures":[{"sig":"MEUCICMWIWQ2EHxXx6Ys6GDc4odf/x4ga/vUG/GmSwZpsIOSAiEAvLAERbc0/dURkccoaOR5I+b0tph73A9al3lWwbXgS6Y=","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17333},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"452a255658c37d5cfc1ad850213ae70d0ef6aca5","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run build && npm run test"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"7.19.1","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"16.20.2","dependencies":{"cheerio":"1.0.0-rc.12","jsonrepair":"3.7.0","htmlparser2":"3.9.1","babel-polyfill":"6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","@babel/register":"^7.24.6","@babel/preset-env":"^7.25.3","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.8_1723993900789_0.7479463037240355","host":"s3://npm-registry-packages"}},"1.0.9":{"name":"@adibenmatdev/web-auto-extractor","version":"1.0.9","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"author":"","license":"MIT","_id":"@adibenmatdev/web-auto-extractor@1.0.9","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"homepage":"https://github.com/indix/web-auto-extractor#readme","bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"dist":{"shasum":"05d5d543275bd70c112176e9abdedced1eb6c8d2","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.0.9.tgz","fileCount":12,"integrity":"sha512-YnmV83RUTc6UHt2l6C5ONXN/zvHGAZ13HgxDnExxG0MBgXCAJJo2m2dyz+leh11apC327tsbE7g0hnqufnLaHA==","signatures":[{"sig":"MEUCIQCUIjk5qIL3+bddfXE2M0d1yLI4Ee5loN+0+AL754RKewIgS0+a56jUNvkpu1/AohLWDIXzsXIqODRLUapBQ5toffU=","keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA"}],"unpackedSize":17333},"main":"dist/index.js","engines":{"node":">=4.4"},"gitHead":"452a255658c37d5cfc1ad850213ae70d0ef6aca5","scripts":{"dev":"nodemon --exec npm run lint","lint":"standard","test":"mocha --recursive --compilers js:babel-register","build":"babel src -d dist","prepublish":"npm run build && npm run test"},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"standard":{"ignore":["tonicExample.js"],"parser":"babel-eslint"},"repository":{"url":"git+https://github.com/indix/web-auto-extractor.git","type":"git"},"_npmVersion":"7.19.1","description":"Automatically extracts structured information from webpages - with json repair","directories":{"test":"test"},"_nodeVersion":"16.20.2","dependencies":{"cheerio":"1.0.0-rc.12","jsonrepair":"3.7.0","htmlparser2":"3.9.1","babel-polyfill":"6.8.0"},"_hasShrinkwrap":false,"devDependencies":{"chai":"^3.5.0","mocha":"^2.4.5","sinon":"^1.17.4","nodemon":"^1.9.2","standard":"^7.0.1","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","@babel/register":"^7.24.6","@babel/preset-env":"^7.25.3","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0"},"tonicExampleFilename":"tonicExample.js","_npmOperationalInternal":{"tmp":"tmp/web-auto-extractor_1.0.9_1723994101305_0.9348714068377928","host":"s3://npm-registry-packages"}},"1.1.0":{"name":"@adibenmatdev/web-auto-extractor","version":"1.1.0","description":"Automatically extracts structured information from webpages - with json repair","main":"dist/index.js","scripts":{"build":"babel src -d dist","test":"mocha --recursive --compilers js:babel-register","lint":"standard","dev":"nodemon --exec npm run lint","prepublish":"npm run build && npm run test"},"engines":{"node":">=4.4"},"license":"MIT","dependencies":{"babel-polyfill":"6.8.0","cheerio":"1.0.0-rc.12","htmlparser2":"3.9.1","jsonrepair":"3.7.0"},"devDependencies":{"@babel/preset-env":"^7.25.3","@babel/register":"^7.24.6","babel-cli":"^6.8.0","babel-eslint":"^6.0.4","babel-preset-es2015":"^6.6.0","babel-preset-stage-0":"^6.5.0","chai":"^3.5.0","mocha":"^2.4.5","nodemon":"^1.9.2","sinon":"^1.17.4","standard":"^7.0.1"},"standard":{"parser":"babel-eslint","ignore":["tonicExample.js"]},"keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"repository":{"type":"git","url":"git+https://github.com/indix/web-auto-extractor.git"},"bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"tonicExampleFilename":"tonicExample.js","homepage":"https://github.com/indix/web-auto-extractor#readme","directories":{"test":"test"},"author":"","gitHead":"9cd26cc55f4a201c62f0d31803c4a2c975653f17","_id":"@adibenmatdev/web-auto-extractor@1.1.0","_nodeVersion":"16.20.2","_npmVersion":"7.19.1","dist":{"integrity":"sha512-asu6z5ACi/Q68VoZUfySIfz/NftNxtM2spIxJ5LTaX3p7ZY4GyIhDcmgqLAfNb6zfyivtHQ8h6kRcimFVMPTVQ==","shasum":"1c7454f736166b956dade0ee9e2ea2b57ca272e0","tarball":"https://registry.npmjs.org/@adibenmatdev/web-auto-extractor/-/web-auto-extractor-1.1.0.tgz","fileCount":12,"unpackedSize":17381,"signatures":[{"keyid":"SHA256:jl3bwswu80PjjokCgh0o2w5c2U4LhQAE57gj9cz1kzA","sig":"MEQCIC1ngjYdEGK/MRSptuNKsPc3w/4xojxyCCMRAC8mQyYeAiAF4NirirLIT+yqyS2IS/oIzXafyS62Rek+lCrwKg8hgg=="}]},"_npmUser":{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"},"maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages","tmp":"tmp/web-auto-extractor_1.1.0_1724431033430_0.7780362184148171"},"_hasShrinkwrap":false}},"time":{"created":"2022-01-12T18:05:55.701Z","modified":"2024-08-23T16:37:13.747Z","1.0.1":"2022-01-12T18:05:55.936Z","1.0.2":"2024-04-28T14:05:11.501Z","1.0.3":"2024-04-28T14:16:38.355Z","1.0.4":"2024-08-13T15:19:38.928Z","1.0.5":"2024-08-18T14:58:50.787Z","1.0.6":"2024-08-18T15:05:25.901Z","1.0.7":"2024-08-18T15:08:12.336Z","1.0.8":"2024-08-18T15:11:40.947Z","1.0.9":"2024-08-18T15:15:01.485Z","1.1.0":"2024-08-23T16:37:13.595Z"},"bugs":{"url":"https://github.com/indix/web-auto-extractor/issues"},"license":"MIT","homepage":"https://github.com/indix/web-auto-extractor#readme","keywords":["crawler","parser","html parser","schema.org","microdata","rdfa","jsonld","seo"],"repository":{"type":"git","url":"git+https://github.com/indix/web-auto-extractor.git"},"description":"Automatically extracts structured information from webpages - with json repair","maintainers":[{"name":"adibenmatdev","email":"adibenmatdev@gmail.com"}],"readme":"# Web Auto Extractor\r\n[![Build Status](https://travis-ci.org/indix/web-auto-extractor.svg?branch=master)](https://travis-ci.org/indix/web-auto-extractor)\r\n\r\nParse semantically structured information from any HTML webpage.\r\n\r\nSupported formats:-\r\n- Encodings that support [Schema.org](http://schema.org/) vocabularies:-\r\n - Microdata\r\n - RDFa-lite\r\n - JSON-LD\r\n- Random Meta tags\r\n\r\nPopularly, many websites mark up their webpages with Schema.org vocabularies for better SEO. This library helps you parse that information to JSON.\r\n\r\n**[Demo](https://tonicdev.com/npm/web-auto-extractor)** it on tonicdev\r\n\r\n## Installation\r\n`npm install web-auto-extractor`\r\n\r\n## [Usage](#usage)\r\n\r\n```js\r\n// IF CommonJS\r\nvar WAE = require('web-auto-extractor').default\r\n// IF ES6\r\nimport WAE from 'web-auto-extractor'\r\n\r\nvar parsed = WAE().parse(sampleHTML)\r\n\r\n```\r\n\r\nLet's use the following text as the `sampleHTML` in our example. It uses Schema.org vocabularies to structure a Product information and is encoded in `microdata` format.\r\n\r\n#### [Input](#input)\r\n```html\r\n
\r\n ACME\r\n Executive Anvil\r\n \"Executive\r\n Sleeker than ACME's Classic Anvil, the\r\n Executive Anvil is perfect for the business traveler\r\n looking for something to drop from a height.\r\n \r\n Product #: 925872\r\n \r\n 4.4 stars, based on 89\r\n reviews\r\n \r\n\r\n \r\n Regular price: $179.99\r\n \r\n $119.99\r\n (Sale ends )\r\n Available from: \r\n Executive Objects\r\n \r\n Condition: Previously owned,\r\n in excellent condition\r\n In stock! Order now!\r\n \r\n
\r\n```\r\n\r\n#### [Output](#output)\r\n\r\nOur `parsed` object should look like -\r\n\r\n```json\r\n{\r\n \"microdata\": {\r\n \"Product\": [\r\n {\r\n \"@context\": \"http://schema.org/\",\r\n \"@type\": \"Product\",\r\n \"brand\": \"ACME\",\r\n \"name\": \"Executive Anvil\",\r\n \"image\": \"anvil_executive.jpg\",\r\n \"description\": \"Sleeker than ACME's Classic Anvil, the\\n Executive Anvil is perfect for the business traveler\\n looking for something to drop from a height.\",\r\n \"mpn\": \"925872\",\r\n \"aggregateRating\": {\r\n \"@context\": \"http://schema.org/\",\r\n \"@type\": \"AggregateRating\",\r\n \"ratingValue\": \"4.4\",\r\n \"reviewCount\": \"89\"\r\n },\r\n \"offers\": {\r\n \"@context\": \"http://schema.org/\",\r\n \"@type\": \"Offer\",\r\n \"priceCurrency\": \"USD\",\r\n \"price\": \"119.99\",\r\n \"priceValidUntil\": \"5 November!\",\r\n \"seller\": {\r\n \"@context\": \"http://schema.org/\",\r\n \"@type\": \"Organization\",\r\n \"name\": \"Executive Objects\"\r\n },\r\n \"itemCondition\": \"http://schema.org/UsedCondition\",\r\n \"availability\": \"http://schema.org/InStock\"\r\n }\r\n }\r\n ]\r\n },\r\n \"rdfa\": {},\r\n \"jsonld\": {},\r\n \"metatags\": {\r\n \"priceCurrency\": [\r\n \"USD\",\r\n \"USD\"\r\n ]\r\n }\r\n}\r\n```\r\n\r\nThe `parsed` object includes four objects - `microdata`, `rdfa`, `jsonld` and `metatags`. Since the above HTML does not have any information encoded in `rdfa` and `jsonld`, those two objects are empty.\r\n\r\n## Caveat\r\n\r\nI wouldn't call it a caveat but rather the parser is strict by design. It might not parse like expected if the HTML isn't encoded correctly, so one might assume the parser is broken.\r\n\r\nFor example, take the following HTML snippet.\r\n\r\n```html\r\n
\r\n

Ghostbusters

\r\n
Black Rhino
\r\n
\r\n Country: United States

\r\n

\r\n
\r\n```\r\n\r\nThe problem here is the `itemprop` - `productionCompany` which is of `itemtype` - `Organization` doesn't have any `itemprop` as its children, in this case - `name`.\r\n\r\nThe parser assumes every `itemtype` contains an `itemprop`, or every `typeof` contains a `property` in case of `rdfa`. So the `\"Black Rhino\"` information is lost.\r\n\r\nIt'll be nice to fix this by having a `non-strict` mode for parsing this information. PRs are welcome.\r\n\r\n## License\r\n\r\nMIT\r\n","readmeFilename":"README.md"}