{"_id":"@agents-npm-packages/scrapify","name":"@agents-npm-packages/scrapify","dist-tags":{"latest":"0.1.0"},"versions":{"0.1.0":{"name":"@agents-npm-packages/scrapify","version":"0.1.0","description":"Clean frontend extractor: convert live sites into editable HTML/CSS/assets","type":"module","bin":{"scrapify":"dist/cli.js","better-wget":"dist/cli.js"},"scripts":{"build":"tsc -p tsconfig.json","dev":"tsx src/cli.ts","start":"node dist/cli.js","check":"tsc --noEmit -p tsconfig.json"},"keywords":["wget","curl","scraping","frontend","playwright"],"author":"","license":"MIT","dependencies":{"cheerio":"^1.0.0","commander":"^14.0.0","prettier":"^3.6.0"},"devDependencies":{"@types/node":"^24.5.1","tsx":"^4.20.5","typescript":"^5.9.2"},"gitHead":"8c1ccf881ff21e3be359844fe981a2a93e4965f6","_id":"@agents-npm-packages/scrapify@0.1.0","_nodeVersion":"25.3.0","_npmVersion":"11.7.0","dist":{"integrity":"sha512-tlsg4oJ9+axvuxMwDm3aqwG59Bsj/ywl940+rbLzPTivKhHb5d1x7bIrqo+bJ/xvwD7RGAa49LUVh02o315Bzg==","shasum":"efd5d235b59a0e3e387dfac9bd801e0afb68c9d2","tarball":"https://registry.npmjs.org/@agents-npm-packages/scrapify/-/scrapify-0.1.0.tgz","fileCount":6,"unpackedSize":40185,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEUCIQDMBoSDysQEZ8FxrvtbQSeDn/blqLEGMTi1l9dNzP8KdAIgO8574LMtO9rTHAmGTeODylj5AxC3Ba1tiU5yftk1dvs="}]},"_npmUser":{"name":"agents-npm-packages","email":"arjunkshah21@gmail.com"},"directories":{},"maintainers":[{"name":"agents-npm-packages","email":"arjunkshah21@gmail.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/scrapify_0.1.0_1774837925684_0.6507187741866445"},"_hasShrinkwrap":false}},"time":{"created":"2026-03-30T02:32:05.591Z","0.1.0":"2026-03-30T02:32:05.817Z","modified":"2026-03-30T02:32:06.013Z"},"maintainers":[{"name":"agents-npm-packages","email":"arjunkshah21@gmail.com"}],"description":"Clean frontend extractor: convert live sites into editable HTML/CSS/assets","keywords":["wget","curl","scraping","frontend","playwright"],"license":"MIT","readme":"# better-wget\n\n`better-wget` is a frontend-first alternative to wget/curl for design and product work.\n\nInstead of dumping low-quality scraped output, it crawls a live site and exports:\n\n- cleaned, formatted HTML\n- merged, editable CSS\n- downloaded image/font/media assets\n- a machine-readable `manifest.json`\n\n## Why this exists\n\nTraditional download tools optimize for raw bytes. This tool optimizes for **clean editable frontend code**.\n\n## Install\n\n```bash\n# global install (after package is published to npm)\nnpm install -g scrapify\n\n# local development\nnpm install\nnpm run build\nnpm link\n```\n\n## Usage\n\n```bash\n# direct command\nscrapify https://example.com -o ./output/example\n\n# run the scraped site locally\nscrapify run ./output/example --port 4173\n\n# everything mode is now default; disable with --no-everything\nscrapify https://example.com -o ./output/example --mode clean\n\n# strict clean pass for ultra-editable output\nscrapify https://example.com -o ./output/example --strict-clean\n\n# whole-site clean crawl (default): follows internal links and strips scripts/tracker junk\nnode dist/cli.js frontend https://example.com -o ./output/example --mode clean\n\n# mirror mode: keeps script tags and fetches script files when possible\nnode dist/cli.js frontend https://example.com -o ./output/example-mirror --mode mirror\n\n# tune crawl scope\nnode dist/cli.js frontend https://example.com -o ./output/example --depth 4 --max-pages 250\n```\n\n## Output structure\n\n```text\noutput/example/\n  manifest.json\n  src/\n    index.html\n    styles.css\n    pages/\n      about/\n        index.html\n        styles.css\n      pricing/\n        index.html\n        styles.css\n  assets/\n    <hostname>/...\n```\n\nCLI prints a verification report after each scrape:\n- pages/assets/scripts/styles/fonts/images/others counts\n- `remote_urls_remaining` so you can quickly see if anything external is still referenced\n\n## Roadmap\n\n- component inference (`Hero`, `Navbar`, `Footer`) into framework templates\n- CSS deduplication and naming normalization\n- JS de-minification and source-map aware rewriting\n- multi-page crawl with route graph export\n","readmeFilename":"README.md","_rev":"1-483777668132240da92135b85385a99f"}