{"_id":"@agents-npm-packages/cleanscrape","name":"@agents-npm-packages/cleanscrape","dist-tags":{"latest":"0.1.0"},"versions":{"0.1.0":{"name":"@agents-npm-packages/cleanscrape","version":"0.1.0","description":"Clean frontend extractor: convert live sites into editable HTML/CSS/assets","type":"module","bin":{"cleanscrape":"dist/cli.js","scraper":"dist/cli.js","scrapify":"dist/cli.js","better-wget":"dist/cli.js"},"scripts":{"build":"tsc -p tsconfig.json","dev":"tsx src/cli.ts","start":"node dist/cli.js","check":"tsc --noEmit -p tsconfig.json"},"keywords":["wget","curl","scraping","frontend","playwright"],"author":"","license":"MIT","dependencies":{"cheerio":"^1.0.0","commander":"^14.0.0","prettier":"^3.6.0"},"devDependencies":{"@types/node":"^24.5.1","tsx":"^4.20.5","typescript":"^5.9.2"},"gitHead":"87c65c0c467f17a14052a4bec71f3e8237bfbc24","_id":"@agents-npm-packages/cleanscrape@0.1.0","_nodeVersion":"25.3.0","_npmVersion":"11.7.0","dist":{"integrity":"sha512-p0MhiFrfTifMCga+50sXtgcjmAhxEMGzI1yzVTeRvB8BLcKZDZ/EZGLKwCZYV64DAW/MoJ3mOU249vA7WDzZSA==","shasum":"22fdd02498bd7466f42d6f5b332c940c8c726a8c","tarball":"https://registry.npmjs.org/@agents-npm-packages/cleanscrape/-/cleanscrape-0.1.0.tgz","fileCount":6,"unpackedSize":40426,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEYCIQCA50hxVoMgKLw61XZ9GyaCpj66dtxHg5fUEFGEEqNSMQIhAPj+YHFRRid2E99rWpcSa3PszBpAx21dH5fKEs28kIOm"}]},"_npmUser":{"name":"agents-npm-packages","email":"arjunkshah21@gmail.com"},"directories":{},"maintainers":[{"name":"agents-npm-packages","email":"arjunkshah21@gmail.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/cleanscrape_0.1.0_1774838107715_0.5724497758411258"},"_hasShrinkwrap":false}},"time":{"created":"2026-03-30T02:35:07.604Z","0.1.0":"2026-03-30T02:35:07.859Z","modified":"2026-03-30T02:35:08.049Z"},"maintainers":[{"name":"agents-npm-packages","email":"arjunkshah21@gmail.com"}],"description":"Clean frontend extractor: convert live sites into editable HTML/CSS/assets","keywords":["wget","curl","scraping","frontend","playwright"],"license":"MIT","readme":"# better-wget\n\n`better-wget` is a frontend-first alternative to wget/curl for design and product work.\n\nInstead of dumping low-quality scraped output, it crawls a live site and exports:\n\n- cleaned, formatted HTML\n- merged, editable CSS\n- downloaded image/font/media assets\n- a machine-readable `manifest.json`\n\n## Why this exists\n\nTraditional download tools optimize for raw bytes. This tool optimizes for **clean editable frontend code**.\n\n## Install\n\n```bash\n# global install\nnpm install -g @agents-npm-packages/cleanscrape\n\n# local development\nnpm install\nnpm run build\nnpm link\n```\n\n## Usage\n\n```bash\n# direct command\ncleanscrape https://example.com -o ./output/example\n\n# run the scraped site locally\ncleanscrape run ./output/example --port 4173\n\n# everything mode is now default; disable with --no-everything\ncleanscrape https://example.com -o ./output/example --mode clean\n\n# strict clean pass for ultra-editable output\ncleanscrape https://example.com -o ./output/example --strict-clean\n\n# whole-site clean crawl (default): follows internal links and strips scripts/tracker junk\nnode dist/cli.js frontend https://example.com -o ./output/example --mode clean\n\n# mirror mode: keeps script tags and fetches script files when possible\nnode dist/cli.js frontend https://example.com -o ./output/example-mirror --mode mirror\n\n# tune crawl scope\nnode dist/cli.js frontend https://example.com -o ./output/example --depth 4 --max-pages 250\n```\n\n## Output structure\n\n```text\noutput/example/\n  manifest.json\n  src/\n    index.html\n    styles.css\n    pages/\n      about/\n        index.html\n        styles.css\n      pricing/\n        index.html\n        styles.css\n  assets/\n    <hostname>/...\n```\n\nCLI prints a verification report after each scrape:\n- pages/assets/scripts/styles/fonts/images/others counts\n- `remote_urls_remaining` so you can quickly see if anything external is still referenced\n\n## Roadmap\n\n- component inference (`Hero`, `Navbar`, `Footer`) into framework templates\n- CSS deduplication and naming normalization\n- JS de-minification and source-map aware rewriting\n- multi-page crawl with route graph export\n","readmeFilename":"README.md","_rev":"1-156f96d6d644dffe7d38eb9479044a47"}