crawl a subset

[gregwebs]

Avoid creating excess traffic and storing excess files. These features would help:

Reducing crawling

• crawl a subset of pages
• limit link following
• interactive mode that reports on all the links it will follow and asks for approval

Reducing high bandwidth/storage

• don't download images (possibly past a threshold)
• don't download videos (don't actually know if it is now)

[Xirui]

I think the existing clone cmd flags already cover most of the use‑cases you mentioned:

Reducing crawling

• crawl a subset of pages: --exclude or --scope-prefix
• limit link following: -d --max-depth

Reducing high bandwidth/storage

• don't download images (possibly past a threshold): --max-asset-mb or --skip-ext .svg .png .jpg .jpeg
• don't download videos (don't actually know if it is now): --skip-ext .mp4 .mkv