katana
A fast crawler focused on execution in automation pipelines offering both headless and non-headless crawling. See also:
gau,scrapy,waymore. More information: https://docs.projectdiscovery.io/opensource/katana/usage.
- Crawl a list of URLs:
katana -list
- Crawl a [u]RL using headless mode using Chromium:
katana -u
- Pass requests through a proxy (http/socks5) and use custom headers from a file:
katana -proxy -u
- Specify the crawling strategy, depth of subdirectories to crawl, and rate limiting (requests per second):
katana -u
- Find subdomains using
subfinder, crawl each for a maximum number of seconds, and write results to an output file:
subfinder | katana
来源:tldr-pages contributors · 作者与贡献记录 · CC BY 4.0。离线整理了版式、链接和媒体显示。
