Primitive script to scan a website and probe for valid HTTP directories, files, and queries.

Requires use of SOCKS4 proxies (to bypass any load-balancer or WAF that doesn't like you prying around). Some are included. Feel free to use your own, or get a fresh list here: https://github.com/waived/proxy-scraper

Good luck