Spencer/Python_HTTP_JavaScript_Scraper
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
Files
main
Python_HTTP_JavaScript_Scraper/README.md
Pin 47a4850f00 small doc changes
2022-01-23 17:09:00 -05:00

789 B
Raw Permalink Blame History

HTTP JavaScript Scraper

Run the code with the following:

# python3 main.py {proto}://{site}
python3 main.py https://www.nintendo.com

Any site that only serves HTTP/2 content will return a 301 HTTP response code. It will return a 301 trying to redirect you to HTTP/2 on the same address and port.

Any status code other than 200 will be reported back to the user without any additional processing. The output of the program will contain the unique number of external resources. If two files are referenced from abc.com they will only count as one external reference. Any reference that shares the same base URL will count once. A full list of references will also be printed out regardless of the uniqueness.

No additional dependencies are required to run the program.