SCOOPER is free software with no warranty, copyright or other excuse.
ANNOUNCING SCOOPER THE FREE WEB PAGE SPIDER
Written by Lee Kent Hempfling December 2020 out of sheer boredom
See the readme.txt file for details contained in the scooper.zip file.
Scooper is written in PHP and will work with no set up or modification. Just upload the script to any folder on a web server running PHP (all of them!)
Create a folder ‘data’ inside of that placement where files will be written.
That’s it.
Any domain you input to the script will be spidered, parsed and returned to a file of the same name as the domain or page.
You can download that file by clicking it in the list (will display in the browser)
Or you can download all files in a ZIP file that will be automatically saved to your selected download folder or location.
Scooper loads jQuery and Bootstrap utilities.
You can delete files one at a time as well.
There ya go.
Here is the example … this is my site spidered for all links:
The format of the file is LINK NAME|LINK|EPOCH DATETIME
And of course if you would like this script to be extended: such as following every link it finds to find more links (ie: like search spiders function) I would be happy to so extend. Not too cheap but could be affordable. Who knows.