Spidering

The spider functionality allows you to quickly discover resources on a Website.

You can do this by right-clicking on any resource in the Website Outline and selecting Spider Here from the context menu. This will perform a quick GET request for the specified Resource and add links from an HTML response payload to the outline.

Note that

• A single request is sent out
• Links are limited to those that point to regular pages (not to images, styles, fonts, JavaScript)
• Links are limited to the same domain
• Dynamically constructed links are not detected

Last updated on 2023-12-05