Advertisement
7_2009-2012 Internet/ Browsers/ HTML #227313

Spider 1.0

This code will spider a given URL and extrapolate links, e-mails, meta information (keywords, description, title), and a specified amount of words. This is useful for indexing personal webpages for use in conjuction with a search engine. Since it's in it's own class, it's very easy to use. This would work particularly well with a search enginge front end and database backend.

AI

AI Summary: This codebase represents a historical implementation of the logic described in the metadata. Our preservation engine analyzes the structure to provide context for modern developers.

Source Code
original-source
Upload
Original Comments (3)
Recovered from Wayback Machine