]> git.evergreen-ils.org Git - working/random.git/commit
projects / working / random.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 0e7b116) | patch
Web spider sample script
authorerickson <erickson@6d9bc8c9-1ec2-4278-b937-99fde70a366f>
Sat, 29 Jan 2011 16:06:52 +0000 (16:06 +0000)
committererickson <erickson@6d9bc8c9-1ec2-4278-b937-99fde70a366f>
Sat, 29 Jan 2011 16:06:52 +0000 (16:06 +0000)
commit4303c3dba72eaa87dd92af622540fbd4f493441d
tree5fa896d7dbc6047825638a8930d938b891c27db0tree
parent0e7b116784ff3275aba3ee5c2d6fca1d57629375commit | diff
Web spider sample script

Simple web spider script that visits, reports, parses, collects links,
and continues until it has fetched a configured number of pages.  Each page
load is a constrictor Task so timing data can be collected.

git-svn-id: svn://svn.open-ils.org/ILS-Contrib/constrictor/trunk@1215 6d9bc8c9-1ec2-4278-b937-99fde70a366f
constrictor.properties diff | blob | history
constrictor/data.py diff | blob | history
constrictor/log.py diff | blob | history
constrictor/properties.py diff | blob | history
constrictor/task.py diff | blob | history
samples/web_spider.py [new file with mode: 0755] blob
Random Contribs