Log of /trunk/perl/scripts/est-spider

---

Revision 33 - (view) (annotate) - [select for diffs]
Modified Tue Oct 11 14:04:52 2005 UTC (18 years, 1 month ago) by dpavlin
File length: 5605 byte(s)
Diff to previous 31

save empty entry as a placeholder

---

Revision 31 - (view) (annotate) - [select for diffs]
Modified Wed Sep 21 15:59:54 2005 UTC (18 years, 2 months ago) by dpavlin
File length: 5522 byte(s)
Diff to previous 30

check if path exists

---

Revision 30 - (view) (annotate) - [select for diffs]
Modified Sun Sep 18 18:21:06 2005 UTC (18 years, 2 months ago) by dpavlin
File length: 5437 byte(s)
Diff to previous 29

split pdf into pages (using #page in uri)

---

Revision 29 - (view) (annotate) - [select for diffs]
Modified Sat Sep 17 23:55:09 2005 UTC (18 years, 2 months ago) by dpavlin
File length: 5426 byte(s)
Diff to previous 28

make title extraction non-greedy, added --force option to force reindex

---

Revision 28 - (view) (annotate) - [select for diffs]
Modified Sat Sep 17 23:43:20 2005 UTC (18 years, 2 months ago) by dpavlin
File length: 5361 byte(s)
Diff to previous 27

use @mtime to store mtime as unix time and check for changes

---

Revision 27 - (view) (annotate) - [select for diffs]
Modified Sat Sep 17 23:07:52 2005 UTC (18 years, 2 months ago) by dpavlin
File length: 4959 byte(s)
Diff to previous 26

use File::MMagic::XS to perform better checking on input formats

---

Revision 26 - (view) (annotate) - [select for diffs]
Modified Sat Sep 17 21:22:26 2005 UTC (18 years, 2 months ago) by dpavlin
File length: 4378 byte(s)
Diff to previous 18

fix recursive links by adding follow_skip => 2

---

Revision 18 - (view) (annotate) - [select for diffs]
Modified Sat Sep 10 09:31:53 2005 UTC (18 years, 2 months ago) by dpavlin
File length: 4358 byte(s)
Diff to previous 5

added --node option to use node API

---

Revision 5 - (view) (annotate) - [select for diffs]
Added Sat Sep 3 19:16:48 2005 UTC (18 years, 3 months ago) by dpavlin
File length: 4094 byte(s)

example spider for filesystem (like estcmd gather)