Log of /trunk

---

Revision 302 - Directory Listing
Modified Sun Apr 4 22:09:57 2004 UTC (19 years, 8 months ago) by dpavlin

bug fix: support for working from root of virtual host

---

Revision 300 - Directory Listing
Modified Sun Apr 4 21:04:47 2004 UTC (19 years, 8 months ago) by dpavlin

even more detail explanation

---

Revision 299 - Directory Listing
Modified Sun Apr 4 20:48:56 2004 UTC (19 years, 8 months ago) by dpavlin

explanation of bit-masks with examples

---

Revision 298 - Directory Listing
Modified Fri Apr 2 23:31:25 2004 UTC (19 years, 8 months ago) by dpavlin

You can now specify configuration file as command-line option, and
if you don't do that, it will use default one called all2xml.conf

---

Revision 297 - Directory Listing
Modified Fri Apr 2 23:30:44 2004 UTC (19 years, 8 months ago) by dpavlin

removed unneeded warning

---

Revision 293 - Directory Listing
Modified Mon Mar 29 19:41:12 2004 UTC (19 years, 8 months ago) by dpavlin

bug fix: eval now honours codepage settings

---

Revision 290 - Directory Listing
Modified Sun Mar 14 20:19:42 2004 UTC (19 years, 8 months ago) by dpavlin

delimiter and append now works as expected

---

Revision 287 - Directory Listing
Modified Sun Mar 14 19:50:13 2004 UTC (19 years, 8 months ago) by dpavlin

fix

---

Revision 286 - Directory Listing
Modified Sun Mar 14 19:44:57 2004 UTC (19 years, 8 months ago) by dpavlin

merge changes from trunk to branches, converted all import_xml

---

Revision 285 - Directory Listing
Modified Sun Mar 14 19:43:51 2004 UTC (19 years, 8 months ago) by dpavlin

preserve other attributes

---

Revision 281 - Directory Listing
Modified Sun Mar 14 18:04:52 2004 UTC (19 years, 8 months ago) by dpavlin

converted delimiters to new format

---

Revision 280 - Directory Listing
Modified Sun Mar 14 17:16:21 2004 UTC (19 years, 8 months ago) by dpavlin

script to convert delimiters

---

Revision 279 - Directory Listing
Modified Sun Mar 14 14:59:43 2004 UTC (19 years, 8 months ago) by dpavlin

Implemented new form of delimiters like this:

<tag>
	<delimiter>, </delimiter>
	<value>200a</value>
</tag>

which is equivavelnt to following old mark-up:

<tag delimiter=", ">200a</tag>

but, it won't loose spaces in attribute values (which
are invalid by XML specification and XML::Simple removes
them so WebPac never get them)

---

Revision 278 - Directory Listing
Modified Sun Mar 14 12:37:14 2004 UTC (19 years, 8 months ago) by dpavlin

moved tests in own directory, added test to demonstrate XML::Simple feature
to remove spaces from begin and end attribute value (which is wrong for
delimiters as WebPAC uses them)

---

Revision 275 - Directory Listing
Modified Sun Mar 14 12:06:51 2004 UTC (19 years, 8 months ago) by dpavlin

ported 269:272 from hidra

---

Revision 274 - Directory Listing
Modified Sun Mar 14 11:50:29 2004 UTC (19 years, 8 months ago) by dpavlin

<config> tags (which use values from all2xml.conf) are now properly handled
if there is more than one in same swish tag. However, to use <config
type="index"> is useless IMHO, and <config type="index_lookup"> is not
implemented.

---

Revision 271 - Directory Listing
Modified Sat Mar 13 17:46:47 2004 UTC (19 years, 8 months ago) by dpavlin

"show details" now work corretly when not on first page

---

Revision 263 - Directory Listing
Modified Fri Mar 12 15:06:58 2004 UTC (19 years, 8 months ago) by dpavlin

ported r260 from hidra branch: moved eval to parse_format.pm where it
belongs. Also changed eval format to: eval{v901^a eq "Mikrotezaurus"}
(please note same format as in ISIS formating language)

---

Revision 259 - Directory Listing
Modified Thu Mar 11 18:23:59 2004 UTC (19 years, 8 months ago) by dpavlin

ported 257:258 from hidra branch
all2xml.pl - fix for swish without filter
openisis/perl/OpenIsis.pm - removed warning

---

Revision 256 - Directory Listing
Modified Tue Mar 9 12:18:17 2004 UTC (19 years, 8 months ago) by dpavlin

ported r254 from hidra branch

---

Revision 255 - Directory Listing
Modified Tue Mar 9 12:17:05 2004 UTC (19 years, 8 months ago) by dpavlin

ported r248:252 from hidra branch:

r248: much improved installation instructions, especially for Debian
      GNU/Linux distributions
r249: changed use of Spreadsheet::ParseExcel and MARC to require/import so
      that dependency on those modules can be resolved in runtime.
r250: finished installation documentation
r251: removing dependency on HTML::Parser would ease installation
r252: smaller eval{} fiexes. eval{} logic should really move to
      parse_format.pm

---

Revision 240 - Directory Listing
Modified Mon Mar 8 17:52:10 2004 UTC (19 years, 8 months ago) by dpavlin

implement close for perl OpenIsis bindings

---

Revision 239 - Directory Listing
Modified Mon Mar 8 17:49:13 2004 UTC (19 years, 8 months ago) by dpavlin

including openisis 0.9.0 into webpac tree

---

Revision 235 - Directory Listing
Modified Sun Mar 7 23:15:24 2004 UTC (19 years, 8 months ago) by dpavlin

preparation for first file dump at sourceforge.net

---

Revision 234 - Directory Listing
Modified Sun Mar 7 22:51:14 2004 UTC (19 years, 8 months ago) by dpavlin

eval{...} now works for type="swish" also...

---

Revision 233 - Directory Listing
Modified Fri Mar 5 23:33:19 2004 UTC (19 years, 8 months ago) by dpavlin

lookup_key and lookup_val types now support filters

---

Revision 232 - Directory Listing
Modified Fri Mar 5 23:18:30 2004 UTC (19 years, 8 months ago) by dpavlin

dump TDB file (e.g. lookup)

---

Revision 231 - Directory Listing
Modified Fri Mar 5 22:53:30 2004 UTC (19 years, 8 months ago) by dpavlin

clear memory cache when opening new file lookup

---

Revision 230 - Directory Listing
Modified Wed Feb 25 10:49:32 2004 UTC (19 years, 9 months ago) by dpavlin

Lot of changes and improvements:
- documentation at beginning of script
- use XML file for configuration (as opposed to hard-coded values in script)
- example XML configuration can be created with ./isis2marc.pl > config.xml
- supports unique and non-unique output depending on presence of <key>
  tag in configuration file

---

Revision 229 - Directory Listing
Modified Mon Feb 23 23:21:43 2004 UTC (19 years, 9 months ago) by dpavlin

brown-bag-bug-fix: writing MARC file just once (at end) will save a lot of time

---

Revision 228 - Directory Listing
Modified Mon Feb 23 23:17:17 2004 UTC (19 years, 9 months ago) by dpavlin

script which will select just some fields from CDS/ISIS database and insert
only unique values in MARC file (useful for creating ad-hoc authority file)

---

Revision 227 - Directory Listing
Modified Sun Feb 22 23:31:00 2004 UTC (19 years, 9 months ago) by dpavlin

Beginning of documentation for debugging of changes in configuration
file. In short: what to do when WebPAC isn't behaving as you expected.

---

Revision 226 - Directory Listing
Modified Wed Feb 11 08:33:51 2004 UTC (19 years, 9 months ago) by dpavlin

added SQLite parametar sqlite_handle_binary_nulls

---

Revision 225 - Directory Listing
Modified Tue Feb 10 10:20:50 2004 UTC (19 years, 9 months ago) by dpavlin

don't die if old table cannot be dropped

---

Revision 224 - Directory Listing
Modified Sun Feb 8 20:16:54 2004 UTC (19 years, 9 months ago) by dpavlin

important bug fix for bug introduced in 1.57: it might eat your data
if you are not using filter. This one was hard do find...

---

Revision 223 - Directory Listing
Modified Sun Feb 8 15:49:44 2004 UTC (19 years, 9 months ago) by dpavlin

fix

---

Revision 222 - Directory Listing
Modified Sun Feb 8 15:44:28 2004 UTC (19 years, 9 months ago) by dpavlin

Documentation describing usage of lookups

---

Revision 221 - Directory Listing
Modified Sun Feb 8 15:15:54 2004 UTC (19 years, 9 months ago) by dpavlin

links using format

---

Revision 220 - Directory Listing
Modified Thu Feb 5 11:04:03 2004 UTC (19 years, 9 months ago) by dpavlin

Important note about SQLite and dbi_user settings (in nutshell: leave them
blank)

---

Revision 219 - Directory Listing
Modified Thu Feb 5 10:56:55 2004 UTC (19 years, 9 months ago) by dpavlin

Display total and unique count when dumping index data to tables

---

Revision 218 - Directory Listing
Modified Thu Feb 5 10:55:58 2004 UTC (19 years, 9 months ago) by dpavlin

Changed never userd format configuration option for import_xml to
marc_format to prevent clash with format for output. If you don't
specify it (as I never do) it will default to 'usmarc' which is probably
the right thing (tm).

---

Revision 217 - Directory Listing
Modified Sun Feb 1 23:28:27 2004 UTC (19 years, 10 months ago) by dpavlin

bugfix and improvements:
- debug and quiet switches
- skip fields which are too short (just subfield without data)
- calculate directory address
- calculate base address in leader

---

Revision 216 - Directory Listing
Modified Sun Feb 1 22:18:05 2004 UTC (19 years, 10 months ago) by dpavlin

insert empty indicators -- that required to rebuild directory, so
I'm also doing some sanity checks (on which programs that import
MARC files might fail later)

---

Revision 215 - Directory Listing
Modified Sun Feb 1 22:06:00 2004 UTC (19 years, 10 months ago) by dpavlin

brown-bag bug: I was using MARC.pm wrong: now whole file will be loaded
at start of indexing, changing memory usage to much more step-like, but
that enables real progress indicator and few seconds gain in indexing
speed.

---

Revision 210 - Directory Listing
Modified Sun Feb 1 20:37:33 2004 UTC (19 years, 10 months ago) by dpavlin

more verbose output

---

Revision 209 - Directory Listing
Modified Sun Feb 1 20:35:59 2004 UTC (19 years, 10 months ago) by dpavlin

I was using MARC.pm wrong. It duplicated records in output

---

Revision 208 - Directory Listing
Modified Sun Feb 1 15:57:17 2004 UTC (19 years, 10 months ago) by dpavlin

Script which will read PhpMyLibrary (http://phpmylibrary.sourceforge.net/)
database and dump MARC file for import in webpac

---

Revision 207 - Directory Listing
Modified Sat Jan 31 21:03:06 2004 UTC (19 years, 10 months ago) by dpavlin

thesaurus is finally working... It contains recursive entries to parnet
term, and we actually needed to display narrower terms, so mem_lookup was
created. Important changes:
- you can write eval{"901a" eq "Mikrotezaurus"} within <isis>
  tag and if expression evaluates to false, no content will be outputed
  (It's used to hide microtesarus terms from lover level descriptors)
- mem_lookup.pm now supports formats: you can write something like
  [a:5614];;[d:[a:5614]] and it will correctly embed values

---

Revision 206 - Directory Listing
Modified Sat Jan 31 20:57:48 2004 UTC (19 years, 10 months ago) by dpavlin

at close vacuum database if using PostgreSQL or SQLite

---

Revision 205 - Directory Listing
Modified Sun Jan 18 21:11:39 2004 UTC (19 years, 10 months ago) by dpavlin

support for unrolling thesaurus entries which have data only about parent
term, so that we can display child terms for each entry

---

Revision 204 - Directory Listing
Modified Sun Jan 18 16:24:41 2004 UTC (19 years, 10 months ago) by dpavlin

updated according to specification

---

Revision 203 - Directory Listing
Modified Sun Jan 18 16:23:56 2004 UTC (19 years, 10 months ago) by dpavlin

grammar fix

---

Revision 202 - Directory Listing
Modified Sun Jan 18 16:23:03 2004 UTC (19 years, 10 months ago) by dpavlin

implemented sort=1 variable to sort results by headline

---

Revision 201 - Directory Listing
Modified Sat Jan 17 14:00:26 2004 UTC (19 years, 10 months ago) by dpavlin

changed behaviour when searching index and no entry beginning with string is
found: until now, it found first substring, and now it find substring from
beginning of word (it has to have space before it)

---

Revision 200 - Directory Listing
Modified Sun Jan 11 21:06:42 2004 UTC (19 years, 10 months ago) by dpavlin

Added missing changes to template for index results

---

Revision 199 - Directory Listing
Modified Wed Jan 7 12:29:11 2004 UTC (19 years, 10 months ago) by dpavlin

fixed filter delimiter bug

---

Revision 198 - Directory Listing
Modified Sun Dec 21 06:35:43 2003 UTC (19 years, 11 months ago) by dpavlin

Implement different interfaces to webpac (for books, articles etc, or in
different languages) easily: just add base_path with relative or
absolute URL to root of your webpac and you can then create multiple
aliases (using Alias directive in httpd.conf) which have same beginning
as base_path. Everything added after base_path will be added after filename
for templates, but before extension. Easy, eh?

---

Revision 197 - Directory Listing
Modified Sun Dec 21 03:27:02 2003 UTC (19 years, 11 months ago) by dpavlin

Changed behaviour of creating data for swish_exact when using type="index".
Now every line is separate entry in swish_exact. That will create additional
clutter in index (fields which wouldn't be used because we are not insering
them in index), but you will have to bare with this for now.

---

Revision 196 - Directory Listing
Modified Mon Dec 15 00:12:16 2003 UTC (19 years, 11 months ago) by dpavlin

correct support for swish_exact when there are repeatable fields

---

Revision 195 - Directory Listing
Modified Sun Dec 14 20:50:03 2003 UTC (19 years, 11 months ago) by dpavlin

don't repeat field name if same as last, support format_name and
format_delimiter on field level if using iterate_by_page (without this, it's
really hard to get useful formating when using iterate_by_page), don't warn
on rare occasion (which is faulty import_xml definition, but anyway...) when
using append="1"

---

Revision 193 - Directory Listing
Modified Thu Dec 11 18:42:40 2003 UTC (19 years, 11 months ago) by dpavlin

closer to specification

---

Revision 192 - Directory Listing
Modified Thu Dec 11 18:00:57 2003 UTC (19 years, 11 months ago) by dpavlin

use locale (important for sorting)

---

Revision 191 - Directory Listing
Modified Sat Nov 29 20:11:07 2003 UTC (20 years ago) by dpavlin

dump content of gdbm file

---

Revision 190 - Directory Listing
Modified Sat Nov 29 19:11:23 2003 UTC (20 years ago) by dpavlin

exact matches can now specify to include (or not) wildcard at end. Added
also documentation about exact matching using swish-e

---

Revision 189 - Directory Listing
Modified Sat Nov 29 19:07:29 2003 UTC (20 years ago) by dpavlin

local changes specific to hida

---

Revision 188 - Directory Listing
Modified Sat Nov 29 19:07:00 2003 UTC (20 years ago) by dpavlin

implemented index_delimiter which enables to to format index entries in format
(values to be inserted in index);;(values to be displayed) if there is
definition of index_delimiter=";;". This will allow you to index (and
search) through values from original database and still have ability to
display lookup fields.

---

Revision 187 - Directory Listing
Modified Sat Nov 29 18:58:34 2003 UTC (20 years ago) by dpavlin

support for subfields in fields 10/11

---

Revision 186 - Directory Listing
Modified Sat Nov 29 18:40:19 2003 UTC (20 years ago) by dpavlin

transfer swish_exact flash in form also, not only in URL

---

Revision 185 - Directory Listing
Modified Sat Nov 29 18:38:02 2003 UTC (20 years ago) by dpavlin

moved documentation in doc directory

---

Revision 183 - Directory Listing
Modified Sat Nov 29 17:51:12 2003 UTC (20 years ago) by dpavlin

fix for swish_exact

---

Revision 182 - Directory Listing
Modified Sat Nov 29 15:59:19 2003 UTC (20 years ago) by dpavlin

make index with lookup field working with iterate on page

---

Revision 181 - Directory Listing
Modified Tue Nov 25 20:19:03 2003 UTC (20 years ago) by dpavlin

fix swish_exact fields so that they don't show up in display

---

Revision 180 - Directory Listing
Modified Tue Nov 25 20:04:24 2003 UTC (20 years ago) by dpavlin

invalidate memory cache when needed

---

Revision 179 - Directory Listing
Modified Tue Nov 25 18:28:42 2003 UTC (20 years ago) by dpavlin

script which will create log of webpac memory and processor usage

---

Revision 178 - Directory Listing
Modified Mon Nov 24 21:54:19 2003 UTC (20 years ago) by dpavlin

major improvements: you can select order of scanning in each topic tag
to be eather by line (which is default, repeatable fields in one line will
be unrolled) or page-by-page (using new interate_by_page="1" attribute).
New page-by-page mode is really useful with lookups (because you can
append fields with lookups in same line, but using two tags), but it will
create multiple rows in html output.

---

Revision 177 - Directory Listing
Modified Mon Nov 24 01:19:15 2003 UTC (20 years ago) by dpavlin

support for lookup fields. Implemented using GDBM or TDB (which I recommend
because it's fastest implementation)

---

Revision 176 - Directory Listing
Modified Mon Nov 24 01:16:04 2003 UTC (20 years ago) by dpavlin

fix for wierd prefixes (consisting of chars and numbers)

---

Revision 175 - Directory Listing
Modified Sun Nov 23 17:33:59 2003 UTC (20 years ago) by dpavlin

fix path

---

Revision 174 - Directory Listing
Modified Sun Nov 23 17:13:53 2003 UTC (20 years ago) by dpavlin

radio buttons for exact search

---

Revision 173 - Directory Listing
Modified Sun Nov 23 17:05:26 2003 UTC (20 years ago) by dpavlin

removed fixed width

---

Revision 172 - Directory Listing
Modified Sun Nov 23 17:04:34 2003 UTC (20 years ago) by dpavlin

profiling tests of cacheing of formats: improvements are close to 50%. Not
bad for one evening of hacking...

---

Revision 171 - Directory Listing
Modified Sun Nov 23 16:45:39 2003 UTC (20 years ago) by dpavlin

configuration option for unac_filter

---

Revision 170 - Directory Listing
Modified Sun Nov 23 15:42:16 2003 UTC (20 years ago) by dpavlin

Re-wrote parsing for ISO-type data (isis, marc) to use in-memory cache of
format... 10% speed improvement and cleaner code. Include filter functions
just once.

---

Revision 169 - Directory Listing
Modified Sun Nov 23 15:39:23 2003 UTC (20 years ago) by dpavlin

die with message if no field name is specified

---

Revision 168 - Directory Listing
Modified Sun Nov 23 15:37:43 2003 UTC (20 years ago) by dpavlin

added years filter for swish to support 1983- notation

---

Revision 167 - Directory Listing
Modified Sun Nov 23 15:36:12 2003 UTC (20 years ago) by dpavlin

add prototype

---

Revision 166 - Directory Listing
Modified Sun Nov 23 15:06:54 2003 UTC (20 years ago) by dpavlin

added TODO for HIDRA

---

Revision 165 - Directory Listing
Modified Sun Nov 23 15:06:29 2003 UTC (20 years ago) by dpavlin

renamed files from HIDRA to contain _hidra_ in filename

---

Revision 164 - Directory Listing
Modified Sat Nov 22 22:04:05 2003 UTC (20 years ago) by dpavlin

implemented filter which can replace (or be used together with) unac_string
from Text::Unaccent

---

Revision 163 - Directory Listing
Modified Thu Nov 20 21:23:40 2003 UTC (20 years ago) by dpavlin

Added type="swish_exact" to save data into swish index with boundaries
xxbxx data xxexxx. This is helpful to implement exact match from beginning
of query and exact match to full query which are defined using e[nr] field
in web user interface (with same [nr] as f[nr] and v[nr] fields) which
have to have value 1 (from beginning) 2 (from end, not that useful...) or
3 (1+2 - exact match)

---

Revision 162 - Directory Listing
Modified Thu Nov 20 21:20:57 2003 UTC (20 years ago) by dpavlin

added profile target

---

Revision 161 - Directory Listing
Modified Thu Nov 20 19:33:00 2003 UTC (20 years ago) by dpavlin

write nice (?) message indicating that there are no results for this query

---

Revision 160 - Directory Listing
Modified Tue Nov 18 19:56:51 2003 UTC (20 years ago) by dpavlin

fix

---

Revision 159 - Directory Listing
Modified Tue Nov 18 19:44:38 2003 UTC (20 years ago) by dpavlin

removed name of library (to produce generic template)

---

Revision 158 - Directory Listing
Modified Mon Nov 17 21:18:37 2003 UTC (20 years ago) by dpavlin

fixed transfer of variables with multiple values in headline

---

Revision 157 - Directory Listing
Modified Mon Nov 17 20:53:03 2003 UTC (20 years ago) by dpavlin

small fix

---

Revision 156 - Directory Listing
Modified Mon Nov 17 20:46:18 2003 UTC (20 years ago) by dpavlin

added template example (which include do_checkbox JavaScript)
added select all/none/toggle at results page (usage of do_checkbox.js)

---

Revision 155 - Directory Listing
Modified Mon Nov 17 20:12:47 2003 UTC (20 years ago) by dpavlin

improvements

---

Revision 154 - Directory Listing
Modified Mon Nov 17 10:31:29 2003 UTC (20 years ago) by dpavlin

another example of import xml file for ISIS. This one features links
(using format)

---

Revision 153 - Directory Listing
Modified Sun Nov 16 22:42:41 2003 UTC (20 years ago) by dpavlin

implemented formats which can be used to produce links between records
in WebPac (documented in README.links)

---

Revision 152 - Directory Listing
Modified Sun Nov 16 22:40:04 2003 UTC (20 years ago) by dpavlin

new languages

---

Revision 151 - Directory Listing
Modified Sun Nov 16 22:39:36 2003 UTC (20 years ago) by dpavlin

keep <a href>

---

Revision 150 - Directory Listing
Modified Sun Nov 16 22:39:06 2003 UTC (20 years ago) by dpavlin

support for "f" and "v" fields without number on which wildcards don't apply

---

Revision 149 - Directory Listing
Modified Sun Nov 16 16:57:11 2003 UTC (20 years ago) by dpavlin

display full record without path specified (used for linking)

---

Revision 148 - Directory Listing
Modified Sun Nov 16 16:16:28 2003 UTC (20 years ago) by dpavlin

master template example

---

Revision 147 - Directory Listing
Modified Sun Nov 16 16:14:37 2003 UTC (20 years ago) by dpavlin

Implementation of master template: just create template html file in
public_html and insert ##webpac## where you want output of webpac.
Then define template to full path to that template, and you are ready to go.

---

Revision 146 - Directory Listing
Modified Sun Nov 16 13:20:14 2003 UTC (20 years ago) by dpavlin

convert more than one URL to correct html link

---

Revision 145 - Directory Listing
Modified Sun Nov 16 12:35:21 2003 UTC (20 years ago) by dpavlin

added more languages

---

Revision 144 - Directory Listing
Modified Sun Nov 16 11:55:18 2003 UTC (20 years ago) by dpavlin

fixed filters (again)

---

Revision 143 - Directory Listing
Modified Thu Nov 6 21:35:17 2003 UTC (20 years ago) by dpavlin

added two missing characters (and still missing one)

---

Revision 142 - Directory Listing
Modified Thu Oct 30 01:02:22 2003 UTC (20 years, 1 month ago) by dpavlin

if no entries found, count should return number of all entries

---

Revision 141 - Directory Listing
Modified Thu Oct 30 00:49:43 2003 UTC (20 years, 1 month ago) by dpavlin

another alternative encoding for Crolist. How many does it have?

---

Revision 140 - Directory Listing
Modified Thu Oct 30 00:10:09 2003 UTC (20 years, 1 month ago) by dpavlin

fix for total number of entries from index if using filter, renamed
check function to count and added limit

---

Revision 139 - Directory Listing
Modified Wed Oct 29 23:19:58 2003 UTC (20 years, 1 month ago) by dpavlin

removed unneeded delimiter parametar

---

Revision 138 - Directory Listing
Modified Wed Oct 29 23:10:51 2003 UTC (20 years, 1 month ago) by dpavlin

Aargh! I should really go to sleep or make PostgeSQL replication or something...

---

Revision 137 - Directory Listing
Modified Wed Oct 29 22:57:43 2003 UTC (20 years, 1 month ago) by dpavlin

I removed too much: this always added delimiter before first element

---

Revision 136 - Directory Listing
Modified Wed Oct 29 22:46:49 2003 UTC (20 years, 1 month ago) by dpavlin

another fix for repeatable fields

---

Revision 135 - Directory Listing
Modified Wed Oct 29 21:27:00 2003 UTC (20 years, 1 month ago) by dpavlin

fix repeatable fields in index data

---

Revision 134 - Directory Listing
Modified Tue Oct 28 10:19:02 2003 UTC (20 years, 1 month ago) by dpavlin

more tasks

---

Revision 133 - Directory Listing
Modified Thu Oct 9 11:24:19 2003 UTC (20 years, 1 month ago) by dpavlin

added note about SQLite performance, example in global.conf

---

Revision 132 - Directory Listing
Modified Thu Oct 9 10:22:35 2003 UTC (20 years, 1 month ago) by dpavlin

better documentation, allmost useful :-)

---

Revision 131 - Directory Listing
Modified Wed Oct 8 22:05:00 2003 UTC (20 years, 1 month ago) by dpavlin

Crolist CROASCII

---

Revision 130 - Directory Listing
Modified Wed Oct 8 21:26:13 2003 UTC (20 years, 1 month ago) by dpavlin

filter to import Crolist data in CROASCII code-page

---

Revision 129 - Directory Listing
Modified Wed Oct 8 21:25:47 2003 UTC (20 years, 1 month ago) by dpavlin

documentation about MARC import

---

Revision 128 - Directory Listing
Modified Thu Sep 4 14:57:02 2003 UTC (20 years, 3 months ago) by dpavlin

use index_DBI_cache.pm (non-cache version is depriciated)

---

Revision 127 - Directory Listing
Modified Thu Sep 4 14:56:41 2003 UTC (20 years, 3 months ago) by dpavlin

if searched word is not found when searching from beginning of index, try
to find in anywhere (substring match)

---

Revision 126 - Directory Listing
Modified Thu Sep 4 13:47:36 2003 UTC (20 years, 3 months ago) by dpavlin

added links from result headline to details, CSS style to make headline links
and links in index non-underlined

---

Revision 125 - Directory Listing
Modified Thu Sep 4 10:51:19 2003 UTC (20 years, 3 months ago) by dpavlin

fixed whitespace

---

Revision 124 - Directory Listing
Modified Wed Sep 3 23:07:21 2003 UTC (20 years, 3 months ago) by dpavlin

links from index back to search

---

Revision 123 - Directory Listing
Modified Wed Sep 3 20:08:57 2003 UTC (20 years, 3 months ago) by dpavlin

(not working) links from index to search

---

Revision 122 - Directory Listing
Modified Wed Sep 3 20:08:26 2003 UTC (20 years, 3 months ago) by dpavlin

don't add wildcards only to full words and, or, not (part of swish-e quiery
language)

---

Revision 121 - Directory Listing
Modified Tue Sep 2 21:31:54 2003 UTC (20 years, 3 months ago) by dpavlin

don't report error if user didn't selected any result and clicked on
details. However, there is still bug: it will reset pager to first page.
I will have to re-write pager without JavaScript to fix this.

---

Revision 120 - Directory Listing
Modified Tue Sep 2 13:24:33 2003 UTC (20 years, 3 months ago) by dpavlin

added minimum numbers of characters for wildcard * to kick in for swish

---

Revision 119 - Directory Listing
Modified Tue Sep 2 11:46:58 2003 UTC (20 years, 3 months ago) by dpavlin

fixes

---

Revision 118 - Directory Listing
Modified Tue Sep 2 11:45:47 2003 UTC (20 years, 3 months ago) by dpavlin

use latest dump from psinib backup

---

Revision 117 - Directory Listing
Modified Mon Jul 21 16:05:42 2003 UTC (20 years, 4 months ago) by dpavlin

use select query and not \d

---

Revision 116 - Directory Listing
Modified Mon Jul 21 15:54:57 2003 UTC (20 years, 4 months ago) by dpavlin

you can specify database name

---

Revision 115 - Directory Listing
Modified Wed Jul 16 15:54:38 2003 UTC (20 years, 4 months ago) by dpavlin

additional button on bottom of results

---

Revision 114 - Directory Listing
Modified Wed Jul 16 15:49:56 2003 UTC (20 years, 4 months ago) by dpavlin

don't generate all html for headline results, lot of html fixes

---

Revision 113 - Directory Listing
Modified Wed Jul 16 10:08:11 2003 UTC (20 years, 4 months ago) by dpavlin

improvements

---

Revision 112 - Directory Listing
Modified Tue Jul 15 15:07:42 2003 UTC (20 years, 4 months ago) by dpavlin

fix: dynamicly create perasistent variables

---

Revision 111 - Directory Listing
Modified Tue Jul 15 12:48:49 2003 UTC (20 years, 4 months ago) by dpavlin

fix pager bug when you have selected items

---

Revision 110 - Directory Listing
Modified Tue Jul 15 12:46:43 2003 UTC (20 years, 4 months ago) by dpavlin

fix

---

Revision 109 - Directory Listing
Modified Mon Jul 14 18:50:39 2003 UTC (20 years, 4 months ago) by dpavlin

erase also *.PTR files

---

Revision 108 - Directory Listing
Modified Mon Jul 14 18:20:27 2003 UTC (20 years, 4 months ago) by dpavlin

Overcome limit of 32 open databases. Unfortunatly, OpenIsis in current
version (0.9.0) doesn't support close call, so you need patch from:
https://www.rot13.org/~dpavlin/projects/openisis-0.9.0-perl_close.diff

---

Revision 107 - Directory Listing
Modified Mon Jul 14 17:34:45 2003 UTC (20 years, 4 months ago) by dpavlin

dump isis records using OpenIsis...

---

Revision 106 - Directory Listing
Modified Mon Jul 14 17:09:36 2003 UTC (20 years, 4 months ago) by dpavlin

check for bogus *.TXT databases (with zero length or 0 records) and
erase them to force OpenIsis to use binary files

---

Revision 105 - Directory Listing
Modified Mon Jul 14 17:08:37 2003 UTC (20 years, 4 months ago) by dpavlin

renamed get_sf to (isis|marc)_sf to avoid warning abouts re-definining of
function

---

Revision 104 - Directory Listing
Modified Mon Jul 14 10:55:35 2003 UTC (20 years, 4 months ago) by dpavlin

remove fake progress bar also

---

Revision 103 - Directory Listing
Modified Mon Jul 14 10:53:10 2003 UTC (20 years, 4 months ago) by dpavlin

new option show_progress for progress bar indicator

---

Revision 102 - Directory Listing
Modified Mon Jul 14 10:54:34 2003 UTC (20 years, 4 months ago) by dpavlin

removed debugging

---

Revision 101 - Directory Listing
Modified Mon Jul 14 10:52:13 2003 UTC (20 years, 4 months ago) by dpavlin

- better error reporing from OpenIsis
- added show_progress in global.conf to turn off progress bar

---

Revision 100 - Directory Listing
Modified Mon Jul 14 10:34:00 2003 UTC (20 years, 4 months ago) by dpavlin

filter to join shelf numbers in one field for index

---

Revision 99 - Directory Listing
Modified Sun Jul 13 22:29:49 2003 UTC (20 years, 4 months ago) by dpavlin

added filter

---

Revision 98 - Directory Listing
Modified Sun Jul 13 22:29:14 2003 UTC (20 years, 4 months ago) by dpavlin

fixed ordering

---

Revision 97 - Directory Listing
Modified Sun Jul 13 21:57:12 2003 UTC (20 years, 4 months ago) by dpavlin

ability to join repeatable fields before inseting into index

---

Revision 96 - Directory Listing
Modified Sun Jul 13 21:55:32 2003 UTC (20 years, 4 months ago) by dpavlin

speedup

---

Revision 95 - Directory Listing
Modified Sun Jul 13 21:54:22 2003 UTC (20 years, 4 months ago) by dpavlin

fix: first index entry should have nr. 1 not 0

---

Revision 94 - Directory Listing
Modified Sun Jul 13 19:30:28 2003 UTC (20 years, 4 months ago) by dpavlin

re-wrote module to use in-memory sorting

---

Revision 93 - Directory Listing
Modified Sun Jul 13 14:44:03 2003 UTC (20 years, 4 months ago) by dpavlin

fix OpenIsis 0.9.0 perl bug

---

Revision 92 - Directory Listing
Modified Sun Jul 13 13:42:17 2003 UTC (20 years, 4 months ago) by dpavlin

repeatable fields in feeds are currently not supported

---

Revision 91 - Directory Listing
Modified Sun Jul 13 13:23:17 2003 UTC (20 years, 4 months ago) by dpavlin

make this version called webpac-dev

---

Revision 90 - Directory Listing
Modified Sun Jul 13 13:22:50 2003 UTC (20 years, 4 months ago) by dpavlin

repeatable fields (broken when other input formats where introduced) work
again

---

Revision 89 - Directory Listing
Modified Sun Jul 13 12:24:06 2003 UTC (20 years, 4 months ago) by dpavlin

count number of entries in tables (one for each index)

---

Revision 88 - Directory Listing
Modified Sat Jul 12 16:02:15 2003 UTC (20 years, 4 months ago) by dpavlin

print timings of last operation

---

Revision 87 - Directory Listing
Modified Fri Jul 11 20:58:45 2003 UTC (20 years, 4 months ago) by dpavlin

print datestamp before starting sort (for benchmarking)

---

Revision 86 - Directory Listing
Modified Fri Jul 11 20:58:06 2003 UTC (20 years, 4 months ago) by dpavlin

run wget only weekly

---

Revision 85 - Directory Listing
Modified Fri Jul 11 20:15:01 2003 UTC (20 years, 4 months ago) by dpavlin

various changes on the way to production

---

Revision 84 - Directory Listing
Modified Fri Jul 11 20:14:45 2003 UTC (20 years, 4 months ago) by dpavlin

print mfn

---

Revision 83 - Directory Listing
Modified Fri Jul 11 20:14:19 2003 UTC (20 years, 4 months ago) by dpavlin

don't die if unable to insert into index, instead just warn

---

Revision 82 - Directory Listing
Modified Fri Jul 11 20:12:23 2003 UTC (20 years, 4 months ago) by dpavlin

added missing xml, needed for production site

---

Revision 81 - Directory Listing
Modified Tue Jul 8 22:13:56 2003 UTC (20 years, 4 months ago) by dpavlin

the great rename: isis2xml.* -> all2xml.*

---

Revision 80 - Directory Listing
Modified Tue Jul 8 08:24:13 2003 UTC (20 years, 4 months ago) by dpavlin

fixed bugs with < and > in headline

---

Revision 79 - Directory Listing
Modified Sun Jul 6 13:03:35 2003 UTC (20 years, 4 months ago) by dpavlin

remove extra spaces

---

Revision 78 - Directory Listing
Modified Sat Jul 5 23:39:04 2003 UTC (20 years, 5 months ago) by dpavlin

fix character conversion

---

Revision 77 - Directory Listing
Modified Sat Jul 5 23:38:08 2003 UTC (20 years, 5 months ago) by dpavlin

fix for data without details

---

Revision 76 - Directory Listing
Modified Sat Jul 5 23:07:47 2003 UTC (20 years, 5 months ago) by dpavlin

move configuration options in global.conf

---

Revision 75 - Directory Listing
Modified Sat Jul 5 22:37:44 2003 UTC (20 years, 5 months ago) by dpavlin

misc fixes and improvements

---

Revision 74 - Directory Listing
Modified Sat Jul 5 22:37:30 2003 UTC (20 years, 5 months ago) by dpavlin

support for new feed format which have decimal number of field, semicolumn
and space at beginning of each line (like: 0: data)

---

Revision 73 - Directory Listing
Modified Sat Jul 5 22:31:46 2003 UTC (20 years, 5 months ago) by dpavlin

- support multi-value fields (e.g. for checkboxes)
- remove accented characters before feeding swish

---

Revision 72 - Directory Listing
Modified Sat Jul 5 22:03:21 2003 UTC (20 years, 5 months ago) by dpavlin

fixed warning

---

Revision 71 - Directory Listing
Modified Sat Jul 5 21:35:44 2003 UTC (20 years, 5 months ago) by dpavlin

more fields and slight speedup

---

Revision 70 - Directory Listing
Modified Sat Jul 5 18:26:40 2003 UTC (20 years, 5 months ago) by dpavlin

new and much detailed ScienceDirect robot that uses SD CSV files to find
details about publications (ISSN, categorisation etc.)

---

Revision 69 - Directory Listing
Modified Sat Jul 5 12:34:08 2003 UTC (20 years, 5 months ago) by dpavlin

ignore temp files

---

Revision 68 - Directory Listing
Modified Fri Jul 4 23:30:47 2003 UTC (20 years, 5 months ago) by dpavlin

misc other changes

---

Revision 67 - Directory Listing
Modified Fri Jul 4 23:29:27 2003 UTC (20 years, 5 months ago) by dpavlin

implemented feed method which calls external program that returns
data line-by-line

---

Revision 66 - Directory Listing
Modified Fri Jul 4 23:28:17 2003 UTC (20 years, 5 months ago) by dpavlin

chop URLS longer than 60 characters

---

Revision 65 - Directory Listing
Modified Fri Jul 4 21:35:34 2003 UTC (20 years, 5 months ago) by dpavlin

make a URL of any URL embeded in text

---

Revision 64 - Directory Listing
Modified Fri Jul 4 20:41:17 2003 UTC (20 years, 5 months ago) by dpavlin

create http links

---

Revision 63 - Directory Listing
Modified Fri Jul 4 20:37:04 2003 UTC (20 years, 5 months ago) by dpavlin

removed maximum number of results

---

Revision 62 - Directory Listing
Modified Fri Jul 4 20:11:48 2003 UTC (20 years, 5 months ago) by dpavlin

added MARC file import

---

Revision 61 - Directory Listing
Modified Fri Jul 4 19:37:32 2003 UTC (20 years, 5 months ago) by dpavlin

unsorted perl tools and snippets

---

Revision 60 - Directory Listing
Modified Fri Jul 4 18:23:00 2003 UTC (20 years, 5 months ago) by dpavlin

uses memory as cache

---

Revision 59 - Directory Listing
Modified Fri Jul 4 17:57:11 2003 UTC (20 years, 5 months ago) by dpavlin

added config tag which can read any variable from isis2xml.conf file for
that library

---

Revision 58 - Directory Listing
Modified Fri Jul 4 16:56:40 2003 UTC (20 years, 5 months ago) by dpavlin

support type and sub-types (in form type_subtype)

---

Revision 57 - Directory Listing
Modified Fri Jul 4 15:05:23 2003 UTC (20 years, 5 months ago) by dpavlin

don't choke on input which iconv can't convert

---

Revision 56 - Directory Listing
Modified Wed Jun 25 12:09:27 2003 UTC (20 years, 5 months ago) by dpavlin

use start_row from excel.xml

---

Revision 55 - Directory Listing
Modified Wed Jun 25 12:01:21 2003 UTC (20 years, 5 months ago) by dpavlin

new config

---

Revision 54 - Directory Listing
Modified Mon Jun 23 20:20:32 2003 UTC (20 years, 5 months ago) by dpavlin

added Microsoft Excel file import

---

Revision 53 - Directory Listing
Modified Sun Jun 1 18:49:49 2003 UTC (20 years, 6 months ago) by dpavlin

moved configuration (database part) to global.conf, added
and, or and not operators

---

Revision 52 - Directory Listing
Modified Sun Jun 1 18:48:55 2003 UTC (20 years, 6 months ago) by dpavlin

improved

---

Revision 51 - Directory Listing
Modified Sun Jun 1 15:33:08 2003 UTC (20 years, 6 months ago) by dpavlin

display details and back doesn't reset page to 1

---

Revision 50 - Directory Listing
Modified Sun Jun 1 13:46:42 2003 UTC (20 years, 6 months ago) by dpavlin

move database arguments to .conf file

---

Revision 49 - Directory Listing
Modified Sun Jun 1 13:45:36 2003 UTC (20 years, 6 months ago) by dpavlin

beginning of installation instructions

---

Revision 48 - Directory Listing
Modified Sun Mar 30 10:00:45 2003 UTC (20 years, 8 months ago) by dpavlin

don't save indexes in CVS

---

Revision 47 - Directory Listing
Modified Sun Mar 23 01:17:49 2003 UTC (20 years, 8 months ago) by dpavlin

show just hits or all details buttons on result page

---

Revision 46 - Directory Listing
Modified Sun Mar 23 01:14:59 2003 UTC (20 years, 8 months ago) by dpavlin

speed-up

---

Revision 45 - Directory Listing
Modified Sat Mar 22 23:40:14 2003 UTC (20 years, 8 months ago) by dpavlin

speedups using profiling

---

Revision 44 - Directory Listing
Modified Sat Mar 22 22:51:48 2003 UTC (20 years, 8 months ago) by dpavlin

fix

---

Revision 43 - Directory Listing
Modified Sat Mar 22 22:43:05 2003 UTC (20 years, 8 months ago) by dpavlin

fixed alphabet soup -- characters encoding should really work now!

---

Revision 42 - Directory Listing
Modified Sat Mar 15 21:48:48 2003 UTC (20 years, 8 months ago) by dpavlin

filter fix && optimisation

---

Revision 41 - Directory Listing
Modified Sat Mar 15 21:34:36 2003 UTC (20 years, 8 months ago) by dpavlin

decode output from swish

---

Revision 40 - Directory Listing
Modified Sat Mar 15 21:33:36 2003 UTC (20 years, 8 months ago) by dpavlin

major de-mungling of different codepages: use same codepage inside perl
(as opposed to UTF-8) and in files on disk

---

Revision 39 - Directory Listing
Modified Sat Mar 15 20:07:17 2003 UTC (20 years, 8 months ago) by dpavlin

moved to import_xml folder

---

Revision 38 - Directory Listing
Modified Sat Mar 15 19:37:28 2003 UTC (20 years, 8 months ago) by dpavlin

typo fix

---

Revision 37 - Directory Listing
Modified Sat Mar 15 19:37:07 2003 UTC (20 years, 8 months ago) by dpavlin

escape only entities which are dangerous to html

---

Revision 36 - Directory Listing
Modified Sat Mar 15 19:16:31 2003 UTC (20 years, 8 months ago) by dpavlin

small program to test codepage which OpenIsis returns

---

Revision 35 - Directory Listing
Modified Sun Feb 23 15:47:40 2003 UTC (20 years, 9 months ago) by dpavlin

last changes; completly broken charsets

---

Revision 34 - Directory Listing
Modified Sun Feb 23 08:06:07 2003 UTC (20 years, 9 months ago) by dpavlin

append="1" fix

---

Revision 33 - Directory Listing
Modified Sun Feb 23 07:53:28 2003 UTC (20 years, 9 months ago) by dpavlin

script to install modules from CPAN needed for WebPac

---

Revision 32 - Directory Listing
Modified Sun Feb 23 07:53:01 2003 UTC (20 years, 9 months ago) by dpavlin

display fields using order="" attribute

---

Revision 31 - Directory Listing
Modified Sun Feb 23 07:11:18 2003 UTC (20 years, 9 months ago) by dpavlin

oh, well... serves me good for commiting without testing first -- even
one-line changes

---

Revision 30 - Directory Listing
Modified Sun Feb 23 07:09:11 2003 UTC (20 years, 9 months ago) by dpavlin

misc updates

---

Revision 29 - Directory Listing
Modified Sun Feb 23 07:08:54 2003 UTC (20 years, 9 months ago) by dpavlin

repeatable field support, filter functions added, broken charset (again!)

---

Revision 28 - Directory Listing
Modified Sun Feb 23 07:07:33 2003 UTC (20 years, 9 months ago) by dpavlin

crop data fields to 255 chars, support for case-insesitive sort

---

Revision 27 - Directory Listing
Modified Sun Feb 23 07:04:36 2003 UTC (20 years, 9 months ago) by dpavlin

support for <br>

---

Revision 26 - Directory Listing
Modified Sun Feb 23 07:02:55 2003 UTC (20 years, 9 months ago) by dpavlin

new filters

---

Revision 25 - Directory Listing
Modified Sun Feb 23 06:57:43 2003 UTC (20 years, 9 months ago) by dpavlin

new fields definitions based on BiblioXML (from http://www.culture.fr/BiblioML/)
but really it's just so that we don't have to re-invent field names.

---

Revision 24 - Directory Listing
Modified Sun Feb 23 06:55:00 2003 UTC (20 years, 9 months ago) by dpavlin

more docs

---

Revision 23 - Directory Listing
Modified Sun Feb 23 06:50:55 2003 UTC (20 years, 9 months ago) by dpavlin

fixed parser, added support for 'mfn' field

---

Revision 22 - Directory Listing
Modified Sun Feb 23 00:01:08 2003 UTC (20 years, 9 months ago) by dpavlin

*** empty log message ***

---

Revision 21 - Directory Listing
Modified Sun Feb 23 00:00:51 2003 UTC (20 years, 9 months ago) by dpavlin

fix

---

Revision 20 - Directory Listing
Modified Sat Feb 22 23:49:22 2003 UTC (20 years, 9 months ago) by dpavlin

add filter="name" for fields (to correct strane input data or make variations
for indexing)

---

Revision 19 - Directory Listing
Modified Sat Feb 22 23:47:15 2003 UTC (20 years, 9 months ago) by dpavlin

re-arange transactions so that drop/create table work

---

Revision 18 - Directory Listing
Modified Sat Feb 22 21:37:25 2003 UTC (20 years, 9 months ago) by dpavlin

make drop/create table actually work

---

Revision 17 - Directory Listing
Modified Sat Feb 22 21:33:04 2003 UTC (20 years, 9 months ago) by dpavlin

fix index insertion

---

Revision 16 - Directory Listing
Modified Sat Feb 22 21:21:35 2003 UTC (20 years, 9 months ago) by dpavlin

allows users to enter queries with asterisk (*)

---

Revision 15 - Directory Listing
Modified Sat Feb 22 13:30:00 2003 UTC (20 years, 9 months ago) by dpavlin

this is example how to start indexer

---

Revision 14 - Directory Listing
Modified Sat Feb 22 13:22:09 2003 UTC (20 years, 9 months ago) by dpavlin

use Text::Iconv for conversions

---

Revision 13 - Directory Listing
Modified Sun Feb 16 22:41:37 2003 UTC (20 years, 9 months ago) by dpavlin

added configuration file with database descriptions,
moved isis.xml definition file in separate directory (in preparation for MARK),
support for different encodings in different files,
various fixes, improvements and badly written parts which will change ;-)

---

Revision 12 - Directory Listing
Modified Wed Jan 22 22:27:19 2003 UTC (20 years, 10 months ago) by dpavlin

added pager for lookup in index

---

Revision 11 - Directory Listing
Modified Wed Jan 22 20:24:32 2003 UTC (20 years, 10 months ago) by dpavlin

display index (without pager for now)

---

Revision 10 - Directory Listing
Modified Thu Jan 16 17:35:54 2003 UTC (20 years, 10 months ago) by dpavlin

bunch of changes: make design more modular, implement index (partial
implementation) and other small and big changes

---

Revision 9 - Directory Listing
Modified Sat Jan 11 19:55:30 2003 UTC (20 years, 10 months ago) by dpavlin

renamed "old" index to swish, and introduced index which is -- index;
implemented using PostgreSQL for now.

---

Revision 8 - Directory Listing
Modified Sat Jan 11 17:08:19 2003 UTC (20 years, 10 months ago) by dpavlin

fix detailed search (drop down still isn't working)

---

Revision 7 - Directory Listing
Modified Sat Jan 11 16:44:03 2003 UTC (20 years, 10 months ago) by dpavlin

major modifications to produce first (non-working) version of Web CGI
interface.

---

Revision 6 - Directory Listing
Modified Sat Jan 11 06:15:10 2003 UTC (20 years, 10 months ago) by dpavlin

'make index' will rebuild index

---

Revision 5 - Directory Listing
Modified Sat Jan 11 06:14:48 2003 UTC (20 years, 10 months ago) by dpavlin

require 1.02 version of Text::Unaccent (1.01 can't pass 'make test' here!)

---

Revision 4 - Directory Listing
Modified Sun Dec 1 22:51:29 2002 UTC (21 years ago) by dpavlin

remove subfield definition from values which are displayed and indexed

---

Revision 3 - Directory Listing
Modified Sat Nov 30 00:36:34 2002 UTC (21 years ago) by dpavlin

first really working version -- creates xml file for swish + swish config

---

Revision 1 - Directory Listing
Added Sun Nov 24 20:52:11 2002 UTC (21 years ago) by dpavlin

Initial revision