Tuesday, October 03, 2006

EOD 2006-10-03

Completed the basic XP install. Now I have a clean, up to date XP VM,
with Firefox and Norton IS installed, that I can clone quickly
whenever I need it.

After chatting with Stephen, I rolled back the McGee test source to 21
June 2006, and tested uploading large files. It seems that the
repository compares a new object's mimetype against it's list of
non-searchable mimetypes so as to exclude the processing of it for
words for the search index. The problem is that the repository reads
in all the values in the 'no_search_mimetypes' configuration group,
but ignores the fact that the default value (in advanced.conf) is a
comma separated list, so no mimetypes match - and everything is
indexed, hence the huge wait and chewing of processor.

I've implemented a utility method to read in the values of a
configuration group, and then split each one using a comma as a
separator, and the repository now uses that method at startup.

Also found a bug in George's original code for extracting search index
entries, where it stuck the flag for 'indexable' into one slot, and
tried to pull it out of another.

Tomorrow need to look at the logic for deciding what is indexable, and
what isn't.

No comments: