Sphider Help Forum

Even though I broke the site into sections and crawl them separately, sometimes the script times out after around 3K links. When that happens during the initial indexing I can utilize the "Continue Indexing" option but if the script times out during re-indexing there's no way to continue. ...

Yes, the Links table is huge. Take quite some time even when I search directly in the table using phpmyadmin...

I have a large site. I had to break the sphidering process into smaller chunks and am running it for days. Once the site is crawled it is still a very long process to return the results. I was wondering if there's a way to optimize the schema further to improve it's performance.

Great, thanks.

Perhaps the " Minimum word length in order to be indexed" setting should not apply to the "phrase" search type. It could be a part of a name or title.

Perhaps this could be one of the settings.

UPDATE: NM - found your post on Aug 26 and replaced my script with 5.2.1. Seems to be working again. ------------------------------ I had a large site to index, so I broke it down into many sites. It took me 3 days to index and then I had to restart my computer. Now, when I go to admin/admin.php pag...