Sphider Help Forum

Timeout errors are USUALLY 500 or 504 HTTP errors. Since these errors are related to browsers and their connections, I have found that they can be avoided by running the indexing from a command prompt. Now, if you happen to have Sphider installed locally and you are indexing a remote site, this is n...

A BUG! in MY code? Heaven forbid!

Well, to be honest it is possible (because it has happened so many times before).

And considering your report on a "less than 10 words" solution, this is DEFINITELY something I will be looking into.

Thanks for the tip... and the tip-off.

The search finds all results for a query. It displays the top result for each domain found, then indented with the second top result within each domain. Sometimes there is no second. There is no way to modify the code to show more. I think I understand what you are trying to accomplish, which is to ...

When trying to index a NEW (not already in the database) site from the Index tab in 5.4.0, you just get a white screen. This will, of course, be corrected in the next release. In the meantime, however, this can be corrected by editing spider.php, line 844 to read: ."? , ? , ? , ? , ?, ?)" ...

In 5.3.0, you COULD index a new site from the Index tab and Sphider would assign a site id to the new site. 5.4.0 has many improvements, but you just found something that got broken in the update! Now I have something to fix for the next release!!! FIX: spider.php, line 844 should read: ."? , ?...

Your method of using markers is valid. The actual Sphider index function (called on line 214) is located between lines 720-1151. Since this does SEEM like a permissions issue, and you mention "wamp" ... I take it you are using a Windows operating system. If so, confirm that "Windows O...

Did you upgrade or install as new? If installed as new, I suspect a permissions problem. There are several directories within the admin directory: backup, log, reports, sitemaps, and tmp. The system needs read/write access to these directories. Permissions need to be 755 (or 775 to be sure). With Ub...

I think I understand. You can get title and description but no fulltxt OR fulltxt but no title or description. Do keywords get indexed for pages with fulltxt? I would like to see the source code for a page from each type. Example: sport/resultatclub-2023?id=96 and recits/fanfare-et-harmonies.php. DO...

Sphider looks for the actual page content. I would need to see the actual page to determine the issue. If a page consists only of links and/or images and no actual text, it is possible there will be "fewer than 10 words". One way to see for sure is to clear the site, go into settings and c...

Clearing the site, then doing a new index will not harm anything. Only recommendation is that AFTER clearing the site you then run "clean keywords" from the Clean Tables tab. Also "clean temp" if there is any data in there. Cleaning keywords MIGHT take awhile... Also, when a time...