Sphider Help Forum

The search finds all results for a query. It displays the top result for each domain found, then indented with the second top result within each domain. Sometimes there is no second. There is no way to modify the code to show more. I think I understand what you are trying to accomplish, which is to ...

When trying to index a NEW (not already in the database) site from the Index tab in 5.4.0, you just get a white screen. This will, of course, be corrected in the next release. In the meantime, however, this can be corrected by editing spider.php, line 844 to read: ."? , ? , ? , ? , ?, ?)" ...

In 5.3.0, you COULD index a new site from the Index tab and Sphider would assign a site id to the new site. 5.4.0 has many improvements, but you just found something that got broken in the update! Now I have something to fix for the next release!!! FIX: spider.php, line 844 should read: ."? , ?...

Your method of using markers is valid. The actual Sphider index function (called on line 214) is located between lines 720-1151. Since this does SEEM like a permissions issue, and you mention "wamp" ... I take it you are using a Windows operating system. If so, confirm that "Windows O...

Did you upgrade or install as new? If installed as new, I suspect a permissions problem. There are several directories within the admin directory: backup, log, reports, sitemaps, and tmp. The system needs read/write access to these directories. Permissions need to be 755 (or 775 to be sure). With Ub...

I think I understand. You can get title and description but no fulltxt OR fulltxt but no title or description. Do keywords get indexed for pages with fulltxt? I would like to see the source code for a page from each type. Example: sport/resultatclub-2023?id=96 and recits/fanfare-et-harmonies.php. DO...

Sphider looks for the actual page content. I would need to see the actual page to determine the issue. If a page consists only of links and/or images and no actual text, it is possible there will be "fewer than 10 words". One way to see for sure is to clear the site, go into settings and c...

Clearing the site, then doing a new index will not harm anything. Only recommendation is that AFTER clearing the site you then run "clean keywords" from the Clean Tables tab. Also "clean temp" if there is any data in there. Cleaning keywords MIGHT take awhile... Also, when a time...

Sphider, as originally envisioned by Ando Saabas, was for small personal websites. It is, however, capable of handling some pretty large stuff! My own webisite (https://www.worldspaceflight.com) runs about 2000 pages. I have also, during testing, had as many as 15 sites indexed at once, some pretty ...

Getting a 500 Internal Server Error while trying to index or re-index a site can be very frustrating. These errors can be quite persistent and unpredictable. The larger the site, the more likely encountering a 500 HTTP error becomes --- and the more frustrating. While this error is not as disastrous...