Sphider Help Forum

The availability of Sphider 2.4.x-PDO will continue. However, there will be no more future enhancements to the PDO edition, although some minor maintenance release(s) may be expected.

Now that Sphider 2.4.0 is released, I've gone back to your site. I've found the the function removeEmoji(0 in and of itself was not the problem, but its placement. So, in future releases this: $host = $data['host']; $path = $data['path']; $fulltxt = $data['fulltext']; $fulltxt = removeEmoji($fulltxt...

The latest version of Sphider is now available.

The problem of the "&" in the title disappearing and leaving "nbsp;" is resolved in Sphider 2.4. Also in the titles, the missing apostrophes are restored. Second issue is the truncation occurring in the description. This occurs when the apostrophe (&apos:) character is en...

Probably a filter somewhere. I'll take a look. -------------------------------------------- UPDATE 4/6: There seems to be a twofold issue. Using Sphider v2.3, none of the full text of pages from http://www.equiterre.fr is being stored. This is probably related to the truncation issue. Trying a diffe...

If you wish to cause spidering to pause for a short time after indexing a certain number of pages, an easy edit can make this possible. Let's say that after indexing 30 pages, you want Sphider to take a five minute break, then resume for another 30 pages. Open spider.php. Find "function indexUr...

Another of the deprecated each() function replacements has come back to haunt Sphider 2.3.1. This has been corrected for the next release, but for those you can't wait, the fix is easy. Open the include/searchfuncs.php file and look for this code: $k = $domains_to_show[$domains[$key]][0]; $v = $doma...

Sphider 2.3.0 was released late 25 February 2019. Details can be seen in the change logs found at https://www.sphider.worldspaceflight.com.

Your code for limiting the number of links Sphider fetch from each domain works just fine! That's good. It has occurred to me that you may want to keep an eye on the 'temp' and 'pending' tables. Since indexing may stop before ALL the links are processed, these tables may contain "leftovers&quo...

I mean to tell Sphider he has to stop when fetch 40 or 50 links from a domain. In PDO 2.2.0, in spider.php, line 1009: while ($count < count($links)) { You can try: while ($count < count($links) && $num < 50) { I HAVE NOT TESTED THIS! NO GUARANTEE! It SEEMS like a good idea though. :lol: