Sphider Help Forum

Trying to do anything to a individual table (mainly deletes) is difficult to impossible. Sphider tables are linked to each other using keys. For example, the sites table is linked to the links table by way of a key. The links table is attached to the link-keyword tables in the same way. Only through...

Is it possible on the Site's "Edit" page that either "Sphider can leave domain" or "Index foreign images" is checked? Also, on the "Clean tables" tab, run "Clean domains". This will remove any domains which are not in active use. This will not clean ...

I understand the issue. The database is properly formatted on your local machine. Unfortunately, during the export/import operation, Unicode characters get corrupted. That is why your remote site gives improper results. I have yet to find a definitive solution to this issue. This has happened to me ...

For anyone curious as to the outcome, an issue was found in the PHP configuration. "Allow_url_fopen" was set to "Off". Changing this value to "On" resolved many issues.
This can be done either by editing the php.ini file, or through CPanel.

Presuming the main issue is 500 errors stalling the indexing, the command line should do the trick. Then it is just a matter of getting the right stuff in the sitemap.xml.

Commandline from sphider/admin:
php spider.php -u https://harrymccracken.com/blog/ -f -s

I tried indexing the your blog using your sitemap. Results were partial success. By this I mean that I made two runs and both ran to completion. No stalls. So in this regards I suspect you are encountering the dreaded 500 error! The best work around for this is to index from a command prompt. BUT --...

Except for "id" and "language", are all of the other settings the same? Especially "stem_language". The minor changes you made shouldn't be causing this. However, if "stem_language" varies, that MIGHT be an issue. The settings snippet you provided does not sho...

The language selected ONLY affects the text on the search page. Therefore, no matter what the search language, Sphider SHOULD return the exact same results for any search term, regardless of the search page language. Obviously, it does not! I even confirmed that myself! I'm not sure what the devil i...

The issue is with the website itself. The certificate is invalid and there is no way for Sphider to change that.

As a work-around, you could try http://wtk-velbert.de (or maybe http://www.wtk-velbert.de), but if the site is set up to redirect to https, that won't work either.

Sorry.

PM me with the URL of the site you are trying to index and I'll see what happens from my end. Then maybe we can figure out a solution.

I hate 500 errors...