Sphider Help Forum

I understand the issue. The database is properly formatted on your local machine. Unfortunately, during the export/import operation, Unicode characters get corrupted. That is why your remote site gives improper results. I have yet to find a definitive solution to this issue. This has happened to me ...

For anyone curious as to the outcome, an issue was found in the PHP configuration. "Allow_url_fopen" was set to "Off". Changing this value to "On" resolved many issues.
This can be done either by editing the php.ini file, or through CPanel.

Presuming the main issue is 500 errors stalling the indexing, the command line should do the trick. Then it is just a matter of getting the right stuff in the sitemap.xml.

Commandline from sphider/admin:
php spider.php -u https://harrymccracken.com/blog/ -f -s

I tried indexing the your blog using your sitemap. Results were partial success. By this I mean that I made two runs and both ran to completion. No stalls. So in this regards I suspect you are encountering the dreaded 500 error! The best work around for this is to index from a command prompt. BUT --...

Except for "id" and "language", are all of the other settings the same? Especially "stem_language". The minor changes you made shouldn't be causing this. However, if "stem_language" varies, that MIGHT be an issue. The settings snippet you provided does not sho...

The language selected ONLY affects the text on the search page. Therefore, no matter what the search language, Sphider SHOULD return the exact same results for any search term, regardless of the search page language. Obviously, it does not! I even confirmed that myself! I'm not sure what the devil i...

The issue is with the website itself. The certificate is invalid and there is no way for Sphider to change that.

As a work-around, you could try http://wtk-velbert.de (or maybe http://www.wtk-velbert.de), but if the site is set up to redirect to https, that won't work either.

Sorry.

PM me with the URL of the site you are trying to index and I'll see what happens from my end. Then maybe we can figure out a solution.

I hate 500 errors...

The search page customization is very nicely done!
I'm not sure what is going on with the searches...
Is there just a single database, or is there a separate database for each language? Knowing this will help me think more clearly as to what/why...

Check this previous post... https://www.forum.worldspaceflight.com/viewtopic.php?t=207 Unfortunately, the 500 error does not show up in the logs. The log writes after a status report from the server, but a 500 error is a failure to get a response, including getting a status report! Post back if you ...