Presuming the main issue is 500 errors stalling the indexing, the command line should do the trick. Then it is just a matter of getting the right stuff in the sitemap.xml.
Commandline from sphider/admin:
php spider.php -u https://harrymccracken.com/blog/ -f -s
Search found 302 matches
- Sun Feb 18, 2024 1:59 am
- Forum: Sphider Help
- Topic: Trouble with indexing
- Replies: 3
- Views: 1669
- Sat Feb 17, 2024 5:56 pm
- Forum: Sphider Help
- Topic: Trouble with indexing
- Replies: 3
- Views: 1669
Re: Trouble with indexing
I tried indexing the your blog using your sitemap. Results were partial success. By this I mean that I made two runs and both ran to completion. No stalls. So in this regards I suspect you are encountering the dreaded 500 error! The best work around for this is to index from a command prompt. BUT --...
- Fri Feb 02, 2024 6:16 pm
- Forum: Sphider Help
- Topic: problem with different languages
- Replies: 6
- Views: 2674
Re: problem with different languages
Except for "id" and "language", are all of the other settings the same? Especially "stem_language". The minor changes you made shouldn't be causing this. However, if "stem_language" varies, that MIGHT be an issue. The settings snippet you provided does not sho...
- Wed Jan 31, 2024 6:25 pm
- Forum: Sphider Help
- Topic: problem with different languages
- Replies: 6
- Views: 2674
Re: problem with different languages
The language selected ONLY affects the text on the search page. Therefore, no matter what the search language, Sphider SHOULD return the exact same results for any search term, regardless of the search page language. Obviously, it does not! I even confirmed that myself! I'm not sure what the devil i...
- Wed Jan 31, 2024 5:59 pm
- Forum: Sphider Help
- Topic: cron job
- Replies: 2
- Views: 2064
Re: cron job
The issue is with the website itself. The certificate is invalid and there is no way for Sphider to change that.
As a work-around, you could try http://wtk-velbert.de (or maybe http://www.wtk-velbert.de), but if the site is set up to redirect to https, that won't work either.
Sorry.
As a work-around, you could try http://wtk-velbert.de (or maybe http://www.wtk-velbert.de), but if the site is set up to redirect to https, that won't work either.
Sorry.
- Tue Jan 30, 2024 4:28 pm
- Forum: Sphider Help
- Topic: 500 Server Error
- Replies: 4
- Views: 2453
Re: 500 Server Error
PM me with the URL of the site you are trying to index and I'll see what happens from my end. Then maybe we can figure out a solution.
I hate 500 errors...
I hate 500 errors...
- Mon Jan 29, 2024 12:10 am
- Forum: Sphider Help
- Topic: problem with different languages
- Replies: 6
- Views: 2674
Re: problem with different languages
The search page customization is very nicely done!
I'm not sure what is going on with the searches...
Is there just a single database, or is there a separate database for each language? Knowing this will help me think more clearly as to what/why...
I'm not sure what is going on with the searches...
Is there just a single database, or is there a separate database for each language? Knowing this will help me think more clearly as to what/why...
- Sun Jan 28, 2024 11:55 pm
- Forum: Sphider Help
- Topic: 500 Server Error
- Replies: 4
- Views: 2453
Re: 500 Server Error
Check this previous post... https://www.forum.worldspaceflight.com/viewtopic.php?t=207 Unfortunately, the 500 error does not show up in the logs. The log writes after a status report from the server, but a 500 error is a failure to get a response, including getting a status report! Post back if you ...
- Sun Jan 28, 2024 11:48 pm
- Forum: Sphider Help
- Topic: Images are not being added to the results
- Replies: 2
- Views: 2596
Re: Images are not being added to the results
Is this an initial index run or a re-index run? Sphider will not index images during a re-index unless there was a change in the page since the last run. Also, index images must be checked in settings. Also, SOMETIMES the image referenced will have a different source from the domain being indexed. F...
- Thu Dec 21, 2023 1:57 am
- Forum: Announcements
- Topic: Sphider 5.5.0 and SphiderLite 2.6.0 have been released
- Replies: 0
- Views: 10326