Search found 298 matches

by captquirk
Fri Mar 01, 2024 3:03 am
Forum: Sphider Help
Topic: Pre-indexing tips
Replies: 0
Views: 4

Pre-indexing tips

Many times problems with indexing a site can be prevented... at least when indexing sites over which you have control. Here are three tips to improve the odds of proper indexing. Be consistent with the use of "http" and "https" in your links. While browsers are much more forgivin...
by captquirk
Thu Feb 29, 2024 3:36 pm
Forum: Sphider Help
Topic: Experience with sphider 5.
Replies: 1
Views: 5

Re: Experience with sphider 5.

Thank you!
by captquirk
Mon Feb 26, 2024 4:05 pm
Forum: Sphider Help
Topic: index only the domain
Replies: 5
Views: 75

Re: index only the domain

Trying to do anything to a individual table (mainly deletes) is difficult to impossible. Sphider tables are linked to each other using keys. For example, the sites table is linked to the links table by way of a key. The links table is attached to the link-keyword tables in the same way. Only through...
by captquirk
Fri Feb 23, 2024 8:52 pm
Forum: Sphider Help
Topic: index only the domain
Replies: 5
Views: 75

Re: index only the domain

Is it possible on the Site's "Edit" page that either "Sphider can leave domain" or "Index foreign images" is checked? Also, on the "Clean tables" tab, run "Clean domains". This will remove any domains which are not in active use. This will not clean ...
by captquirk
Tue Feb 20, 2024 4:44 pm
Forum: Sphider Help
Topic: Always problems with with accented characters
Replies: 1
Views: 52

Re: Always problems with with accented characters

I understand the issue. The database is properly formatted on your local machine. Unfortunately, during the export/import operation, Unicode characters get corrupted. That is why your remote site gives improper results. I have yet to find a definitive solution to this issue. This has happened to me ...
by captquirk
Mon Feb 19, 2024 3:58 pm
Forum: Sphider Help
Topic: Images are not being added to the results
Replies: 2
Views: 569

Re: Images are not being added to the results

For anyone curious as to the outcome, an issue was found in the PHP configuration. "Allow_url_fopen" was set to "Off". Changing this value to "On" resolved many issues.
This can be done either by editing the php.ini file, or through CPanel.
by captquirk
Sun Feb 18, 2024 1:59 am
Forum: Sphider Help
Topic: Trouble with indexing
Replies: 3
Views: 48

Re: Trouble with indexing

Presuming the main issue is 500 errors stalling the indexing, the command line should do the trick. Then it is just a matter of getting the right stuff in the sitemap.xml.

Commandline from sphider/admin:
php spider.php -u https://harrymccracken.com/blog/ -f -s
by captquirk
Sat Feb 17, 2024 5:56 pm
Forum: Sphider Help
Topic: Trouble with indexing
Replies: 3
Views: 48

Re: Trouble with indexing

I tried indexing the your blog using your sitemap. Results were partial success. By this I mean that I made two runs and both ran to completion. No stalls. So in this regards I suspect you are encountering the dreaded 500 error! The best work around for this is to index from a command prompt. BUT --...
by captquirk
Fri Feb 02, 2024 6:16 pm
Forum: Sphider Help
Topic: problem with different languages
Replies: 6
Views: 807

Re: problem with different languages

Except for "id" and "language", are all of the other settings the same? Especially "stem_language". The minor changes you made shouldn't be causing this. However, if "stem_language" varies, that MIGHT be an issue. The settings snippet you provided does not sho...
by captquirk
Wed Jan 31, 2024 6:25 pm
Forum: Sphider Help
Topic: problem with different languages
Replies: 6
Views: 807

Re: problem with different languages

The language selected ONLY affects the text on the search page. Therefore, no matter what the search language, Sphider SHOULD return the exact same results for any search term, regardless of the search page language. Obviously, it does not! I even confirmed that myself! I'm not sure what the devil i...