Search found 302 matches

by captquirk
Sat Jan 15, 2022 4:11 pm
Forum: Sphider Help
Topic: Page contains less than 10 words. error in terminal
Replies: 6
Views: 5511

Re: Page contains less than 10 words. error in terminal

This page has content which is made up of primarily JavaScript and references to other content. Sphider does not index JavaScript and the no-follow flag prevents following the references. I will check further as to whether there is any content Sphider could (or should) index. EDIT/UPDATE: I do get t...
by captquirk
Sat Jan 15, 2022 4:03 pm
Forum: Sphider Help
Topic: Relocation: http 301 error in terminal
Replies: 19
Views: 13691

Re: Relocation: http 301 error in terminal

I took a quick look at the source code for https://yourstory.com/, and ... WOW! Definitely not your traditional HTML! I'll have to look deeper, but at this moment I'm not sure Sphider is sophisticated enough to digest it. I'll check deeper and elaborate. EDIT/UPDATE: This site is proving difficult t...
by captquirk
Tue Dec 21, 2021 5:27 pm
Forum: Sphider Help
Topic: Relocation: http 301 error in terminal
Replies: 19
Views: 13691

Re: Relocation: http 301 error in terminal

I have determined that sugermint.com is built using WordPress. I also know Sphider has difficulties with WordPress sites. A lot has to do with how robots.txt is set up. Sphider CAN index some WordPress sites, but it is an iffy proposition. (From experience using Sphider on my own WordPress blog.) In...
by captquirk
Mon Dec 20, 2021 12:07 am
Forum: Sphider Help
Topic: Page contains less than 10 words. error in terminal
Replies: 6
Views: 5511

Re: Page contains less than 10 words. error in terminal

Seems your setting are correct. That you CAN index SOME sites also tells me your installation is valid.

List a couple more URLs that are giving you the too few words message. I'll keep playing around on my end and maybe I'll finally see a clue.
by captquirk
Mon Dec 20, 2021 12:01 am
Forum: Sphider Help
Topic: Relocation: http 301 error in terminal
Replies: 19
Views: 13691

Re: Relocation: http 301 error in terminal

Sphider is definitely a lightweight search engine. Anyone trying to use it as their own personal replacement for Google, Bing, etc., is going to be sorely disappointed! Google, Bing, et al., use much more sophisticated algorithms than Sphider, and like any decent browser, follows redirects. Sphider ...
by captquirk
Sun Dec 19, 2021 7:38 pm
Forum: Sphider Help
Topic: Relocation: http 301 error in terminal
Replies: 19
Views: 13691

Re: Relocation: http 301 error in terminal

I get the same result --- 301 error. I have seen this happen before and it is not your installation. It is something funky with the web page! I will keep looking to see if I can determine the EXACT issue. In one other case where I saw this, the issue was how the https was set up on the site's server...
by captquirk
Sun Dec 19, 2021 7:32 pm
Forum: Sphider Help
Topic: Page contains less than 10 words. error in terminal
Replies: 6
Views: 5511

Re: Page contains less than 10 words. error in terminal

I was unable to duplicate this problem. I indexed both from the admin form and from the command prompt. With setting of 10 for "Required number of words in a page in order to be indexed" and 5 for "Minimum word length in order to be indexed", I obtain 17 keywords. The page actual...
by captquirk
Sun Dec 19, 2021 5:08 pm
Forum: Sphider Help
Topic: Page contains less than 10 words. error in terminal
Replies: 6
Views: 5511

Re: Page contains less than 10 words. error in terminal

I will investigate and get back to you.
by captquirk
Sun Dec 19, 2021 5:06 pm
Forum: Sphider Help
Topic: Relocation: http 301 error in terminal
Replies: 19
Views: 13691

Re: Relocation: http 301 error in terminal

Let me investigate. I will get back to you.
by captquirk
Fri Oct 08, 2021 6:56 pm
Forum: Sphider Help
Topic: NOHOST Plaguing Me
Replies: 6
Views: 5702

Re: NOHOST Plaguing Me

Possibly related... hard to know for sure. MAYBE you were lacking a PHP module that Sphider uses and the library installed it? Without comparing before and after results of phpinfo() query, that would be pure conjecture. (Seeing the phpinfo() results WOULD have been one of my next steps.) The import...