Search found 302 matches

by captquirk
Sat Apr 08, 2023 7:53 pm
Forum: Sphider Help
Topic: Limitations at scale?
Replies: 2
Views: 5331

Re: Limitations at scale?

First, sorry for the long delay at responding. I was having some health issues. Sphider does not do very well at indexing JavaScript generated content. As to scalability, Sphider's main intent is for indexing personal sites. HOWEVER, you can index many websites. I have no idea what the upper limits ...
by captquirk
Sat Apr 08, 2023 7:45 pm
Forum: Sphider Help
Topic: Hi - i have a problem with search
Replies: 2
Views: 4243

Re: Hi - i have a problem with search

Sorry for the long delay responding. Health issues.
Glad you were able to resolve the issue.
by captquirk
Sat Apr 08, 2023 7:43 pm
Forum: Sphider Help
Topic: Problem with sitema.xml
Replies: 1
Views: 3820

Re: Problem with sitema.xml

Sorry for the delay responding. Was having some health issues.

Could you attach the sitemap.xml you are attempting to use? There are several ways of formatting and it is possible Sphider does not recognize this one.
by captquirk
Thu Oct 06, 2022 7:17 pm
Forum: Sphider Help
Topic: Cannot index my site
Replies: 5
Views: 9254

Re: Cannot index my site

Let's try something... In spiderfuncs.php, starting at line 136, see: if (mbsubstr($url, 0, 5) == "https") { $target = "ssl://".$host; } else { $target = $host; } Add a line so it looks like: if (mbsubstr($url, 0, 5) == "https") { $target = "ssl://".$host; } e...
by captquirk
Thu Oct 06, 2022 2:29 am
Forum: Sphider Help
Topic: Cannot index my site
Replies: 5
Views: 9254

Re: Cannot index my site

Spaces in filenames can be a real pain. Windows based servers typically replace a space with a "%20", but Linux?UNIX servers do not. At this point, the initial error was likely indeed a URL name that resulted in a corrupted file pointer during the fsockopen. My advice is to rename files wi...
by captquirk
Wed Oct 05, 2022 8:10 pm
Forum: Sphider Help
Topic: Cannot index my site
Replies: 5
Views: 9254

Re: Cannot index my site

Pretty sure your mySqlnd is indeed enabled enabled. Your permissions are fine and user change for data is correct. Your PHP version 8.1.9 should not be the issue. Development machine is currently at 8.1.8, so there should be no issues there. The problem has to do with opening a file stream on your w...
by captquirk
Wed Sep 14, 2022 2:03 am
Forum: Sphider Help
Topic: Relocation: http 301 error in terminal
Replies: 19
Views: 13579

Re: Relocation: http 301 error in terminal

Sorry for the delay in responding. You can try different things for User Agent. I do know SOME administrators consider "Sphider" to be a rogue bot, which is a shame. It is not a rogue bot, but either the app or the name can be used by ROGUE PEOPLE! You can try leaving User Agent blank. Or ...
by captquirk
Fri Jul 22, 2022 4:22 pm
Forum: Sphider Help
Topic: Keyword question
Replies: 4
Views: 5771

Re: Keyword question

Compared to indexing, searching is a piece of cake. Any particular keyword can occur on any particular page. And if multiple sites are indexed, keywords can appear in multiple sites. Yes, there are many keywords. Now imagine the number of link (page) to keyword relationships. That is why there are 1...
by captquirk
Thu Jul 21, 2022 2:31 am
Forum: Sphider Help
Topic: Keyword question
Replies: 4
Views: 5771

Re: Keyword question

Key factors in weighting is location (title, domain, path, meta tags, and body) and number of occurrences. The keyword weighting remains just as it was when Ando Saabas left it. I have not had the courage to screw with it, although I can't say I always feel it is ideal. For example, one particular c...
by captquirk
Sun Jul 17, 2022 5:06 am
Forum: Sphider Help
Topic: admin.php error 500
Replies: 16
Views: 13992

Re: admin.php error 500

Check out the NEW Sphider 5.0.0! It can generate a links report!