Search found 308 matches

by captquirk
Fri Nov 03, 2023 3:11 am
Forum: Sphider Help
Topic: Can't indexing
Replies: 3
Views: 7573

Re: Can't indexing

Sphider looks for the actual page content. I would need to see the actual page to determine the issue. If a page consists only of links and/or images and no actual text, it is possible there will be "fewer than 10 words". One way to see for sure is to clear the site, go into settings and c...
by captquirk
Tue Oct 24, 2023 4:10 pm
Forum: Sphider Help
Topic: Optimizing for speed
Replies: 4
Views: 6891

Re: Optimizing for speed

Clearing the site, then doing a new index will not harm anything. Only recommendation is that AFTER clearing the site you then run "clean keywords" from the Clean Tables tab. Also "clean temp" if there is any data in there. Cleaning keywords MIGHT take awhile... Also, when a time...
by captquirk
Mon Oct 23, 2023 2:34 am
Forum: Sphider Help
Topic: Optimizing for speed
Replies: 4
Views: 6891

Re: Optimizing for speed

Sphider, as originally envisioned by Ando Saabas, was for small personal websites. It is, however, capable of handling some pretty large stuff! My own webisite (https://www.worldspaceflight.com) runs about 2000 pages. I have also, during testing, had as many as 15 sites indexed at once, some pretty ...
by captquirk
Fri Oct 20, 2023 11:24 pm
Forum: Sphider Help
Topic: Dealing with the curse of the 500 Internal Server Error
Replies: 0
Views: 14745

Dealing with the curse of the 500 Internal Server Error

Getting a 500 Internal Server Error while trying to index or re-index a site can be very frustrating. These errors can be quite persistent and unpredictable. The larger the site, the more likely encountering a 500 HTTP error becomes --- and the more frustrating. While this error is not as disastrous...
by captquirk
Wed Oct 18, 2023 3:56 pm
Forum: Sphider Help
Topic: Having trouble getting Sphyider started
Replies: 4
Views: 6898

Re: Having trouble getting Sphyider started

Ahhh! Turns out that is a fairly new collation and your version of MySQL obviously does not have it.
Well, easy fix.
Edit install.php and replace all instances of of 'utf8mb4_0900_ai_ci' with 'utf8mb4_general_ci'. Then rerun install.php.
by captquirk
Wed Oct 18, 2023 3:35 am
Forum: Sphider Help
Topic: Having trouble getting Sphyider started
Replies: 4
Views: 6898

Re: Having trouble getting Sphyider started

Did you edit settings/database.php and settings/my.cnf for database name, mysql_user, mysql_password, and mysql_server?

Just getting the "Sphider installation script" with nothing after than indicates a failure to connect to the database.
by captquirk
Tue Oct 17, 2023 12:21 am
Forum: Announcements
Topic: Sphider 5.4.0, SphiderLite 2.5.0 released
Replies: 0
Views: 16816

Sphider 5.4.0, SphiderLite 2.5.0 released

15 October 2023 - Processing of robots.txt files has been improved. Robots.txt is now case sensitive and consideration is given to "allow" directives. All common text files have been integrated into Sphider. The user may assign a default language to a web site, but Sphider will also try to...
by captquirk
Mon Oct 09, 2023 4:03 pm
Forum: Sphider Help
Topic: unicode indexing
Replies: 18
Views: 12874

Re: unicode indexing

I am puzzled... Obviously, I am no guru and am missing something. The 'keyword' field is capable of holding Unicode characters. What version of MySQL (or possibly MariaDB) is running? MySQL, from what I read, has finally made utf8 and utf8mb4 the same instead of utf8 == utf8mb3. If the DB is MariaDB...
by captquirk
Sun Oct 08, 2023 4:21 pm
Forum: Sphider Help
Topic: unicode indexing
Replies: 18
Views: 12874

Re: unicode indexing

"0 rows affected" is expected as there was no operation affecting actual data. Just a table creation which has no data. Can you run a "show create table keywords;" again just to confirm the table does have utf8mb4 varchar. The fact you can manually enter a unicode character into ...
by captquirk
Sat Oct 07, 2023 7:42 pm
Forum: Sphider MODS
Topic: Cause spidering to pause after indexing a specified number of pages
Replies: 2
Views: 70051

Re: Cause spidering to pause after indexing a specified number of pages

That is a suggestion I will keep in mind. Thanks!