Search found 309 matches
- Sat Oct 07, 2023 7:42 pm
- Forum: Sphider MODS
- Topic: Cause spidering to pause after indexing a specified number of pages
- Replies: 2
- Views: 70061
Re: Cause spidering to pause after indexing a specified number of pages
That is a suggestion I will keep in mind. Thanks!
- Sat Oct 07, 2023 7:41 pm
- Forum: Sphider MODS
- Topic: Suggestion: phrase search
- Replies: 2
- Views: 7441
Re: Suggestion: phrase search
It doesn't.
The full text of the page is stored in the links table. When a phrase search is performed, Sphider looks for that string in the full text and not a chain of individual keywords.
The full text of the page is stored in the links table. When a phrase search is performed, Sphider looks for that string in the full text and not a chain of individual keywords.
- Fri Oct 06, 2023 8:32 pm
- Forum: Sphider Help
- Topic: unicode indexing
- Replies: 18
- Views: 12887
Re: unicode indexing
Not all tables have varchar() fileds, and of those that do, only TWO are critical for this situation. Keywords and links are the critical tables. Go into the site setting and "Clear site", now go into the Clean tables tab and clean keywords. Your links and keywords tables should now be emp...
- Fri Oct 06, 2023 8:27 pm
- Forum: Sphider Help
- Topic: Caractères mal interprétés
- Replies: 1
- Views: 6194
Re: Caractères mal interprétés
Using Google translate, I get: Good morning, I'm trying to use Sphider which seems very good to me. Only, I have a problem with accented characters (French). In my tables, for example, the word nièvre appears like this (with an è after ni). But in the Sphider_keywords table, the word appears like th...
- Fri Sep 29, 2023 4:40 pm
- Forum: Sphider Help
- Topic: unicode indexing
- Replies: 18
- Views: 12887
Re: unicode indexing
Your code looks perfect! We have already established your tables are utf8mb4. Is there some way the fields in the table are NOT utf8mb4??? This does not seem likely, but I suppose anything is possible. Go into mysql, connect to the database you are using, and run a 'show create table' for links and ...
- Thu Sep 28, 2023 3:32 pm
- Forum: Sphider Help
- Topic: unicode indexing
- Replies: 18
- Views: 12887
Re: unicode indexing
I sent you a PM with instructions.
- Wed Sep 27, 2023 5:17 pm
- Forum: Sphider Help
- Topic: unicode indexing
- Replies: 18
- Views: 12887
Re: unicode indexing
I have to think you should be able to override whatever your host has as a default... I would like to see a portion of source code for a page containing Unicode characters... Even better would be to see the site itself. If you are not comfortable sharing that publicly, you may do so by private messa...
- Tue Sep 26, 2023 7:23 pm
- Forum: Sphider Help
- Topic: unicode indexing
- Replies: 18
- Views: 12887
Re: unicode indexing
Your database does not seem to be the issue. With web pages, it is possible for a Unicode character to appear correctly in a browser window, BUT the source code behind that page is not Unicode, but a replacement. For example: Browser displays: Д Source code is: Д Another possible issue is ...
- Wed Sep 13, 2023 1:33 am
- Forum: Sphider Help
- Topic: An issue with PDF indexing.
- Replies: 16
- Views: 12980
Re: An issue with PDF indexing.
This issue has been resolved. It turns out that Sphider uses the PHP exec() function to run the pdftotext converter Some Linux installations, for security reasons, block some functions such as exec(). A slight change to php.ini allowed exec() to function and pdf's were then indexed. As I said, the d...
- Sun Sep 10, 2023 5:00 am
- Forum: Sphider Help
- Topic: Robots.txt - would allow support be useful for many
- Replies: 6
- Views: 7308
Re: Robots.txt - would allow support be useful for many
Check this: viewtopic.php?p=547#p547 While not a FINAL solution, user-agent: Sphider Allow: / should now allow access, disregarding all the disallows in user-agent: *. Any desired disallows need to be added to user_agent: Sphider, even if they are duplicates of some disallows in user-agent: *. Feedb...