Search found 143 matches

by captquirk
Wed Dec 16, 2020 5:47 pm
Forum: Sphider Help
Topic: All title tags are showing as Untitled document
Replies: 7
Views: 344

Re: All title tags are showing as Untitled document

Issue is confirmed! The 'title" column of the links table is not being populated for apnews.com. Now to figure out WHY! UPDATE: Sphider is unable to find the title tags (<title> and </title>). In the case of apnews.com, there are TWO causes for this. The first is a simple code fix, but the seco...
by captquirk
Wed Dec 16, 2020 5:05 pm
Forum: Sphider Help
Topic: All title tags are showing as Untitled document
Replies: 7
Views: 344

Re: All title tags are showing as Untitled document

Let me look at the issue. I'll post what I find.

I'LL BE BACK!
by captquirk
Thu Dec 10, 2020 7:39 pm
Forum: Announcements
Topic: Sphider 3.5.2-MB and SphiderLite 1.2.2 released
Replies: 0
Views: 316

Sphider 3.5.2-MB and SphiderLite 1.2.2 released

The Sphider search function has been revised. Sphider searches should now be even faster.
by captquirk
Sun Dec 06, 2020 3:47 am
Forum: Sphider Help
Topic: Backup does not complete
Replies: 0
Views: 224

Backup does not complete

If your website has abnormally large pages, it is possible that a database backup may not complete. There will be an entry in your error log mentioning running out of memory. Because the backup groups several table rows for efficiency, large pages can cause a transaction to be too big to handle. Thi...
by captquirk
Sat Jul 18, 2020 4:20 pm
Forum: Announcements
Topic: Sphider 3.4.1-MB, SphiderLite 1.1.1 released 18 July 2020
Replies: 0
Views: 638

Sphider 3.4.1-MB, SphiderLite 1.1.1 released 18 July 2020

This is a very minor update, affecting only the jquery version used in searching.
by captquirk
Sat Dec 07, 2019 10:22 pm
Forum: Announcements
Topic: Sphider 3.4.0-MB and SphiderLite 1.1.0 released 7 December 2019
Replies: 0
Views: 32558

Sphider 3.4.0-MB and SphiderLite 1.1.0 released 7 December 2019

These editions provide a couple minor bug fixes and a new feature compared to the previous editions.

The new feature is the ability to create a sitemap of any previously indexed site. This feature is available from a sites Options screen. Existing sitemaps can be seen from the Statistics tab.
by captquirk
Sat Nov 30, 2019 12:14 am
Forum: Sphider Help
Topic: On the matter of stemming
Replies: 0
Views: 33114

On the matter of stemming

There have been a couple (two, actually) reports of Sphider failing when stemming has been enabled. I have not been able to test those instances, not knowing the urls affected. I can test sites randomly, but have been unable to get a failure... until now. More in a moment. First to let you know a bi...
by captquirk
Thu Nov 28, 2019 4:49 pm
Forum: Sphider Help
Topic: Premature completion
Replies: 6
Views: 19623

Re: Premature completion

If you could send me your spider log I might get a clue as to what is happening. There is something strange here as I have indexed many sites using relative links with no issue. But even I come up with some invalid links while the source code appears totally valid. Give me a bit and I WILL figure ou...
by captquirk
Wed Nov 27, 2019 7:04 pm
Forum: Sphider Help
Topic: Premature completion
Replies: 6
Views: 19623

Re: Premature completion

Using Sphider 3.3.0-MB, I added a new site: http://www.marquis-kyle.com.au/ I set index level to: full In settings, I checked "Index pdf". Minimum words per page is 10, minimum word length is 3. Using these settings, I ran the spider. There were 1668 links discovered, a couple being duplic...
by captquirk
Wed Nov 27, 2019 4:00 am
Forum: Sphider Help
Topic: Premature completion
Replies: 6
Views: 19623

Re: Premature completion

Give me a link to your site and I will have a look. Just a couple ideas that may or may not apply... Do you have a sitemap, and is it linked to from the main page? Indexing using a sitemap.xml is a surefire way of finding pages. Do you have any links that are only in javascript, like a javascript me...