Sphider Help Forum

Issue is confirmed! The 'title" column of the links table is not being populated for apnews.com. Now to figure out WHY! UPDATE: Sphider is unable to find the title tags (<title> and </title>). In the case of apnews.com, there are TWO causes for this. The first is a simple code fix, but the seco...

Let me look at the issue. I'll post what I find.

I'LL BE BACK!

The Sphider search function has been revised. Sphider searches should now be even faster.

If your website has abnormally large pages, it is possible that a database backup may not complete. There will be an entry in your error log mentioning running out of memory. Because the backup groups several table rows for efficiency, large pages can cause a transaction to be too big to handle. Thi...

This is a very minor update, affecting only the jquery version used in searching.

These editions provide a couple minor bug fixes and a new feature compared to the previous editions.

The new feature is the ability to create a sitemap of any previously indexed site. This feature is available from a sites Options screen. Existing sitemaps can be seen from the Statistics tab.

There have been a couple (two, actually) reports of Sphider failing when stemming has been enabled. I have not been able to test those instances, not knowing the urls affected. I can test sites randomly, but have been unable to get a failure... until now. More in a moment. First to let you know a bi...

If you could send me your spider log I might get a clue as to what is happening. There is something strange here as I have indexed many sites using relative links with no issue. But even I come up with some invalid links while the source code appears totally valid. Give me a bit and I WILL figure ou...

Using Sphider 3.3.0-MB, I added a new site: http://www.marquis-kyle.com.au/ I set index level to: full In settings, I checked "Index pdf". Minimum words per page is 10, minimum word length is 3. Using these settings, I ran the spider. There were 1668 links discovered, a couple being duplic...

Give me a link to your site and I will have a look. Just a couple ideas that may or may not apply... Do you have a sitemap, and is it linked to from the main page? Indexing using a sitemap.xml is a surefire way of finding pages. Do you have any links that are only in javascript, like a javascript me...