how can i tell if indexing is working

Come here for help or to post comments on Sphider
User avatar
captquirk
Site Admin
Posts: 168
Joined: Sun Apr 09, 2017 8:49 pm
Location: Arizona, USA
Contact:

Re: how can i tell if indexing is working

Post by captquirk »

Whichever version works as the correct PHP module for you version of PHP. My experience says the modules change for each major PHP version and tend to be immune to minor changes.
So, for your case, PHP 7.4 matters, but the ".20" minor version does not.
Concentrate on the correct Imagick for PHP 7.4.
I am running PHP 7.4.3. My Imagick module is 3.4.4. There MIGHT be a difference between thread safe and non-thread safe modules, depending on your PHP build. I use a PHP version which does NOT have thread safety.
I also know, at least for Linux, there are 32 bit and 64 bit modules, so you want to match your PHP version.
Between 32/64 bit, and thread safe/non-thread safe, you have four different possibilities right there.
Hope this helps.
captcurrent
Posts: 23
Joined: Mon May 31, 2021 5:48 pm

Re: how can i tell if indexing is working

Post by captcurrent »

as expected too much procedure and reepository differences. I seem to be getting further away from it functioning right then getting it right. Thanks for the assistance I think i will keep trying for another couple of days then punt.
User avatar
captquirk
Site Admin
Posts: 168
Joined: Sun Apr 09, 2017 8:49 pm
Location: Arizona, USA
Contact:

Re: how can i tell if indexing is working

Post by captquirk »

If you can find a Free BSD forum, that may be of some help from others experienced in the operating system.
captcurrent
Posts: 23
Joined: Mon May 31, 2021 5:48 pm

Re: how can i tell if indexing is working

Post by captcurrent »

Oh I have been on the FreeBSD forum. Trouble is all the posts there basically say. app xy requires. so and so Imagick. That is why I asked ehat Sphider requires
captcurrent
Posts: 23
Joined: Mon May 31, 2021 5:48 pm

Re: how can i tell if indexing is working

Post by captcurrent »

OK got it running trick was getting all the modules in php, which was not fun, then getting the path defined correctly for the tmp director..

I had to use ImageMagick6-nox11-6.9.11.6_2,1 Image processing tools to get it to run with FreeBSD 13 and Php 7.4


Thanks for all the help and for listening to all my bitching
User avatar
captquirk
Site Admin
Posts: 168
Joined: Sun Apr 09, 2017 8:49 pm
Location: Arizona, USA
Contact:

Re: how can i tell if indexing is working

Post by captquirk »

I am happy it is all working and glad I could be of some assistance. You did the hard work.
Persistence is what leads to success, and bitching is part of the process. (I know from experience!)

And just think.... you'll get to do it all over again when you upgrade to PHP 8... :o
captcurrent
Posts: 23
Joined: Mon May 31, 2021 5:48 pm

Re: how can i tell if indexing is working

Post by captcurrent »

Hush your mouth. I set this all off dealing with an upgrade to FreeBSD 13 after fell behind when I lost computer access due to covid 19. One strange thing that I did notice is that indexing reject as duplicates a number of images in different areas. The only thing duplicate was the file name which I would think the path would identify as different. My slide shows use similar names. images-1.jpg. with the last number incremented in the sub folder. Not on topic for this but...
User avatar
captquirk
Site Admin
Posts: 168
Joined: Sun Apr 09, 2017 8:49 pm
Location: Arizona, USA
Contact:

Re: how can i tell if indexing is working

Post by captquirk »

Sphider records images by name and URL. If the same image URL/name is referenced on multiple pages, it will be recorded as a duplicate. Thus, it doesn't matter what page the image appears on, but where it actually resides.
Each page being indexed finds all images referenced by that page. For each image found, the database looks to see if the full path (including the file name) exists. If so, it is deemed a duplicate.

As Sphider builds a list of pages to index, it IS possible that a page may appear in the queue more than once. This should be noted by a "already indexed" notice and it will be skipped as indexing moves to next in queue. Image indexing for that page is also skipped over.

NOTE: It may seem weird that a page may appear in the queue more than once. I certainly think so, anyway! I've never (yet) figured out just how to prevent this. On the other hand, I rather this than a page being missed!

If you have an example of "duplicates" which are not real duplicates but just recurring names in different paths, please let me know so I can see what may be the cause. I am not so naive as to believe Sphider is without bugs, but I have to find them to fix them. Unfortunately, I miss stuff and depend on users to point them out to me when I do.
captcurrent
Posts: 23
Joined: Mon May 31, 2021 5:48 pm

Re: how can i tell if indexing is working

Post by captcurrent »

Here are two examples
Image 48. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg at 13:23:56. Image is a duplicate
Image 49. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg at 13:23:56. Image is a duplicate
Image 50. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg at 13:23:56. Image is a duplicate
Image 51. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg at 13:23:56. Image is a duplicate
Image 52. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg at 13:23:56. Image is a duplicate
Image 53. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg at 13:23:56. Image is a duplicate
Image 54. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... f%201).jpg at 13:23:56. Image is a duplicate
The ones above are probably a bad example as the tires seems to indicate they were generated.
18. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... gustfirst/ at 13:23:55.
Size of page: 9.18kb. Starting indexing at 13:23:55. Page is a duplicate.
Links found: 0. New links: 0
19. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... irstagain/ at 13:23:55.
Size of page: 1.18kb. Starting indexing at 13:23:56. Page is a duplicate.
Links found: 0. New links: 0
20. Retrieving: http://kasdivi.com/images/Gallery/2009/ ... partthree/ at 13:23:56.
Size of page: 9.18kb. Starting indexing at 13:23:56. Page is a duplicate.
Links found: 0. New links: 0
The ones above are generate warmings.. I use to use flash. need to seek out and destroy
User avatar
captquirk
Site Admin
Posts: 168
Joined: Sun Apr 09, 2017 8:49 pm
Location: Arizona, USA
Contact:

Re: how can i tell if indexing is working

Post by captquirk »

With the first example, the ellipses hide part of the path. However, the first 6 lines do APPEAR to be the same. Looking in my database, this is what I see:
4175, http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg, cargill%20(1%20of%206).jpg, 400, 300, , 25, 0
4174, http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg, cargill%20(2%20of%206).jpg, 400, 300, , 25, 0
4173, http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg, cargill%20(3%20of%206).jpg, 400, 300, , 25, 0
4172, http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg, cargill%20(4%20of%206).jpg, 400, 300, , 25, 0
4170, http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg, cargill%20(5%20of%206).jpg, 400, 300, , 25, 0
4171, http://kasdivi.com/images/Gallery/2009/ ... f%206).jpg, cargill%20(6%20of%206).jpg, 400, 300, , 25, 0
This shows 6 unique but very similar names. Visiting the page, this appears to be correct.

With the second example, the first and third pages display the content:
This photo gallery requires the Adobe Flash Player.Get the free Flash Player here
I suspect there MAY be other pages displaying the same message. Which the page name may be different, the content is identical! To Sphider, it LOOKS to be a duplicate page. The second entry has a slightly different text display, but again I suspect it may not be the only page with that message.

Sphider does do some puzzling stuff! I have been working with it for several years now, it it still leaves me scratching my head at times. LOL! When I am CONVINCED Sphider is wrong, I try to fix it. However, when in doubt I leave it alone until I understand it better. I learned early on that some of my "fixes" were introducing problems because I didn't understand the issue.
Post Reply