Code: Select all
RewriteCond %{REMOTE_ADDR} !^10\.1\.0\.2$
RewriteCond %{HTTPS} !on
RewriteCond %{HTTP_HOST} ^www\.okanoganpud\.org*
RewriteRule ^(.*)$ https://www.okanoganpud.org/$1 [L,R=301]
Code: Select all
RewriteCond %{REMOTE_ADDR} !^10\.1\.0\.2$
RewriteCond %{HTTPS} !on
RewriteCond %{HTTP_HOST} ^www\.okanoganpud\.org*
RewriteRule ^(.*)$ https://www.okanoganpud.org/$1 [L,R=301]
Now THIS is really perplexing! So I have to wonder... is it something about CentOS? CentOS definitely does have a GOOD reputation. I have to agree that the problem, given the newest information, is NOT with your setup.[Back to admin]
Spidering https://www.bleepingcomputer.com/
Disallowed files and directories in robots.txt:
https://www.bleepingcomputer.com/cgi-bin/
https://www.bleepingcomputer.com/forums/style_images/
https://www.bleepingcomputer.com/forums ... act=Search
https://www.bleepingcomputer.com/forums ... ?act=Login
https://www.bleepingcomputer.com/forums ... hp?act=Reg
https://www.bleepingcomputer.com/forums ... t=calendar
https://www.bleepingcomputer.com/forums ... hp?act=Msg
https://www.bleepingcomputer.com/forums ... p?act=Mail
https://www.bleepingcomputer.com/forums ... ct=Forward
https://www.bleepingcomputer.com/forums ... ct=forward
https://www.bleepingcomputer.com/forums ... ?act=Track
https://www.bleepingcomputer.com/forums ... p?act=Post
https://www.bleepingcomputer.com/forums ... p?act=post
https://www.bleepingcomputer.com/forums ... p?showuser
https://www.bleepingcomputer.com/forums ... ?act=Print
https://www.bleepingcomputer.com/forums ... php?act=ST
https://www.bleepingcomputer.com/forums ... act=UserCP
https://www.bleepingcomputer.com/forums ... act=usercp
https://www.bleepingcomputer.com/forums ... act=Arcade
https://www.bleepingcomputer.com/forums ... t=findpost
https://www.bleepingcomputer.com/forums ... php?act=SF
https://www.bleepingcomputer.com/forums ... ?act=Stats
https://www.bleepingcomputer.com/forums ... act=Online
https://www.bleepingcomputer.com/forums ... ct=Members
https://www.bleepingcomputer.com/forums ... p?act=Help
https://www.bleepingcomputer.com/forums ... ct=Profile
https://www.bleepingcomputer.com/forums ... ct=profile
https://www.bleepingcomputer.com/forums ... act=Attach
https://www.bleepingcomputer.com/forums ... act=attach
https://www.bleepingcomputer.com/forums ... ?act=Print
https://www.bleepingcomputer.com/forums ... ?act=print
https://www.bleepingcomputer.com/forums ... Cookies&k=*
https://www.bleepingcomputer.com/forums ... &do=logout*
https://www.bleepingcomputer.com/forums ... ype=all&k=*
https://www.bleepingcomputer.com/forums ... oderate&f=*
https://www.bleepingcomputer.com/forums ... ule=search*
https://www.bleepingcomputer.com/forums ... sharelink=*
https://www.bleepingcomputer.com/forums/u/*
https://www.bleepingcomputer.com/forums/user-*
https://www.bleepingcomputer.com/forums/*&view=findpost*
https://www.bleepingcomputer.com/forums/*&view=old
https://www.bleepingcomputer.com/forums/*&view=new
https://www.bleepingcomputer.com/forums/*&mode=linear
https://www.bleepingcomputer.com/forums ... linearplus
https://www.bleepingcomputer.com/forums/*&mode=threaded
https://www.bleepingcomputer.com/forums/*&mode=threaded
https://www.bleepingcomputer.com/forums ... linearplus
https://www.bleepingcomputer.com/forums/*&mode=linear
https://www.bleepingcomputer.com/forums/help.html
https://www.bleepingcomputer.com/forums/lastpost
https://www.bleepingcomputer.com/resources/link
https://www.bleepingcomputer.com/tutori ... ?act=print
https://www.bleepingcomputer.com/tutori ... act=friend
https://www.bleepingcomputer.com/cmsimages/
https://www.bleepingcomputer.com/logreply/
1. Retrieving: https://www.bleepingcomputer.com/ at 15:40:39.
Size of page: 88.76kb. Starting indexing at 15:40:42.
Indexed
Links found: 103. New links: 103
2. Retrieving: https://www.bleepingcomputer.com/ at 15:40:52.
already in database
3. Retrieving: https://www.bleepingcomputer.com/about/ at 15:40:52.
Size of page: 46.68kb. Starting indexing at 15:40:54.
Indexed
Links found: 65. New links: 1
4. Retrieving: https://www.bleepingcomputer.com/advertise/ at 15:40:58.
Size of page: 54.36kb. Starting indexing at 15:40:59.
Indexed
Links found: 61. New links: 1
5. Retrieving: https://www.bleepingcomputer.com/author/ionut-ilascu/ at 15:41:06.
Size of page: 58.10kb. Starting indexing at 15:41:08.
Indexed
Links found: 86. New links: 25
6. Retrieving: https://www.bleepingcomputer.com/author ... ce-abrams/ at 15:41:14.
Size of page: 60.09kb. Starting indexing at 15:41:17.
Indexed
Links found: 81. New links: 15
7. Retrieving: https://www.bleepingcomputer.com/author/mayank-parmar/ at 15:41:20.
Size of page: 58.44kb. Starting indexing at 15:41:21.
Indexed
Links found: 83. New links: 19
8. Retrieving: https://www.bleepingcomputer.com/changelog/ at 15:41:25.
Size of page: 38.65kb. Starting indexing at 15:41:27.
Indexed
Links found: 67. New links: 7
9. Retrieving: https://www.bleepingcomputer.com/contact/ at 15:41:28.
Size of page: 54.26kb. Starting indexing at 15:41:30.
Indexed
Links found: 68. New links: 8
10. Retrieving: https://www.bleepingcomputer.com/download/ at 15:41:33.
Size of page: 70.12kb. Starting indexing at 15:41:36.
Indexed
Links found: 148. New links: 88
11. Retrieving: https://www.bleepingcomputer.com/downlo ... -security/ at 15:41:41.
Size of page: 68.93kb. Starting indexing at 15:41:43.
Indexed
Links found: 135. New links: 4
12. Retrieving: https://www.bleepingcomputer.com/download/adwcleaner/ at 15:41:46.
Size of page: 68.88kb. Starting indexing at 15:41:48.
Indexed
Links found: 138. New links: 8
13. Retrieving: https://www.bleepingcomputer.com/download/combofix/ at 15:41:51.
Size of page: 66.63kb. Starting indexing at 15:41:53.
Indexed
Links found: 136. New links: 5
14. Retrieving: https://www.bleepingcomputer.com/downlo ... scan-tool/ at 15:41:54.
Size of page: 65.34kb. Starting indexing at 15:41:56.
Indexed
Links found: 135. New links: 5