Extended UA String
Posted: Fri Nov 23, 2018 10:53 pm
Just a note:
I've taken the liberty of extending the user agent string text field from 20 to 50 in the configset.php on the admin side:
690 echo "<tr>\n";
691 echo "<td class='left1'><input name='_user_agent' value='Mozilla/5.0 (compatible; yourBot/build; +https://www.XXXX.com/XXX/)'";
692 echo $row[25];
693 echo "' type='text' id='user_agent' size='50'></td>\n";
694 echo "<td> User agent string</td>\n";
695 echo "</tr>\n";
-- If you're running a site parsing agent on the open web, it's important that you let site owners know who you are, otherwise they may mistake you for a scraper of some sort or some other nefarious type and block your bot or even worse, your IP Range in their .htaccess.
The address provided in your UA String should point to a page that explains who you are and what your bot does.
I've taken the liberty of extending the user agent string text field from 20 to 50 in the configset.php on the admin side:
690 echo "<tr>\n";
691 echo "<td class='left1'><input name='_user_agent' value='Mozilla/5.0 (compatible; yourBot/build; +https://www.XXXX.com/XXX/)'";
692 echo $row[25];
693 echo "' type='text' id='user_agent' size='50'></td>\n";
694 echo "<td> User agent string</td>\n";
695 echo "</tr>\n";
-- If you're running a site parsing agent on the open web, it's important that you let site owners know who you are, otherwise they may mistake you for a scraper of some sort or some other nefarious type and block your bot or even worse, your IP Range in their .htaccess.
The address provided in your UA String should point to a page that explains who you are and what your bot does.