diff options
Diffstat (limited to '')
| -rw-r--r-- | www/py-robot-detection/pkg-message | 14 |
1 files changed, 14 insertions, 0 deletions
diff --git a/www/py-robot-detection/pkg-message b/www/py-robot-detection/pkg-message new file mode 100644 index 000000000000..e3e1aed11a1a --- /dev/null +++ b/www/py-robot-detection/pkg-message @@ -0,0 +1,14 @@ +[ +{ type: install + message: <<EOM +You can download a new version of the Robot Database from https://www.robotstxt.org/db/all.txt. + +Download the database dump, and run the file robot_detection.py with the file as first argument. + + $ fetch https://www.robotstxt.org/db/all.txt + $ python robot_detection.py all.txt + +If the database has changed, it'll print out the new version of robot_useragents variable that you need to put into the source code. +EOM +} +] |