%PDF- %PDF-
Direktori : /usr/local/lib/python2.7/ |
Current File : //usr/local/lib/python2.7/robotparser.pyc |
ó Mêáac @ s} d Z d d l Z d d l Z d g Z d d d „ ƒ YZ d d d „ ƒ YZ d d d „ ƒ YZ d e j f d „ ƒ YZ d S( s& robotparser.py Copyright (C) 2000 Bastian Kleineidam You can choose between two licenses when using this package: 1) GNU GPLv2 2) PSF license for Python 2.2 The robots.txt Exclusion Protocol is implemented as specified in http://www.robotstxt.org/norobots-rfc.txt iÿÿÿÿNt RobotFileParserc B sb e Z d Z d d „ Z d „ Z d „ Z d „ Z d „ Z d „ Z d „ Z d „ Z d „ Z RS( ss This class provides a set of methods to read, parse and answer questions about a single robots.txt file. t c C s>