py-protego

v 0.3.1 Updated: 6 months, 3 weeks ago

Protego is a pure-Python `robots.txt` parser with support for modern conventions.


https://pypi.python.org/pypi/Protego

Installable ports:


Add to my watchlist

Installations 0
Requested Installations 0