Uses of Package
org.archive.wayback.accesscontrol.robotstxt

Packages that use org.archive.wayback.accesscontrol.robotstxt

Package	Description
org.archive.wayback.accesscontrol.robotstxt
org.archive.wayback.accesscontrol.robotstxt.redis
org.archive.wayback.webapp

Classes in org.archive.wayback.accesscontrol.robotstxt used by org.archive.wayback.accesscontrol.robotstxt

Class and Description
RobotsDirectives Represents the directives that apply to a user-agent (or set of user-agents)
Robotstxt Utility class for parsing and representing 'robots.txt' format directives, into a list of named user-agents and map from user-agents to RobotsDirectives.

Classes in org.archive.wayback.accesscontrol.robotstxt used by org.archive.wayback.accesscontrol.robotstxt.redis

Class and Description
RobotExclusionFilter CaptureSearchResult Filter that uses a LiveWebCache to retrieve robots.txt documents from the live web, and filters SearchResults based on the rules therein.
RobotExclusionFilterFactory

Classes in org.archive.wayback.accesscontrol.robotstxt used by org.archive.wayback.webapp

Class and Description
RobotExclusionFilterFactory