Package | Description |
---|---|
org.archive.wayback.accesscontrol.robotstxt | |
org.archive.wayback.accesscontrol.robotstxt.redis | |
org.archive.wayback.liveweb | |
org.archive.wayback.webapp |
Modifier and Type | Method and Description |
---|---|
LiveWebCache |
RobotExclusionFilter.getWebCache() |
LiveWebCache |
RobotExclusionFilterFactory.getWebCache() |
Modifier and Type | Method and Description |
---|---|
void |
RobotExclusionFilterFactory.setWebCache(LiveWebCache webCache) |
Constructor and Description |
---|
HRobotExclusionFilter(LiveWebCache webCache,
String userAgent,
long maxCacheMS)
Construct a new HRobotExclusionFilter that uses webCache to pull
robots.txt documents. filtering is based on userAgent, and cached
documents newer than maxCacheMS in the webCache are considered valid.
|
RobotExclusionFilter(LiveWebCache webCache,
String userAgent,
long maxCacheMS)
Construct a new RobotExclusionFilter that uses webCache to pull
robots.txt documents. filtering is based on userAgent, and cached
documents newer than maxCacheMS in the webCache are considered valid.
|
Modifier and Type | Class and Description |
---|---|
class |
RedisRefresher |
class |
SimpleRedisRobotsCache |
Modifier and Type | Field and Description |
---|---|
protected LiveWebCache |
SimpleRedisRobotsCache.liveweb |
Modifier and Type | Method and Description |
---|---|
LiveWebCache |
SimpleRedisRobotsCache.getLiveweb() |
Modifier and Type | Method and Description |
---|---|
void |
SimpleRedisRobotsCache.setLiveweb(LiveWebCache liveweb) |
Constructor and Description |
---|
RedisRobotExclusionFilter(LiveWebCache redisCache,
String userAgent,
boolean cacheFails) |
Modifier and Type | Class and Description |
---|---|
class |
LiveRobotsNoCache |
class |
RemoteLiveWebCache |
Modifier and Type | Method and Description |
---|---|
LiveWebCache |
LiveWebAccessPoint.getCache() |
Modifier and Type | Method and Description |
---|---|
void |
LiveWebAccessPoint.setCache(LiveWebCache cache) |
Copyright © 2005–2015 IIPC. All rights reserved.