org.archive.wayback.accesscontrol.robotstxt.redis

Class SimpleRedisRobotsCache

java.lang.Object

org.archive.wayback.accesscontrol.robotstxt.redis.SimpleRedisRobotsCache

All Implemented Interfaces:

LiveWebCache

Direct Known Subclasses:

RedisRefresher

public class SimpleRedisRobotsCache
extends Object
implements LiveWebCache

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	gzipRobots
protected LiveWebCache	liveweb
protected RedisRobotsLogic	redisCmds

Constructor Summary

Constructors

Constructor and Description
SimpleRedisRobotsCache()

Method Summary

Methods

Modifier and Type	Method and Description
org.archive.wayback.accesscontrol.robotstxt.redis.SimpleRedisRobotsCache.RobotsResult	forceUpdate(String url, int minUpdateTime, boolean cacheFails)
Resource	getCachedResource(URL urlURL, long maxCacheMS, boolean bUseOlder) Fetch a Resource from the live web, or from a cache of the live web.
LiveWebCache	getLiveweb()
boolean	isExpired(org.archive.wayback.accesscontrol.robotstxt.redis.RedisRobotsLogic.RedisValue value, String url, int customRefreshTime)
boolean	isGzipRobots()
protected boolean	isValidRobots(String value)
protected org.archive.wayback.accesscontrol.robotstxt.redis.SimpleRedisRobotsCache.RobotsResult	loadExternal(URL urlURL, long maxCacheMS, boolean bUseOlder)
void	setGzipRobots(boolean gzipRobots)
void	setLiveweb(LiveWebCache liveweb)
void	setRedisConnMan(RedisConnectionManager redisConn)
void	shutdown() closes all resources
protected void	updateCache(String contents, String url, String current, int status, boolean cacheFails)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

redisCmds

protected RedisRobotsLogic redisCmds

liveweb

protected LiveWebCache liveweb

gzipRobots

protected boolean gzipRobots

Constructor Detail

SimpleRedisRobotsCache

public SimpleRedisRobotsCache()

Method Detail

getCachedResource

public Resource getCachedResource(URL urlURL,
                         long maxCacheMS,
                         boolean bUseOlder)
                           throws LiveDocumentNotAvailableException,
                                  LiveWebCacheUnavailableException,
                                  LiveWebTimeoutException,
                                  IOException

Description copied from interface: LiveWebCache

Fetch a Resource from the live web, or from a cache of the live web.

Specified by:

getCachedResource in interface LiveWebCache

Parameters:

urlURL - to fetch from the live web.

maxCacheMS - maximum age of resource to return - optionally honored

bUseOlder - if true, return documents older than maxCacheMS if a more recent copy is not available.

Returns:

Resource for url

Throws:

LiveDocumentNotAvailableException - if the resource cannot be retrieved from the live web, but all proxying and caching mechanisms functioned properly

LiveWebCacheUnavailableException - if there was a problem either accessing the live web, in proxying to the live web, or in maintaining the cache for the live web

LiveWebTimeoutException - if there is no response from the live web cache before a timeout occurred.

IOException - for the usual reasons

shutdown

public void shutdown()

Description copied from interface: LiveWebCache

closes all resources

Specified by:

shutdown in interface LiveWebCache

isExpired

public boolean isExpired(org.archive.wayback.accesscontrol.robotstxt.redis.RedisRobotsLogic.RedisValue value,
                String url,
                int customRefreshTime)

loadExternal

protected org.archive.wayback.accesscontrol.robotstxt.redis.SimpleRedisRobotsCache.RobotsResult loadExternal(URL urlURL,
                                                                                                 long maxCacheMS,
                                                                                                 boolean bUseOlder)

updateCache

protected void updateCache(String contents,
               String url,
               String current,
               int status,
               boolean cacheFails)

isValidRobots

protected boolean isValidRobots(String value)

forceUpdate

public org.archive.wayback.accesscontrol.robotstxt.redis.SimpleRedisRobotsCache.RobotsResult forceUpdate(String url,
                                                                                                int minUpdateTime,
                                                                                                boolean cacheFails)

setRedisConnMan

public void setRedisConnMan(RedisConnectionManager redisConn)

getLiveweb

public LiveWebCache getLiveweb()

setLiveweb

public void setLiveweb(LiveWebCache liveweb)

isGzipRobots

public boolean isGzipRobots()

setGzipRobots

public void setGzipRobots(boolean gzipRobots)