org.archive.wayback.resourceindex

Class ZipNumClusterSearchResultSource

java.lang.Object

org.archive.wayback.resourceindex.ZipNumClusterSearchResultSource

All Implemented Interfaces:

SearchResultSource, Adapter<String,CaptureSearchResult>

public class ZipNumClusterSearchResultSource
extends Object
implements SearchResultSource, Adapter<String,CaptureSearchResult>

SearchResultSource wrapper for new implementation of CDX input source, including ZipNumCluster and CDX File from archive-commons

Author:

ilya

Field Summary

Fields

Modifier and Type	Field and Description
protected org.archive.format.gzip.zipnum.ZipNumCluster	cluster
protected List<String>	ignoreRobotPaths
protected org.archive.format.gzip.zipnum.ZipNumParams	oneBlockParams
protected org.archive.format.gzip.zipnum.ZipNumParams	params
protected int	timestampDedupLength

Constructor Summary

Constructors

Constructor and Description
ZipNumClusterSearchResultSource()

Method Summary

Methods

Modifier and Type	Method and Description
CaptureSearchResult	adapt(String line) Transform one object into another
void	cleanup(org.archive.util.iterator.CloseableIterator<CaptureSearchResult> c)
org.archive.format.gzip.zipnum.ZipNumCluster	getCluster()
List<String>	getIgnoreRobotPaths()
org.archive.format.gzip.zipnum.ZipNumParams	getParams()
org.archive.util.iterator.CloseableIterator<CaptureSearchResult>	getPrefixIterator(String urlkey)
org.archive.util.iterator.CloseableIterator<CaptureSearchResult>	getPrefixReverseIterator(String prefix)
int	getTimestampDedupLength()
void	init()
void	setCluster(org.archive.format.gzip.zipnum.ZipNumCluster cluster)
void	setIgnoreRobotPaths(List<String> ignoreRobotPaths)
void	setParams(org.archive.format.gzip.zipnum.ZipNumParams params)
void	setTimestampDedupLength(int timestampDedupLength)
void	shutdown()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

cluster

protected org.archive.format.gzip.zipnum.ZipNumCluster cluster

params

protected org.archive.format.gzip.zipnum.ZipNumParams params

oneBlockParams

protected org.archive.format.gzip.zipnum.ZipNumParams oneBlockParams

timestampDedupLength

protected int timestampDedupLength

ignoreRobotPaths

protected List<String> ignoreRobotPaths

Constructor Detail

ZipNumClusterSearchResultSource

public ZipNumClusterSearchResultSource()

Method Detail

init

public void init()
          throws IOException

Throws:

IOException

getPrefixIterator

public org.archive.util.iterator.CloseableIterator<CaptureSearchResult> getPrefixIterator(String urlkey)
                                                                                   throws ResourceIndexNotAvailableException

Specified by:

getPrefixIterator in interface SearchResultSource

Returns:

CleanableIterator that will return SearchResults beginning with prefix argument, with subsequent next() calls returning subsequent results.

Throws:

ResourceIndexNotAvailableException

getPrefixReverseIterator

public org.archive.util.iterator.CloseableIterator<CaptureSearchResult> getPrefixReverseIterator(String prefix)
                                                                                          throws ResourceIndexNotAvailableException

Specified by:

getPrefixReverseIterator in interface SearchResultSource

Returns:

CleanableIterator that will return SearchResults starting *before* prefix argument, with subsequent next() calls returning previous results.

Throws:

ResourceIndexNotAvailableException

cleanup

public void cleanup(org.archive.util.iterator.CloseableIterator<CaptureSearchResult> c)
             throws IOException

Specified by:

cleanup in interface SearchResultSource

Throws:

IOException

shutdown

public void shutdown()
              throws IOException

Specified by:

shutdown in interface SearchResultSource

Throws:

IOException

getCluster

public org.archive.format.gzip.zipnum.ZipNumCluster getCluster()

setCluster

public void setCluster(org.archive.format.gzip.zipnum.ZipNumCluster cluster)

getParams

public org.archive.format.gzip.zipnum.ZipNumParams getParams()

setParams

public void setParams(org.archive.format.gzip.zipnum.ZipNumParams params)

adapt

public CaptureSearchResult adapt(String line)

Description copied from interface: Adapter

Transform one object into another

Specified by:

adapt in interface Adapter<String,CaptureSearchResult>

Returns:

new object that is adapted from the old

getIgnoreRobotPaths

public List<String> getIgnoreRobotPaths()

setIgnoreRobotPaths

public void setIgnoreRobotPaths(List<String> ignoreRobotPaths)

getTimestampDedupLength

public int getTimestampDedupLength()

setTimestampDedupLength

public void setTimestampDedupLength(int timestampDedupLength)