org.archive.cdxserver.processor

Class GroupCountProcessor

java.lang.Object

org.archive.cdxserver.processor.WrappedProcessor

org.archive.cdxserver.processor.GroupCountProcessor

All Implemented Interfaces:

BaseProcessor

public class GroupCountProcessor
extends WrappedProcessor

Field Summary

Fields

Modifier and Type	Field and Description
protected org.archive.format.cdx.CDXLine	deferWriteLine
static String	endtimestamp
static String	groupcount
protected boolean	lastLineSkipped
protected org.archive.format.cdx.CDXLine	lastReadLine
protected org.archive.format.cdx.CDXLine	prevReadLine
protected int	skipCount
static String	uniqcount
protected HashSet<Integer>	uniqDigestSet
protected boolean	writeLastTimestamp

Fields inherited from class org.archive.cdxserver.processor.WrappedProcessor

inner

Constructor Summary

Constructors

Constructor and Description
GroupCountProcessor(BaseProcessor base, boolean writeLastTimestamp, boolean writeUniqCount)

Method Summary

Methods

Modifier and Type	Method and Description
void	end() Called at the end.
org.archive.format.cdx.FieldSplitFormat	modifyOutputFormat(org.archive.format.cdx.FieldSplitFormat format) Return output format (list of fields), given input format format.
void	trackLine(org.archive.format.cdx.CDXLine cdxLine) Called on each CDX line, just before timestamp range filtering (to and from parameters), regexp filtering, and collapser processing.
protected int	writeDeferredLine()
int	writeLine(org.archive.format.cdx.CDXLine cdxLine) Process line.
void	writeResumeKey(String resumeKey) Write resumption key.

Methods inherited from class org.archive.cdxserver.processor.WrappedProcessor

begin

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

groupcount

public static final String groupcount

See Also:

Constant Field Values

endtimestamp

public static final String endtimestamp

See Also:

Constant Field Values

uniqcount

public static final String uniqcount

See Also:

Constant Field Values

prevReadLine

protected org.archive.format.cdx.CDXLine prevReadLine

lastReadLine

protected org.archive.format.cdx.CDXLine lastReadLine

deferWriteLine

protected org.archive.format.cdx.CDXLine deferWriteLine

lastLineSkipped

protected boolean lastLineSkipped

skipCount

protected int skipCount

writeLastTimestamp

protected boolean writeLastTimestamp

uniqDigestSet

protected HashSet<Integer> uniqDigestSet

Constructor Detail

GroupCountProcessor

public GroupCountProcessor(BaseProcessor base,
                   boolean writeLastTimestamp,
                   boolean writeUniqCount)

Method Detail

trackLine

public void trackLine(org.archive.format.cdx.CDXLine cdxLine)

Description copied from interface: BaseProcessor

Called on each CDX line, just before timestamp range filtering (to and from parameters), regexp filtering, and collapser processing. Typically used for counting the number of CDX lines collapsed / grouped.

Specified by:

trackLine in interface BaseProcessor

Overrides:

trackLine in class WrappedProcessor

Parameters:

cdxLine - CDX line

writeDeferredLine

protected int writeDeferredLine()

writeLine

public int writeLine(org.archive.format.cdx.CDXLine cdxLine)

Description copied from interface: BaseProcessor

Process line.

Specified by:

writeLine in interface BaseProcessor

Overrides:

writeLine in class WrappedProcessor

Parameters:

cdxLine - CDXLine

Returns:

1 if line is sent to output, 0 otherwise.

modifyOutputFormat

public org.archive.format.cdx.FieldSplitFormat modifyOutputFormat(org.archive.format.cdx.FieldSplitFormat format)

Description copied from interface: BaseProcessor

Return output format (list of fields), given input format format. Intermediaries should call modifyOutputFormat(format) on nested processor first, then make appropriate changes to it if they add/remove fields.

Specified by:

modifyOutputFormat in interface BaseProcessor

Overrides:

modifyOutputFormat in class WrappedProcessor

Parameters:

format - input format

Returns:

output format

See Also:

CDXFieldConstants

writeResumeKey

public void writeResumeKey(String resumeKey)

Description copied from interface: BaseProcessor

Write resumption key. Only the final CDXWriter should do actual work. All intermediaries shall simply call writeResumeKey(resumeKey) on nested processor.

Specified by:

writeResumeKey in interface BaseProcessor

Overrides:

writeResumeKey in class WrappedProcessor

end

public void end()

Description copied from interface: BaseProcessor

Called at the end. Perform any clean ups / finalizations here. Intermediaries processor should call end() on nested processor.

Specified by:

end in interface BaseProcessor

Overrides:

end in class WrappedProcessor