org.archive.wayback.resourceindex.ziplines

Class HDFSBlockLoader

java.lang.Object

org.archive.wayback.resourceindex.ziplines.HDFSBlockLoader

All Implemented Interfaces:

BlockLoader

public class HDFSBlockLoader
extends Object
implements BlockLoader

Constructor Summary

Constructors

Constructor and Description
HDFSBlockLoader(String defaultFSURI)

Method Summary

Methods

Modifier and Type	Method and Description
void	finalize()
byte[]	getBlock(String url, long offset, int length) Fetch a range of bytes from a particular URL.
String	getDefaultFSURI()
void	init()
void	setDefaultFSURI(String defaultFSURI)

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HDFSBlockLoader

public HDFSBlockLoader(String defaultFSURI)

Method Detail

init

public void init()
          throws IOException,
                 URISyntaxException

Throws:

IOException

URISyntaxException

getBlock

public byte[] getBlock(String url,
              long offset,
              int length)
                throws IOException

Description copied from interface: BlockLoader

Fetch a range of bytes from a particular URL. Note that the bytes are read into memory all at once, so care should be taken with the length argument.

Specified by:

getBlock in interface BlockLoader

Parameters:

url - String URL to fetch

offset - byte start offset of the desired range

length - number of octets to fetch

Returns:

a new byte[] containing the octets fetched

Throws:

IOException - on Network and protocol failures, as well as Timeouts

getDefaultFSURI

public String getDefaultFSURI()

Returns:

the defaultFSURI

setDefaultFSURI

public void setDefaultFSURI(String defaultFSURI)

Parameters:

defaultFSURI - the defaultFSURI to set

finalize

public void finalize()

Overrides:

finalize in class Object