org.dice_research.squirrel.queue

Class InMemoryQueue

java.lang.Object

org.dice_research.squirrel.queue.AbstractIpAddressBasedQueue

org.dice_research.squirrel.queue.InMemoryQueue

All Implemented Interfaces:

IpAddressBasedQueue, UriQueue

public class InMemoryQueue
extends AbstractIpAddressBasedQueue

Field Summary

Fields

Modifier and Type	Field and Description
private static int	LIMITFORITERATOR
protected SortedMap<IpUriTypePair,List<CrawleableUri>>	queue

Constructor Summary

Constructors

Constructor and Description
InMemoryQueue()
InMemoryQueue(Comparator<IpUriTypePair> comparator)

Method Summary

Modifier and Type	Method and Description
protected void	addToQueue(CrawleableUri uri)
void	close() Close RDB connection, destroy the database.
Iterator<AbstractMap.SimpleEntry<InetAddress,List<CrawleableUri>>>	getIPURIIterator() Goes through the queue und collects all IP-address with their URIs
protected Iterator<IpUriTypePair>	getIterator()
protected List<CrawleableUri>	getUris(IpUriTypePair pair)
boolean	isEmpty() Returns true is the queue is empty
void	open() Open RDB connection, init the database.

Methods inherited from class org.dice_research.squirrel.queue.AbstractIpAddressBasedQueue

addUri, getNextUris, getNumberOfBlockedIps, markIpAddressAsAccessible

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

queue

protected SortedMap<IpUriTypePair,List<CrawleableUri>> queue

LIMITFORITERATOR

private static final int LIMITFORITERATOR

See Also:

Constant Field Values

Constructor Detail

InMemoryQueue

public InMemoryQueue()

InMemoryQueue

public InMemoryQueue(Comparator<IpUriTypePair> comparator)

Method Detail

addToQueue

protected void addToQueue(CrawleableUri uri)

Specified by:

addToQueue in class AbstractIpAddressBasedQueue

getIterator

protected Iterator<IpUriTypePair> getIterator()

Specified by:

getIterator in class AbstractIpAddressBasedQueue

getUris

protected List<CrawleableUri> getUris(IpUriTypePair pair)

Specified by:

getUris in class AbstractIpAddressBasedQueue

open

public void open()

Description copied from interface: UriQueue

Open RDB connection, init the database.

close

public void close()

Description copied from interface: UriQueue

Close RDB connection, destroy the database.

getIPURIIterator

public Iterator<AbstractMap.SimpleEntry<InetAddress,List<CrawleableUri>>> getIPURIIterator()

Description copied from interface: IpAddressBasedQueue

Goes through the queue und collects all IP-address with their URIs

Returns:

a IP-address-iterator with the list of uris for each IP-address

isEmpty

public boolean isEmpty()

Description copied from interface: UriQueue

Returns true is the queue is empty

Returns: