org.dice_research.squirrel.queue

Interface UriQueue

All Known Subinterfaces:

IpAddressBasedQueue

All Known Implementing Classes:

AbstractIpAddressBasedQueue, InMemoryQueue

public interface UriQueue

Interface of a URI queue managing the URIs that should be crawled next.

Author:

Michael Röder (roeder@informatik.uni-leipzig.de)

Method Summary

Modifier and Type	Method and Description
void	addUri(CrawleableUri uri) Adds the given CrawleableUri instance to the queue.
void	close() Close RDB connection, destroy the database.
List<CrawleableUri>	getNextUris() Returns the next chunk of URIs that should be crawled or null.
boolean	isEmpty() Returns true is the queue is empty
void	open() Open RDB connection, init the database.

Method Detail

addUri

void addUri(CrawleableUri uri)

Adds the given CrawleableUri instance to the queue.

Parameters:

uri - the CrawleableUri instance that should be added to the queue.

getNextUris

List<CrawleableUri> getNextUris()

Returns the next chunk of URIs that should be crawled or null. Note that this method removes the URIs from the queue.

Returns:

the next chunk of URIs that should be crawled or null if no URIs are available

isEmpty

boolean isEmpty()

Returns true is the queue is empty

Returns:

close

void close()

Close RDB connection, destroy the database.

open

void open()

Open RDB connection, init the database.