org.dice_research.squirrel.data.uri.filter

Class AbstractKnownUriFilterDecorator

java.lang.Object

org.dice_research.squirrel.data.uri.filter.AbstractKnownUriFilterDecorator

All Implemented Interfaces:

Closeable, AutoCloseable, KnownUriFilter, KnownUriFilterDecorator, UriFilter

public abstract class AbstractKnownUriFilterDecorator
extends Object
implements KnownUriFilterDecorator

Field Summary

Fields

Modifier and Type	Field and Description
protected KnownUriFilter	decorated

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractKnownUriFilterDecorator()
	AbstractKnownUriFilterDecorator(KnownUriFilter decorated)

Method Summary

Modifier and Type	Method and Description
void	add(CrawleableUri uri, long nextCrawlTimestamp) Adds the given URI to the list of already known URIs.
void	add(CrawleableUri uri, long lastCrawlTimestamp, long nextCrawlTimestamp) Adds the given URI to the list of already known URIs together with the the time at which it has been crawled.
void	close()
long	count() count the numbers of known URIs
KnownUriFilter	getDecorated()
List<CrawleableUri>	getOutdatedUris() Returns all CrawleableUris which have to be recrawled.
boolean	isUriGood(CrawleableUri uri) Returns true if the given CrawleableUri object fulfills the requirements imposed by this filter.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

decorated

protected KnownUriFilter decorated

Constructor Detail

AbstractKnownUriFilterDecorator

protected AbstractKnownUriFilterDecorator()

AbstractKnownUriFilterDecorator

public AbstractKnownUriFilterDecorator(KnownUriFilter decorated)

Method Detail

add

public void add(CrawleableUri uri,
                long nextCrawlTimestamp)

Description copied from interface: KnownUriFilter

Adds the given URI to the list of already known URIs. Works like calling KnownUriFilter.add(CrawleableUri, long) with the current system time.

Specified by:

add in interface KnownUriFilter

Parameters:

uri - the URI that should be added to the list.

nextCrawlTimestamp - The time at which the given URI should be crawled next.

add

public void add(CrawleableUri uri,
                long lastCrawlTimestamp,
                long nextCrawlTimestamp)

Description copied from interface: KnownUriFilter

Adds the given URI to the list of already known URIs together with the the time at which it has been crawled.

Specified by:

add in interface KnownUriFilter

Parameters:

uri - the URI that should be added to the list.

lastCrawlTimestamp - the time at which the given URI has eben crawled.

nextCrawlTimestamp - The time at which the given URI should be crawled next.

getOutdatedUris

public List<CrawleableUri> getOutdatedUris()

Description copied from interface: KnownUriFilter

Returns all CrawleableUris which have to be recrawled. This means their time to next crawl has passed.

Specified by:

getOutdatedUris in interface KnownUriFilter

Returns:

The outdated CrawleableUris.

count

public long count()

Description copied from interface: KnownUriFilter

count the numbers of known URIs

Specified by:

count in interface KnownUriFilter

Returns:

the number of lines in that database

isUriGood

public boolean isUriGood(CrawleableUri uri)

Description copied from interface: UriFilter

Returns true if the given CrawleableUri object fulfills the requirements imposed by this filter.

Specified by:

isUriGood in interface UriFilter

Parameters:

uri - the CrawleableUri object that is checked

Returns:

true if the given CrawleableUri object fulfills the requirements imposed by this filter. Otherwise false is returned.

getDecorated

public KnownUriFilter getDecorated()

Specified by:

getDecorated in interface KnownUriFilterDecorator

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException