edu.uci.ics.crawler4j.frontier

Class InProcessPagesDB

java.lang.Object

edu.uci.ics.crawler4j.frontier.WorkQueues

edu.uci.ics.crawler4j.frontier.InProcessPagesDB

public class InProcessPagesDB
extends WorkQueues

This class maintains the list of pages which are assigned to crawlers but are not yet processed. It is used for resuming a previous crawl.

Author:

Yasser Ganjisaffar

Field Summary

Fields inherited from class edu.uci.ics.crawler4j.frontier.WorkQueues

env, mutex, resumable, urlsDB, webURLBinding

Constructor Summary

Constructors

Constructor and Description
InProcessPagesDB(com.sleepycat.je.Environment env)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	removeURL(WebURL webUrl)

Methods inherited from class edu.uci.ics.crawler4j.frontier.WorkQueues

close, delete, get, getDatabaseEntryKey, getLength, put, sync

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InProcessPagesDB

public InProcessPagesDB(com.sleepycat.je.Environment env)
                 throws com.sleepycat.je.DatabaseException

Throws:

com.sleepycat.je.DatabaseException

Method Detail

removeURL

public boolean removeURL(WebURL webUrl)