Uses of Class
edu.uci.ics.crawler4j.url.WebURL

Packages that use WebURL

Package	Description
edu.uci.ics.crawler4j.crawler
edu.uci.ics.crawler4j.fetcher
edu.uci.ics.crawler4j.frontier
edu.uci.ics.crawler4j.parser
edu.uci.ics.crawler4j.robotstxt

Uses of WebURL in edu.uci.ics.crawler4j.crawler

Fields in edu.uci.ics.crawler4j.crawler declared as WebURL

Modifier and Type	Field and Description
protected WebURL	Page.url The URL of this page.

Methods in edu.uci.ics.crawler4j.crawler that return WebURL

Modifier and Type	Method and Description
WebURL	Page.getWebURL()

Methods in edu.uci.ics.crawler4j.crawler with parameters of type WebURL

Modifier and Type	Method and Description
protected void	WebCrawler.handlePageStatusCode(WebURL webUrl, int statusCode, String statusDescription) This function is called once the header of a page is fetched.
protected void	WebCrawler.onContentFetchError(WebURL webUrl) This function is called if the content of a url could not be fetched.
protected void	WebCrawler.onParseError(WebURL webUrl) This function is called if there has been an error in parsing the content.
void	Page.setWebURL(WebURL url)
boolean	WebCrawler.shouldVisit(WebURL url) Classes that extends WebCrawler can overwrite this function to tell the crawler whether the given url should be crawled or not.

Constructors in edu.uci.ics.crawler4j.crawler with parameters of type WebURL

Constructor and Description
Page(WebURL url)

Uses of WebURL in edu.uci.ics.crawler4j.fetcher

Methods in edu.uci.ics.crawler4j.fetcher with parameters of type WebURL

Modifier and Type	Method and Description
PageFetchResult	PageFetcher.fetchHeader(WebURL webUrl)

Uses of WebURL in edu.uci.ics.crawler4j.frontier

Methods in edu.uci.ics.crawler4j.frontier that return WebURL

Modifier and Type	Method and Description
WebURL	WebURLTupleBinding.entryToObject(com.sleepycat.bind.tuple.TupleInput input)

Methods in edu.uci.ics.crawler4j.frontier that return types with arguments of type WebURL

Modifier and Type	Method and Description
List<WebURL>	WorkQueues.get(int max)

Methods in edu.uci.ics.crawler4j.frontier with parameters of type WebURL

Modifier and Type	Method and Description
protected com.sleepycat.je.DatabaseEntry	WorkQueues.getDatabaseEntryKey(WebURL url)
void	WebURLTupleBinding.objectToEntry(WebURL url, com.sleepycat.bind.tuple.TupleOutput output)
void	WorkQueues.put(WebURL url)
boolean	InProcessPagesDB.removeURL(WebURL webUrl)
void	Frontier.schedule(WebURL url)
void	Frontier.setProcessed(WebURL webURL)

Method parameters in edu.uci.ics.crawler4j.frontier with type arguments of type WebURL

Modifier and Type	Method and Description
void	Frontier.getNextURLs(int max, List<WebURL> result)
void	Frontier.scheduleAll(List<WebURL> urls)

Uses of WebURL in edu.uci.ics.crawler4j.parser

Methods in edu.uci.ics.crawler4j.parser that return types with arguments of type WebURL

Modifier and Type	Method and Description
List<WebURL>	HtmlParseData.getOutgoingUrls()

Method parameters in edu.uci.ics.crawler4j.parser with type arguments of type WebURL

Modifier and Type	Method and Description
void	HtmlParseData.setOutgoingUrls(List<WebURL> outgoingUrls)

Uses of WebURL in edu.uci.ics.crawler4j.robotstxt

Methods in edu.uci.ics.crawler4j.robotstxt with parameters of type WebURL

Modifier and Type	Method and Description
boolean	RobotstxtServer.allows(WebURL webURL)