edu.uci.ics.crawler4j.robotstxt

Class HostDirectives

java.lang.Object

edu.uci.ics.crawler4j.robotstxt.HostDirectives

public class HostDirectives
extends Object

Author:

Yasser Ganjisaffar

Constructor Summary

Constructors

Constructor and Description
HostDirectives()

Method Summary

Methods

Modifier and Type	Method and Description
void	addAllow(String path)
void	addDisallow(String path)
boolean	allows(String path)
long	getLastAccessTime()
boolean	needsRefetch()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HostDirectives

public HostDirectives()

Method Detail

needsRefetch

public boolean needsRefetch()

allows

public boolean allows(String path)

addDisallow

public void addDisallow(String path)

addAllow

public void addAllow(String path)

getLastAccessTime

public long getLastAccessTime()