| Package | Description |
|---|---|
| org.dice_research.squirrel.data.uri | |
| org.dice_research.squirrel.data.uri.filter |
| Modifier and Type | Field and Description |
|---|---|
protected UriFilter[] |
CrawleableUriFactoryImpl.filters
URI filters applied to the URIs during the generation.
|
| Constructor and Description |
|---|
CrawleableUriFactoryImpl(UriFilter... filters)
Constructor taking additional filters that are used to check URIs during
the creation.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
KnownUriFilter
A
UriFilter that works like a blacklist filter and contains only those
URIs on its blacklist that the crawler already has seen before. |
interface |
KnownUriFilterDecorator |
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractKnownUriFilterDecorator |
class |
InMemoryKnownUriFilter
A simple in-memory implementation of the
KnownUriFilter interface. |
Copyright © 2017–2019. All rights reserved.