org.dice_research.squirrel.deduplication.hashing

Interface UriHashCustodian

public interface UriHashCustodian

This component maintains HashValues for uris. It provides methods for getting uris with some desired hash values, and also for adding hash values for given uris. The idea is that hash values could be stored in the KnownUriFilter, as well as in the TripleBasedSink.

Method Summary

Modifier and Type	Method and Description
void	addHashValuesForUris(List<CrawleableUri> uris) Add the given hash values for the given uris.
Set<CrawleableUri>	getUrisWithSameHashValues(Set<HashValue> hashValuesForComparison) Get all uris that have a common hash value with one of the hash values of the given set.

Method Detail

getUrisWithSameHashValues

Set<CrawleableUri> getUrisWithSameHashValues(Set<HashValue> hashValuesForComparison)

Get all uris that have a common hash value with one of the hash values of the given set.

Parameters:

hashValuesForComparison - The given set of hash values.

Returns:

All uris that have a common hash value with one of the hash values of the given list.

addHashValuesForUris

void addHashValuesForUris(List<CrawleableUri> uris)

Add the given hash values for the given uris. Hash values are contained in the uris.

Parameters:

uris - The given uris.