org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.ner.filter

Class NamedEntityFilteringSupplierDecorator

java.lang.Object

org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.AbstractDocumentSupplierDecorator

org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.ner.filter.NamedEntityFilteringSupplierDecorator

All Implemented Interfaces:

Function<org.dice_research.topicmodeling.utils.doc.Document,org.dice_research.topicmodeling.utils.doc.Document>, DocumentSupplierDecorator, org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier

public class NamedEntityFilteringSupplierDecorator
extends AbstractDocumentSupplierDecorator

Field Summary

Fields

Modifier and Type	Field and Description
private boolean	discardDocumentsWithoutNEs
private NamedEntitiesFilter	filter

Fields inherited from class org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.AbstractDocumentSupplierDecorator

documentSource

Constructor Summary

Constructors

Constructor and Description
NamedEntityFilteringSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource, NamedEntitiesFilter filter)
NamedEntityFilteringSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource, NamedEntitiesFilter filter, boolean discardDocumentsWithoutNEs)

Method Summary

Modifier and Type	Method and Description
private org.dice_research.topicmodeling.utils.doc.ner.NamedEntitiesInText	filterEntities(org.dice_research.topicmodeling.utils.doc.ner.NamedEntitiesInText entities, org.dice_research.topicmodeling.utils.doc.Document document)
protected org.dice_research.topicmodeling.utils.doc.Document	prepareDocument(org.dice_research.topicmodeling.utils.doc.Document document)

Methods inherited from class org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.AbstractDocumentSupplierDecorator

apply, getDecoratedDocumentSupplier, getNextDocument, setDecoratedDocumentSupplier, setDocumentStartId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier

convertToStream

Methods inherited from interface java.util.function.Function

andThen, compose, identity

Field Detail

filter

private NamedEntitiesFilter filter

discardDocumentsWithoutNEs

private boolean discardDocumentsWithoutNEs

Constructor Detail

NamedEntityFilteringSupplierDecorator

public NamedEntityFilteringSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource,
                                             NamedEntitiesFilter filter)

NamedEntityFilteringSupplierDecorator

public NamedEntityFilteringSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource,
                                             NamedEntitiesFilter filter,
                                             boolean discardDocumentsWithoutNEs)

Method Detail

prepareDocument

protected org.dice_research.topicmodeling.utils.doc.Document prepareDocument(org.dice_research.topicmodeling.utils.doc.Document document)

Specified by:

prepareDocument in class AbstractDocumentSupplierDecorator

filterEntities

private org.dice_research.topicmodeling.utils.doc.ner.NamedEntitiesInText filterEntities(org.dice_research.topicmodeling.utils.doc.ner.NamedEntitiesInText entities,
                                                                                         org.dice_research.topicmodeling.utils.doc.Document document)