org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.splitter

Class PatternBasedDocumentTextSplitter<T extends org.dice_research.topicmodeling.utils.doc.StringContainingDocumentProperty>

java.lang.Object

org.dice_research.topicmodeling.preprocessing.docsupplier.AbstractDocumentSupplier

org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.splitter.AbstractSplittingDocumentSupplierDecorator

org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.splitter.PatternBasedDocumentTextSplitter<T>

All Implemented Interfaces:

DocumentSupplierDecorator, org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier

public class PatternBasedDocumentTextSplitter<T extends org.dice_research.topicmodeling.utils.doc.StringContainingDocumentProperty>
extends AbstractSplittingDocumentSupplierDecorator

Field Summary

Fields

Modifier and Type	Field and Description
private static org.slf4j.Logger	LOGGER
private Class<T>	propertyClass
private Constructor<T>	propertyConstructor
private String	splitPattern
private boolean	trimSplittedParts

Fields inherited from class org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.splitter.AbstractSplittingDocumentSupplierDecorator

documentSource, queue

Fields inherited from class org.dice_research.topicmodeling.preprocessing.docsupplier.AbstractDocumentSupplier

nextDocumentId

Constructor Summary

Constructors

Constructor and Description
PatternBasedDocumentTextSplitter(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource, Class<T> propertyClass, String splitPattern)
PatternBasedDocumentTextSplitter(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource, Class<T> propertyClass, String splitPattern, boolean trimSplittedParts)

Method Summary

Modifier and Type	Method and Description
private org.dice_research.topicmodeling.utils.doc.Document	createDocument(String value, org.dice_research.topicmodeling.utils.doc.Document document)
boolean	isTrimSplittedParts()
void	setTrimSplittedParts(boolean trimSplittedParts)
protected void	splitDocument(org.dice_research.topicmodeling.utils.doc.Document document) In this method the splitter should split up the given document and add all new documents to the AbstractSplittingDocumentSupplierDecorator.queue.

Methods inherited from class org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.splitter.AbstractSplittingDocumentSupplierDecorator

addToQueue, getDecoratedDocumentSupplier, getNextDocument, setDecoratedDocumentSupplier

Methods inherited from class org.dice_research.topicmodeling.preprocessing.docsupplier.AbstractDocumentSupplier

getNextDocumentId, setDocumentStartId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier

convertToStream, setDocumentStartId

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

splitPattern

private String splitPattern

propertyClass

private Class<T extends org.dice_research.topicmodeling.utils.doc.StringContainingDocumentProperty> propertyClass

propertyConstructor

private Constructor<T extends org.dice_research.topicmodeling.utils.doc.StringContainingDocumentProperty> propertyConstructor

trimSplittedParts

private boolean trimSplittedParts

Constructor Detail

PatternBasedDocumentTextSplitter

public PatternBasedDocumentTextSplitter(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource,
                                        Class<T> propertyClass,
                                        String splitPattern)

PatternBasedDocumentTextSplitter

public PatternBasedDocumentTextSplitter(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource,
                                        Class<T> propertyClass,
                                        String splitPattern,
                                        boolean trimSplittedParts)

Method Detail

isTrimSplittedParts

public boolean isTrimSplittedParts()

setTrimSplittedParts

public void setTrimSplittedParts(boolean trimSplittedParts)

splitDocument

protected void splitDocument(org.dice_research.topicmodeling.utils.doc.Document document)

Description copied from class: AbstractSplittingDocumentSupplierDecorator

In this method the splitter should split up the given document and add all new documents to the AbstractSplittingDocumentSupplierDecorator.queue.

Specified by:

splitDocument in class AbstractSplittingDocumentSupplierDecorator

createDocument

private org.dice_research.topicmodeling.utils.doc.Document createDocument(String value,
                                                                          org.dice_research.topicmodeling.utils.doc.Document document)