org.dice_research.topicmodeling.preprocessing

Class StreamedFileBasedCorpusCreatingPreprocessor

java.lang.Object

org.dice_research.topicmodeling.preprocessing.StreamedFileBasedCorpusCreatingPreprocessor

All Implemented Interfaces:

org.dice_research.topicmodeling.preprocessing.Preprocessor

public class StreamedFileBasedCorpusCreatingPreprocessor
extends Object
implements org.dice_research.topicmodeling.preprocessing.Preprocessor

Field Summary

Fields

Modifier and Type	Field and Description
protected StreamedFileBasedCorpus	corpus
protected boolean	corpusCreated
protected File	corpusFile
private static org.slf4j.Logger	LOGGER
private org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier	supplier

Constructor Summary

Constructors

Constructor and Description
StreamedFileBasedCorpusCreatingPreprocessor(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier supplier, File corpusFile)

Method Summary

Modifier and Type	Method and Description
void	addDocuments(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentFactory) Deprecated.
void	deleteCorpus()
protected void	generateCorpus()
org.dice_research.topicmodeling.utils.corpus.Corpus	getCorpus()
boolean	hasCorpus()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

supplier

private org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier supplier

corpus

protected StreamedFileBasedCorpus corpus

corpusCreated

protected boolean corpusCreated

corpusFile

protected File corpusFile

Constructor Detail

StreamedFileBasedCorpusCreatingPreprocessor

public StreamedFileBasedCorpusCreatingPreprocessor(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier supplier,
                                                   File corpusFile)

Method Detail

addDocuments

@Deprecated
public void addDocuments(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentFactory)

Deprecated.

Specified by:

addDocuments in interface org.dice_research.topicmodeling.preprocessing.Preprocessor

getCorpus

public org.dice_research.topicmodeling.utils.corpus.Corpus getCorpus()

Specified by:

getCorpus in interface org.dice_research.topicmodeling.preprocessing.Preprocessor

generateCorpus

protected void generateCorpus()

hasCorpus

public boolean hasCorpus()

Specified by:

hasCorpus in interface org.dice_research.topicmodeling.preprocessing.Preprocessor

deleteCorpus

public void deleteCorpus()

Specified by:

deleteCorpus in interface org.dice_research.topicmodeling.preprocessing.Preprocessor