org.dice_research.topicmodeling.io.json

Class JsonBasedCorpusPartWriter

java.lang.Object

org.dice_research.topicmodeling.io.json.JsonBasedCorpusPartWriter

All Implemented Interfaces:

Closeable, AutoCloseable, Consumer<org.dice_research.topicmodeling.utils.doc.Document>, org.dice_research.topicmodeling.preprocessing.docconsumer.DocumentConsumer

public class JsonBasedCorpusPartWriter
extends Object
implements org.dice_research.topicmodeling.preprocessing.docconsumer.DocumentConsumer, Closeable

Field Summary

Fields

Modifier and Type	Field and Description
private int	currentPartDocCount
private int	currentPartId
private JsonWritingDocumentConsumer	currentWriter
private int	documentPerPart
private static org.slf4j.Logger	LOGGER
private File	outputFolder
static String	PART_FILE_PREFIX
static String	PART_FILE_SUFFIX

Constructor Summary

Constructors

Constructor and Description
JsonBasedCorpusPartWriter(File outputFolder, int documentPerPart)
JsonBasedCorpusPartWriter(File outputFolder, int documentPerPart, int firstPartId)

Method Summary

Modifier and Type	Method and Description
void	close()
void	consumeDocument(org.dice_research.topicmodeling.utils.doc.Document document)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dice_research.topicmodeling.preprocessing.docconsumer.DocumentConsumer

accept

Methods inherited from interface java.util.function.Consumer

andThen

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

PART_FILE_PREFIX

public static final String PART_FILE_PREFIX

See Also:

Constant Field Values

PART_FILE_SUFFIX

public static final String PART_FILE_SUFFIX

See Also:

Constant Field Values

outputFolder

private final File outputFolder

documentPerPart

private final int documentPerPart

currentPartDocCount

private int currentPartDocCount

currentPartId

private int currentPartId

currentWriter

private JsonWritingDocumentConsumer currentWriter

Constructor Detail

JsonBasedCorpusPartWriter

public JsonBasedCorpusPartWriter(File outputFolder,
                                 int documentPerPart)

JsonBasedCorpusPartWriter

public JsonBasedCorpusPartWriter(File outputFolder,
                                 int documentPerPart,
                                 int firstPartId)

Method Detail

consumeDocument

public void consumeDocument(org.dice_research.topicmodeling.utils.doc.Document document)

Specified by:

consumeDocument in interface org.dice_research.topicmodeling.preprocessing.docconsumer.DocumentConsumer

close

public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable