org.dice_research.topicmodeling.wikipedia

Class WikipediaMarkupDeletingDocumentSupplierDecorator

java.lang.Object

org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.AbstractDocumentSupplierDecorator

org.dice_research.topicmodeling.wikipedia.WikipediaMarkupDeletingDocumentSupplierDecorator

All Implemented Interfaces:

Function<org.dice_research.topicmodeling.utils.doc.Document,org.dice_research.topicmodeling.utils.doc.Document>, org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.DocumentSupplierDecorator, org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier

public class WikipediaMarkupDeletingDocumentSupplierDecorator
extends org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.AbstractDocumentSupplierDecorator

Field Summary

Fields

Modifier and Type	Field and Description
private boolean	keepTableContents
private static org.slf4j.Logger	LOGGER
private boolean	removeCategoryLinks

Fields inherited from class org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.AbstractDocumentSupplierDecorator

documentSource

Constructor Summary

Constructors

Constructor and Description
WikipediaMarkupDeletingDocumentSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource)
WikipediaMarkupDeletingDocumentSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource, boolean removeCategoryLinks)
WikipediaMarkupDeletingDocumentSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource, boolean removeCategoryLinks, boolean keepTableContents)

Method Summary

Modifier and Type	Method and Description
StackBasedMarkupDeletingMachine	createDeleter()
org.dice_research.topicmodeling.utils.doc.Document	prepareDocument(org.dice_research.topicmodeling.utils.doc.Document document)
void	setKeepTableContents(boolean keepTableContents)
void	setRemoveCategoryLinks(boolean removeCategoryLinks)

Methods inherited from class org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.AbstractDocumentSupplierDecorator

apply, getDecoratedDocumentSupplier, getNextDocument, setDecoratedDocumentSupplier, setDocumentStartId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier

convertToStream

Methods inherited from interface java.util.function.Function

andThen, compose, identity

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

removeCategoryLinks

private boolean removeCategoryLinks

keepTableContents

private boolean keepTableContents

Constructor Detail

WikipediaMarkupDeletingDocumentSupplierDecorator

public WikipediaMarkupDeletingDocumentSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource)

WikipediaMarkupDeletingDocumentSupplierDecorator

public WikipediaMarkupDeletingDocumentSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource,
                                                        boolean removeCategoryLinks)

WikipediaMarkupDeletingDocumentSupplierDecorator

public WikipediaMarkupDeletingDocumentSupplierDecorator(org.dice_research.topicmodeling.preprocessing.docsupplier.DocumentSupplier documentSource,
                                                        boolean removeCategoryLinks,
                                                        boolean keepTableContents)

Method Detail

prepareDocument

public org.dice_research.topicmodeling.utils.doc.Document prepareDocument(org.dice_research.topicmodeling.utils.doc.Document document)

Specified by:

prepareDocument in class org.dice_research.topicmodeling.preprocessing.docsupplier.decorator.AbstractDocumentSupplierDecorator

createDeleter

public StackBasedMarkupDeletingMachine createDeleter()

setRemoveCategoryLinks

public void setRemoveCategoryLinks(boolean removeCategoryLinks)

setKeepTableContents

public void setKeepTableContents(boolean keepTableContents)