marmot.tokenize.preprocess

Class WikiSelector

java.lang.Object

marmot.tokenize.preprocess.WikiSelector

All Implemented Interfaces:

java.lang.Iterable<Pair>

public class WikiSelector
extends java.lang.Object
implements java.lang.Iterable<Pair>

Constructor Summary

Constructors

Constructor and Description
WikiSelector(java.lang.String untokenized_file, java.lang.String tokenized_file, boolean expand, int max_sentences)
WikiSelector(java.lang.String untokenized_file, java.lang.String tokenized_file, boolean expand, int num_sentences, int token_threshold, double score_threshold)

Method Summary

Modifier and Type	Method and Description
java.util.Iterator<Pair>	iterator()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

WikiSelector

public WikiSelector(java.lang.String untokenized_file,
                    java.lang.String tokenized_file,
                    boolean expand,
                    int num_sentences,
                    int token_threshold,
                    double score_threshold)

WikiSelector

public WikiSelector(java.lang.String untokenized_file,
                    java.lang.String tokenized_file,
                    boolean expand,
                    int max_sentences)

Method Detail

iterator

public java.util.Iterator<Pair> iterator()

Specified by:

iterator in interface java.lang.Iterable<Pair>