|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use Token | |
|---|---|
| gate.creole.annic.apache.lucene.analysis | API and code to convert text into indexable tokens. |
| gate.creole.annic.apache.lucene.analysis.standard | A grammar-based tokenizer constructed with JavaCC. |
| gate.creole.annic.lucene | |
| Uses of Token in gate.creole.annic.apache.lucene.analysis |
|---|
| Methods in gate.creole.annic.apache.lucene.analysis that return Token | |
|---|---|
abstract Token |
TokenStream.next()
Returns the next token in the stream, or null at EOS. |
| Uses of Token in gate.creole.annic.apache.lucene.analysis.standard |
|---|
| Methods in gate.creole.annic.apache.lucene.analysis.standard that return Token | |
|---|---|
Token |
StandardTokenizer.next()
Returns the next token in the stream, or null at EOS. |
| Uses of Token in gate.creole.annic.lucene |
|---|
| Fields in gate.creole.annic.lucene with type parameters of type Token | |
|---|---|
private List<Token> |
LuceneSearchThread.tokenStreamInUse
This is where we store the tokenStreamInUse |
| Methods in gate.creole.annic.lucene that return Token | |
|---|---|
Token |
LuceneTokenizer.next()
Returns the next token in the token stream. |
| Methods in gate.creole.annic.lucene that return types with arguments of type Token | |
|---|---|
private List<Token> |
LuceneSearchThread.getTokenStreamFromDisk(String indexDirectory,
String documentFolder,
String documentID)
This method looks on the disk to find the tokenStream |
| Methods in gate.creole.annic.lucene with parameters of type Token | |
|---|---|
private boolean |
PatternValidator.isEqual(Token tk,
Term term)
Checks whether two terms are equal. |
| Method parameters in gate.creole.annic.lucene with type arguments of type Token | |
|---|---|
private LuceneSearchThread.PatternResult |
LuceneSearchThread.getPatternResult(List<Token> subTokens,
String annotationSetName,
int patLen,
int qType,
int patWindow,
String query,
String baseTokenAnnotationType,
int numberOfResultsToFetch)
this method takes the tokenStream as a text, the first term positions, pattern length, queryType and patternWindow and returns the GateAnnotations as an array for each pattern with left and right context |
private LuceneSearchThread.PatternResult |
LuceneSearchThread.getPatternResult(List<Token> subTokens,
String annotationSetName,
int patLen,
int patWindow,
String query,
String baseTokenAnnotationType,
int noOfResultsToFetch)
This method returns the valid patterns back and the respective GateAnnotations |
int |
PatternValidator.validate(List<String> queryTokens,
List<Token> annotations,
int from,
QueryParser queryParser)
This method takes two parameters the actual query issued and annotations in which it checks if the annotations exist that are validating for the given query |
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||