org.aksw.gerbil.execute

Class ExperimentTask

java.lang.Object

org.aksw.gerbil.execute.ExperimentTask

All Implemented Interfaces:

Runnable, org.aksw.simba.topicmodeling.concurrent.tasks.Task

public class ExperimentTask
extends Object
implements org.aksw.simba.topicmodeling.concurrent.tasks.Task

This is a single experiment designed as Task to be able to run several tasks in parallel.

Author:

Michael Röder (roeder@informatik.uni-leipzig.de)

Constructor Summary

Constructors

Constructor and Description
ExperimentTask(int experimentTaskId, ExperimentDAO experimentDAO, SameAsRetriever globalRetriever, EvaluatorFactory evFactory, ExperimentTaskConfiguration configuration)

Method Summary

Modifier and Type	Method and Description
protected <T extends org.aksw.gerbil.transfer.nif.Marking> EvaluationResult	evaluate(List<Evaluator<? extends org.aksw.gerbil.transfer.nif.Marking>> evaluators, List<List<T>> annotatorResults, List<List<T>> goldStandard)
String	getId()
String	getProgress()
protected void	prepareAnnotatorResults(List<? extends List<? extends org.aksw.gerbil.transfer.nif.Meaning>> results, SameAsRetriever annotatorSameAsRetriever) Prepares the given annotator results for the evaluation, i.e., performs a sameAs retrieval if it is needed for the experiment type.
protected void	prepareDataset(Dataset dataset) Deprecated. This should be done by the DatasetConfiguration class that has loaded the dataset
void	run()
protected EvaluationResult	runExperiment(Dataset dataset, Annotator annotator, List<Evaluator<? extends org.aksw.gerbil.transfer.nif.Marking>> evaluators, ExperimentTaskState state)
void	setAnnotatorOutputWriter(AnnotatorOutputWriter annotatorOutputWriter)
protected void	transformResults(EvaluationResult result, ExperimentTaskResult expResult)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ExperimentTask

public ExperimentTask(int experimentTaskId,
                      ExperimentDAO experimentDAO,
                      SameAsRetriever globalRetriever,
                      EvaluatorFactory evFactory,
                      ExperimentTaskConfiguration configuration)

Method Detail

run

public void run()

Specified by:

run in interface Runnable

prepareDataset

@Deprecated
protected void prepareDataset(Dataset dataset)

Deprecated. This should be done by the DatasetConfiguration class that has loaded the dataset

Prepares the given dataset for the experiment, i.e., performs a sameAs retrieval if it is needed for the experiment type.

Parameters:

dataset -

prepareAnnotatorResults

protected void prepareAnnotatorResults(List<? extends List<? extends org.aksw.gerbil.transfer.nif.Meaning>> results,
                                       SameAsRetriever annotatorSameAsRetriever)

Prepares the given annotator results for the evaluation, i.e., performs a sameAs retrieval if it is needed for the experiment type.

Parameters:

results -

annotatorSameAsRetriever -

transformResults

protected void transformResults(EvaluationResult result,
                                ExperimentTaskResult expResult)

runExperiment

protected EvaluationResult runExperiment(Dataset dataset,
                                         Annotator annotator,
                                         List<Evaluator<? extends org.aksw.gerbil.transfer.nif.Marking>> evaluators,
                                         ExperimentTaskState state)
                                  throws GerbilException

Throws:

GerbilException

evaluate

protected <T extends org.aksw.gerbil.transfer.nif.Marking> EvaluationResult evaluate(List<Evaluator<? extends org.aksw.gerbil.transfer.nif.Marking>> evaluators,
                                                                                     List<List<T>> annotatorResults,
                                                                                     List<List<T>> goldStandard)

getId

public String getId()

Specified by:

getId in interface org.aksw.simba.topicmodeling.concurrent.tasks.Task

getProgress

public String getProgress()

Specified by:

getProgress in interface org.aksw.simba.topicmodeling.concurrent.tasks.Task

setAnnotatorOutputWriter

public void setAnnotatorOutputWriter(AnnotatorOutputWriter annotatorOutputWriter)