Open Challenge

The workshop is preceded by an open challenge in Question Answering over Linked Data, in order to provide a benchmark for comparing different approaches and systems that mediate between a user (expressing his or her information need in natural language) and semantic data.

Full description: qald-2-challenge.pdf (last updated: March 26, 2012)

Schedule

Release of training dataset	January 31
Release of test set	March 28 25
Submission of results	April 1

Datasets

DBpedia 3.7

• http://downloads.dbpedia.org/3.7/en
• http://downloads.dbpedia.org/3.7/links

MusicBrainz (RDF export):

• musicbrainz.tar.gz (226.8 MB)

Training questions

DBpedia:

• dbpedia-train.xml (without answers)
• dbpedia-train-answers.xml (with answers)

MusicBrainz:

• musicbrainz-train.xml (without answers)
• musicbrainz-train-answers.xml (with answers)

Participant's challenge:

• participants-challenge.xml

Test questions:

• dbpedia-test-questions.xml
• musicbrainz-test-questions.xml

Test questions with annotations:

• dbpedia-test.xml
• musicbrainz-test.xml

Evaluation

For both training and the test phase, results can be uploaded with the following evaluation form:

• Evaluation tool

Evaluation results (test phase)