NTCIR Test Collection
Test collections of various kinds have been built by NTCIR Project which is organized by NII. IDR distributes a part of the test collections shown in the forllowing table at present.
update: 2020/01/17
| Name | Task data (1) | Document data | ||
|---|---|---|---|---|
| Description | Usage procedure | Description | Usage procedure | |
| ACLIA |
NTCIR-7
NTCIR-8 |
online application | (2) | |
| CLIR |
NTCIR-3
NTCIR-4 NTCIR-5 NTCIR-6 |
online application | (2) | |
| CLQA |
NTCIR-5
NTCIR-6 |
online application | (2) | |
| CQA | NTCIR-8 | (3) | "Yahoo! Chiebukuro data" |
agreement
→ procedure |
| Crosslink | NTCIR-9 & NTCIR-10 | online application | (2) | |
| FinNum |
NTCIR-14
* added: 2020/01/17 |
open access | (2) | |
| INTENT / IMine |
NTCIR-9
NTCIR-10 NTCIR-11 (IMine) NTCIR-12 (IMine) |
online application | (2) | |
| Lifelog | NTCIR-12 | online application | (2) | |
| MATH / MathIR |
NTCIR-10
NTCIR-11 NTCIR-12 (MathIR) |
online application | (2) | |
| MedWeb | NTCIR-13 | online application | (2) | |
| 1CLICK / MobileClick |
NTCIR-9
NTCIR-10 NTCIR-11 (MobileClick) NTCIR-12 (MobileClick) |
online application | (2) | |
| QA/QAC |
NTCIR-3
NTCIR-4 NTCIR-5 |
online application | (2) | |
| SpokenDoc |
NTCIR-9
NTCIR-10 |
online application | (2) | |
| Temporalia |
NTCIR-11
NTCIR-12 |
online application | (2) | |
| WEB |
NTCIR-3
NTCIR-4 NTCIR-5 |
online application |
NW100G-01
NW1000G-04 |
agreement → procedure |
(1) "Topics and Relevance Judgments" or "Questions and Answers"
(2) Document data should be obtained separately.
(3) This test collection must be applied for together with "Yahoo! Chiebukuro data".
Various data other than the above are also distributed by NTCIR project.
For the details of the test collections, please refer to "Test Collections" at NTCIR site.