|
Speech Group Home
Benchmark Tests
Tools
Test Beds
Publications
Links
Contacts
|
ACE08
Software
- Evaluation scoring script:
ace08-eval-v17.pl (August 26 2008)
The ACE08 scoring script includes updated formulas that addresses
concerns raised at the ACE07 evaluation workshop.
- XML Validation Tool:
XMLValidator.tar.gz (October 25 2005)
This java based (jar file) will validate a XML file against
it's DTD. It is important that the DTD is located in the same
directory as the XML file being validated.
- ACE08 apf transformation tool:
apf-for-2008-v10.pl (June 4 2008)
apf-for-2008 is a tool used to transform LDC ACE cross-document annotation data
(in non-standard apf format) into standard apf reference data suitable for scoring
system performance for either the local (within-document) task or the global
(cross-document) task (with the "-x" command line flag). Among other things,
apf-for-2008 discards unevaluated information and merges equivalent relations
(which are relations that have identical attributes and arguments).
NIST has found apf-for-2008 helpful as an optional pre-processing step for some
system output data. This is because in some cases the tool is able to ignore or
discard certain system output inconsistencies that would otherwise prevent the
successful generation of a score report. If there are differences between a
system's performance scored with and without apf-for-2008 preprocessing, both
versions will be provided.
[ ACE Home ]
Page Created: September 6, 2007
Last Updated:
August 25, 2008
|
