Score ACE Events
EventScorer implements Heng Ji's 3 event metrics, as defined in
Refining Event Extraction [Ji and Grishman, ACL 2008]. The
three metrics are trigger labeling, argument identification,
and argument role labeling. These metrics are applied at the
event mention level (not the event level).
It is invoked by
xjet
AceJet.EventScorer
docList textDirectory textExtension
systemApfDirectory systemApfExtension keyApfDirectory keyApfExtension");
where
- docList
- file containing list of document file names, one per line
- textDirectory
- directory containing text files for documents
- textExtension
- file extension for text files
- systemApfDirectory
- directory containing APF files to be scored
- systemApfExtension
- file extension for APF files to be scored
- keyApfDirectory
- directory containing APF keys
- keyApfExtension
- file extension for APF keys
If one line in the docList file is d, the program will
compare the APF files
systemApfDirectory/d.systemApfExtension and
keyApfDirectory/d.keyApfExtension.