Score ACE Events

EventScorer implements Heng Ji's 3 event metrics, as defined in Refining Event Extraction [Ji and Grishman, ACL 2008]. The three metrics are trigger labeling, argument identification, and argument role labeling. These metrics are applied at the event mention level (not the event level). It is invoked by

xjet AceJet.EventScorer docList textDirectory textExtension systemApfDirectory systemApfExtension keyApfDirectory keyApfExtension");

where
docList
file containing list of document file names, one per line
textDirectory
directory containing text files for documents
textExtension
file extension for text files
systemApfDirectory
directory containing APF files to be scored
systemApfExtension
file extension for APF files to be scored
keyApfDirectory
directory containing APF keys
keyApfExtension
file extension for APF keys
If one line in the docList file is d, the program will compare the APF files systemApfDirectory/d.systemApfExtension and keyApfDirectory/d.keyApfExtension.