Jet.Refres
Class CorefScorer

java.lang.Object
  extended byJet.Refres.CorefScorer

public class CorefScorer
extends java.lang.Object

implements coreference scoring based on the metric developed by Marc Vilain for MUC-6. The two documents should have entity annotations, each representing (the referent of) a set of coreferential mentions. Each annotation should have a mentions feature whose value is a Vector of mentions -- the phrases referring to this entity. The scorer measures the overlap between the mention sets in the key and response documents.

Mentions in the response and key files are aligned based on the final character of the head of the mentions.


Field Summary
 int mappedMentionCount
          number of mentions in current response Document which have a corresponding mention in key Document (a mention whose head ends at the same position).
 int overallMappedMentionCount
          number of corresponding mentions in all documents processed by this instance of CorefScorer.
 float overallPrecision
          coreference link precison for all documents processed by this instance of CorefScorer.
 float overallRecall
          coreference link recall for all documents processed by this instance of CorefScorer.
 float precision
          coreference link precision for the most recently processed document.
 float recall
          coreference link recall for the most recently processed document.
 
Constructor Summary
CorefScorer()
          create a new coreference scorer.
 
Method Summary
static java.util.Vector findMentions(Document doc)
          return a Vector of all the mentions in the document (the union of the 'mentions' feature of all entities).
static void main(java.lang.String[] args)
           
 void score(Document responseDoc, Document keyDoc)
          compare the two documents, responseDoc and keyDoc, setting recall and precision.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

recall

public float recall
coreference link recall for the most recently processed document.


precision

public float precision
coreference link precision for the most recently processed document.


overallRecall

public float overallRecall
coreference link recall for all documents processed by this instance of CorefScorer.


overallPrecision

public float overallPrecision
coreference link precison for all documents processed by this instance of CorefScorer.


mappedMentionCount

public int mappedMentionCount
number of mentions in current response Document which have a corresponding mention in key Document (a mention whose head ends at the same position).


overallMappedMentionCount

public int overallMappedMentionCount
number of corresponding mentions in all documents processed by this instance of CorefScorer.

Constructor Detail

CorefScorer

public CorefScorer()
create a new coreference scorer.

Method Detail

score

public void score(Document responseDoc,
                  Document keyDoc)
compare the two documents, responseDoc and keyDoc, setting recall and precision.


findMentions

public static java.util.Vector findMentions(Document doc)
return a Vector of all the mentions in the document (the union of the 'mentions' feature of all entities).


main

public static void main(java.lang.String[] args)
                 throws java.io.IOException
Throws:
java.io.IOException