|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.ObjectJet.Refres.CorefScorer
implements coreference scoring based on the metric developed by Marc Vilain for MUC-6. The two documents should have entity annotations, each representing (the referent of) a set of coreferential mentions. Each annotation should have a mentions feature whose value is a Vector of mentions -- the phrases referring to this entity. The scorer measures the overlap between the mention sets in the key and response documents.
Mentions in the response and key files are aligned based on the final character of the head of the mentions.
Field Summary | |
int |
mappedMentionCount
number of mentions in current response Document which have a corresponding mention in key Document (a mention whose head ends at the same position). |
int |
overallMappedMentionCount
number of corresponding mentions in all documents processed by this instance of CorefScorer. |
float |
overallPrecision
coreference link precison for all documents processed by this instance of CorefScorer. |
float |
overallRecall
coreference link recall for all documents processed by this instance of CorefScorer. |
float |
precision
coreference link precision for the most recently processed document. |
float |
recall
coreference link recall for the most recently processed document. |
Constructor Summary | |
CorefScorer()
create a new coreference scorer. |
Method Summary | |
static java.util.Vector |
findMentions(Document doc)
return a Vector of all the mentions in the document (the union of the 'mentions' feature of all entities). |
static void |
main(java.lang.String[] args)
|
void |
score(Document responseDoc,
Document keyDoc)
compare the two documents, responseDoc and
keyDoc , setting recall and
precision . |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
public float recall
public float precision
public float overallRecall
public float overallPrecision
public int mappedMentionCount
public int overallMappedMentionCount
Constructor Detail |
public CorefScorer()
Method Detail |
public void score(Document responseDoc, Document keyDoc)
responseDoc
and
keyDoc
, setting recall
and
precision
.
public static java.util.Vector findMentions(Document doc)
public static void main(java.lang.String[] args) throws java.io.IOException
java.io.IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |