Package org.coordinatekit.crf.mallet.train

Class CompositeTestAccuracyEvaluator

java.lang.Object

cc.mallet.fst.TransducerEvaluator

org.coordinatekit.crf.mallet.train.CompositeTestAccuracyEvaluator

@NullMarked
public class CompositeTestAccuracyEvaluator
extends cc.mallet.fst.TransducerEvaluator

A composite evaluator that logs iteration statistics along with both instance and token accuracy metrics on test data.

This evaluator combines the functionality of MALLET's InstanceAccuracyEvaluator and TokenAccuracyEvaluator into a single evaluator that logs results using SLF4J. It evaluates only on test data and logs:

• Iteration number
• Log likelihood (training cost)
• Instance accuracy (if test data is present)
• Token accuracy (if test data is present)

Instance accuracy measures the proportion of sequences where all tokens are correctly labeled. Token accuracy measures the proportion of individual tokens that are correctly labeled.

See Also:

• InstanceAccuracyEvaluator
• TokenAccuracyEvaluator

Field Summary

Fields inherited from class cc.mallet.fst.TransducerEvaluator

instanceListDescriptions, instanceLists

Constructor Summary

Constructors

Constructor	Description
CompositeTestAccuracyEvaluator(cc.mallet.types.InstanceList testData, String description)	Creates a new composite evaluator for the specified test data.

Method Summary

Modifier and Type	Method	Description
void	evaluateInstanceList(cc.mallet.fst.TransducerTrainer trainer, cc.mallet.types.InstanceList instances, String description)

Methods inherited from class cc.mallet.fst.TransducerEvaluator

evaluate, preamble, precondition

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

CompositeTestAccuracyEvaluator

public CompositeTestAccuracyEvaluator(cc.mallet.types.InstanceList testData,
 String description)

Creates a new composite evaluator for the specified test data.

Parameters:

testData - the test instances to evaluate on; may be empty but not null

description - the description for this test data set

Method Details

evaluateInstanceList

public void evaluateInstanceList(cc.mallet.fst.TransducerTrainer trainer,
 cc.mallet.types.InstanceList instances,
 String description)

Specified by:

evaluateInstanceList in class cc.mallet.fst.TransducerEvaluator