otx.api.usecases.tasks.interfaces.evaluate_interface#

This module contains the interface class for tasks that can compute performance.

Classes

IEvaluationTask()

A base interface class for tasks which can compute performance on a resultset.
class otx.api.usecases.tasks.interfaces.evaluate_interface.IEvaluationTask[source]#

Bases: object

A base interface class for tasks which can compute performance on a resultset.

abstract evaluate(output_resultset: ResultSetEntity, evaluation_metric: str | None = None)[source]#

Compute performance metrics for a given set of results.

The task may use at its discretion the most appropriate metrics for the evaluation (for instance, average precision for classification, DICE for segmentation, etc). The performance will be stored directly to output_resultset.performance

Parameters:

  • output_resultset (ResultSetEntity) – The set of results which must be evaluated.

  • evaluation_metric (Optional[str]) – the evaluation metric used to compute the performance