MacroRankBasedEvaluator

class MacroRankBasedEvaluator(**kwargs)[source]

Bases: RankBasedEvaluator

Macro-average rank-based evaluation.

Initialize the evaluator.

Parameters:

kwargs – additional keyword-based parameters passed to RankBasedEvaluator.__init__().

Methods Summary

clear()

Clear buffers and intermediate results.

finalize()

Compute the final results, and clear buffers.

process_scores_(hrt_batch, target, scores[, ...])

Process a batch of triples with their computed scores for all entities.

Methods Documentation

clear()[source]

Clear buffers and intermediate results.

Return type:

None

finalize()[source]

Compute the final results, and clear buffers.

Return type:

RankBasedMetricResults

process_scores_(hrt_batch, target, scores, true_scores=None, dense_positive_mask=None)[source]

Process a batch of triples with their computed scores for all entities.

Parameters:
  • hrt_batch (LongTensor) – shape: (batch_size, 3)

  • target (Literal[‘head’, ‘relation’, ‘tail’]) – the prediction target

  • scores (FloatTensor) – shape: (batch_size, num_entities)

  • true_scores (Optional[FloatTensor]) – shape: (batch_size, 1)

  • dense_positive_mask (Optional[FloatTensor]) – shape: (batch_size, num_entities) An optional binary (0/1) tensor indicating other true entities.

Return type:

None