HashDiversityInfo

class HashDiversityInfo(uniques_per_representation: List[float], uniques_total: float)[source]

Bases: tuple

A ratio information object.

A pair unique_per_repr, unique_total, where unique_per_repr is a list with the percentage of unique hashes for each token representation, and unique_total the frequency of unique hashes when we concatenate all token representations.

Create new instance of HashDiversityInfo(uniques_per_representation, uniques_total)

Parameters
  • uniques_per_representation (List[float]) –

  • uniques_total (float) –