GalkinPrecomputedTokenizerLoader
- class GalkinPrecomputedTokenizerLoader[source]
Bases:
PrecomputedTokenizerLoader
A loader for pickle files provided by Galkin et al.
See also
https://github.com/migalkin/NodePiece/blob/9adc57efe302919d017d74fc648f853308cf75fd/download_data.sh https://github.com/migalkin/NodePiece/blob/9adc57efe302919d017d74fc648f853308cf75fd/ogb/download.sh
Methods Summary
__call__
(path)Load tokenization from the given path.
Methods Documentation