Tokenizer
=========

.. currentmodule:: pykeen.nn.node_piece

.. autoclass:: Tokenizer
   :show-inheritance:

   .. rubric:: Methods Summary

   .. autosummary::

      ~Tokenizer.__call__

   .. rubric:: Methods Documentation

   .. automethod:: __call__