wordpiece repositories

Trending repositories tagged wordpiece, ranked by trending score. Updated daily.

  1. 1
    georg-jung/FastBertTokenizer

    Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.

    GitHub · C# · 55 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00

  2. 2
    actual-computer/toks

    exact tokenizers ids, as fast as the hardware allows

    GitHub · C · 115 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00