GitHub · Rust

ml-rust/splintr

A high-performance tokenizer (BPE, WordPiece, SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.

Stars
63
Forks
6
Stars gained in 24 hours
+2
Forks gained in 24 hours
0

Topics: huggingface, llm, machine-learning, openai, rust, tokenizer

Latest data point: Nov 21, 2026 · 63 stars · 6 forks

Open on GitHub

Trending in Rust

  1. 1
    zvec-ai/zvec-grep

    Local-first search across your workspace, built for humans and AI agents.

    GitHub · Rust · 4,368 stars · 269 forks · +7 stars in 24 hours · Trending score 2.08

  2. 2
    martin-olivier/airgorah

    A WiFi security auditing software

    GitHub · Rust · 6,621 stars · 1,093 forks · 0 stars in 24 hours · Trending score 2.31

  3. 3
    nklmilojevic/sofka

    A Kubernetes TUI, reimagined in Rust - built on kube-rs and ratatui, async-first from the ground up.

    GitHub · Rust · 1,893 stars · 85 forks · +8 stars in 24 hours · Trending score 1.96

  4. 4
    openai/codex

    Lightweight coding agent that runs in your terminal

    GitHub · Rust · 136,019 stars · 21,577 forks · +201 stars in 24 hours · Trending score 4.57

  5. 5
    Kuddev/pebrel

    AI-native, GPU-accelerated terminal emulator for Windows with SSH, persistent sessions, split panes, and first-class AI CLI workflows.

    GitHub · Rust · 3,858 stars · 224 forks · +23 stars in 24 hours · Trending score 2.72

  6. 6
    CapSoftware/Cap

    Open source Loom alternative. Beautiful, shareable screen recordings.

    GitHub · Rust · 25,357 stars · 2,399 forks · +107 stars in 24 hours · Trending score 3.98