batching repositories

Trending repositories tagged batching, ranked by trending score. Updated daily.

  1. 1
    aryamandarda/tamserve

    Live, multi-camera object tracking with SAM3, SAM 2 and EdgeTAM, on one GPU or many. One model per GPU serves every camera: faster than the original code, about 4x less GPU memory, the same accuracy.

    GitHub · Python · 255 stars · 14 forks · +163 stars in 24 hours · Trending score 2.55

  2. 2
    General-Sequences/sequence-ai

    SequenceLink: open source serving for robot policies on remote GPUs, verified with openpi, LeRobot, GR00T and Octo. An inference layer (CUDA graphs with the same outputs, replicas) and a network layer (a robot's connection to its GPU), on your own GPU or on the hosted SequenceLink platform. pip install sequence-ai

    GitHub · Python · 48 stars · 0 forks · +28 stars in 24 hours · Trending score 1.73

  3. 3
    TanStack/pacer

    Utilities for debouncing, throttling, rate limiting, and queueing. Non-async and Async.

    GitHub · TypeScript · 798 stars · 68 forks · +5 stars in 24 hours · Trending score 1.26

  4. 4
    BuildMosaic/Mosaic

    A Kotlin library for composing backend responses from reusable work, with concurrent execution, shared dependencies, and batching. Powered by a dynamic DAG scheduler.

    GitHub · Kotlin · 29 stars · 1 forks · 0 stars in 24 hours · Trending score 0.06

  5. 5
    nasa/batchee

    NASA Harmony service that groups together files into batches for concatenation

    GitHub · Python · 6 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    jmaczan/tiny-vllm

    Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

    GitHub · C++ · 1,161 stars · 101 forks · 0 stars in 24 hours · Trending score 0.00

  7. 7
    tallslab/threeforge

    Frame-budget compiler and diagnostics for three.js games: batches naive scenes, measures every frame cost, explains what to fix. CLI and MCP for AI agents

    GitHub · TypeScript · 19 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  8. 8
    collapseindex/jev-ultralightspeed

    BRRRRRRRRRRRRRRRRRRRRRR

    GitHub · Python · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00