ascend repositories

Trending repositories tagged ascend, ranked by trending score. Updated daily.

  1. 1
    data-infra/cube-studio

    cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务,VGPU虚拟化,云边端协同,边缘计算,自动化标注平台,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库llmops智能体,AI模型市场,支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等,支持ib/roce/RDMA,信创支持

    GitHub · Python · 2,615 stars · 224 forks · +65 stars in 24 hours · Trending score 3.10

  2. 2
    huawei-csl/MACaQ

    SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.

    GitHub · C++ · 383 stars · 22 forks · +15 stars in 24 hours · Trending score 2.72

  3. 3
    gpustack/gpustack

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    GitHub · Python · 6,094 stars · 748 forks · +18 stars in 24 hours · Trending score 2.57

  4. 4
    Project-HAMi/HAMi

    Heterogeneous GPU Sharing on Kubernetes

    GitHub · Go · 5,044 stars · 895 forks · +17 stars in 24 hours · Trending score 2.47

  5. 5
    youyve/nputop

    An interactive Ascend-NPU process viewer

    GitHub · Python · 146 stars · 17 forks · +8 stars in 24 hours · Trending score 1.43

  6. 6
    ModelEngine-Group/unified-cache-management

    Persist and reuse KV Cache to speedup your LLM.

    GitHub · C++ · 361 stars · 138 forks · +3 stars in 24 hours · Trending score 1.41

  7. 7
    modelsphere/modelsphere

    ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.

    GitHub · Shell · 195 stars · 11 forks · +1 stars in 24 hours · Trending score 1.12

  8. 8
    Ascend/pytorch

    As the core component of the Huawei Ascend for PyTorch community, TorchNPU is a deep learning adapter plugin built by Ascend for PyTorch, enabling the PyTorch framework to directly invoke Ascend NPU and providing developers with the powerful compute capabilities of Ascend AI processors.

    GitHub · Python · 609 stars · 114 forks · 0 stars in 24 hours · Trending score 0.54

  9. 9
    nndeploy/nndeploy

    一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

    GitHub · C++ · 1,904 stars · 232 forks · 0 stars in 24 hours · Trending score 0.32

  10. 10
    datawhalechina/torch-rechub

    A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

    GitHub · Jupyter Notebook · 1,243 stars · 162 forks · 0 stars in 24 hours · Trending score 0.32

  11. 11
    BreakingY/Media-Cognition-Pipeline

    A general-purpose real-time streaming media and deep learning inference acceleration framework, supporting H264, H265, AAC, MP4, FLV, RTSP, RTMP, and YOLO.

    GitHub · C++ · 81 stars · 22 forks · 0 stars in 24 hours · Trending score 0.31

  12. 12
    youyve/awesome-kernel-agent

    🔥 The living map of LLM-driven kernel generation: 280+ agents, models, benchmarks, and industry systems across NVIDIA, AMD, Ascend, TPU, and more. Continuously updated.

    GitHub · Python · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.22

  13. 13
    pillumina/ascend-sleuth

    昇腾 NPU 训练与推理故障诊断知识库:按症状命中 case、用先验知识与源码分析定位根因,定位后进待审队列、每周升格回库。

    GitHub · Python · 6 stars · 4 forks · 0 stars in 24 hours · Trending score 0.10

  14. 14
    Syllo/nvtop

    GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm

    GitHub · C · 11,146 stars · 460 forks · 0 stars in 24 hours · Trending score 0.04

  15. 15
    cl-vv-h/SGLang_Tutor

    Bilingual SGLang tutorials and source-code walkthroughs for LLM inference, AI infrastructure, scheduling, KV cache, attention, Ascend NPU, and kernel optimization. | SGLang 中英双语教程与源码解析

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.02

  16. 16
    lvyufeng/PocketLLM

    Inference engine for large language models on consumer GPUs, with deep optimization for older hardware

    GitHub · Python · 55 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00