ascend repositories
Trending repositories tagged ascend, ranked by trending score. Updated daily.
-
1
data-infra/cube-studio
cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务,VGPU虚拟化,云边端协同,边缘计算,自动化标注平台,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库llmops智能体,AI模型市场,支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等,支持ib/roce/RDMA,信创支持
GitHub · Python · 2,615 stars · 224 forks · +65 stars in 24 hours · Trending score 3.10
-
2
huawei-csl/MACaQ
SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.
GitHub · C++ · 383 stars · 22 forks · +15 stars in 24 hours · Trending score 2.72
-
3
gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
GitHub · Python · 6,094 stars · 748 forks · +18 stars in 24 hours · Trending score 2.57
-
4
Project-HAMi/HAMi
Heterogeneous GPU Sharing on Kubernetes
GitHub · Go · 5,044 stars · 895 forks · +17 stars in 24 hours · Trending score 2.47
-
5
youyve/nputop
An interactive Ascend-NPU process viewer
GitHub · Python · 146 stars · 17 forks · +8 stars in 24 hours · Trending score 1.43
-
6
ModelEngine-Group/unified-cache-management
Persist and reuse KV Cache to speedup your LLM.
GitHub · C++ · 361 stars · 138 forks · +3 stars in 24 hours · Trending score 1.41
-
7
modelsphere/modelsphere
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
GitHub · Shell · 195 stars · 11 forks · +1 stars in 24 hours · Trending score 1.12
-
8
Ascend/pytorch
As the core component of the Huawei Ascend for PyTorch community, TorchNPU is a deep learning adapter plugin built by Ascend for PyTorch, enabling the PyTorch framework to directly invoke Ascend NPU and providing developers with the powerful compute capabilities of Ascend AI processors.
GitHub · Python · 609 stars · 114 forks · 0 stars in 24 hours · Trending score 0.54
-
9
nndeploy/nndeploy
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
GitHub · C++ · 1,904 stars · 232 forks · 0 stars in 24 hours · Trending score 0.32
-
10
datawhalechina/torch-rechub
A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.
GitHub · Jupyter Notebook · 1,243 stars · 162 forks · 0 stars in 24 hours · Trending score 0.32
-
11
BreakingY/Media-Cognition-Pipeline
A general-purpose real-time streaming media and deep learning inference acceleration framework, supporting H264, H265, AAC, MP4, FLV, RTSP, RTMP, and YOLO.
GitHub · C++ · 81 stars · 22 forks · 0 stars in 24 hours · Trending score 0.31
-
12
youyve/awesome-kernel-agent
🔥 The living map of LLM-driven kernel generation: 280+ agents, models, benchmarks, and industry systems across NVIDIA, AMD, Ascend, TPU, and more. Continuously updated.
GitHub · Python · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.22
-
13
pillumina/ascend-sleuth
昇腾 NPU 训练与推理故障诊断知识库:按症状命中 case、用先验知识与源码分析定位根因,定位后进待审队列、每周升格回库。
GitHub · Python · 6 stars · 4 forks · 0 stars in 24 hours · Trending score 0.10
-
14
Syllo/nvtop
GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm
GitHub · C · 11,146 stars · 460 forks · 0 stars in 24 hours · Trending score 0.04
-
15
cl-vv-h/SGLang_Tutor
Bilingual SGLang tutorials and source-code walkthroughs for LLM inference, AI infrastructure, scheduling, KV cache, attention, Ascend NPU, and kernel optimization. | SGLang 中英双语教程与源码解析
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.02
-
16
lvyufeng/PocketLLM
Inference engine for large language models on consumer GPUs, with deep optimization for older hardware
GitHub · Python · 55 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00