MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.
↑ +7 today
IPADS-SAI
1 tracked repository
☆ 192 TOTAL STARS
⑂ 23 TOTAL FORKS
↗ +2 STARS TODAY
★ Add Profile Badge to your GitHub README.md
Auto-UpdatingShowcase your total open-source impact. This SVG badge updates automatically as our continuous crawler records new stars.
[](https://githubrepo.cloud/developers/IPADS-SAI)Repositories
Sorted by stars
From our network