Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.
↑ +1 today
guqiong96
1 tracked repository
☆ 161 TOTAL STARS
⑂ 21 TOTAL FORKS
↗ +2 STARS TODAY
★ Add Profile Badge to your GitHub README.md
Auto-UpdatingShowcase your total open-source impact. This SVG badge updates automatically as our continuous crawler records new stars.
[](https://githubrepo.cloud/developers/guqiong96)Repositories
Sorted by stars
From our network