Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.
↑ +1 today
Discover the best Numa open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.