lightseekorg/tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
Language: Python
#blackwell #deepseek #gpt_oss #kimi #lightseek #llm #minimax #qwen #speed_of_light #tokenspeed
Stars: 695 Issues: 15 Forks: 43
https://github.com/lightseekorg/tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
Language: Python
#blackwell #deepseek #gpt_oss #kimi #lightseek #llm #minimax #qwen #speed_of_light #tokenspeed
Stars: 695 Issues: 15 Forks: 43
https://github.com/lightseekorg/tokenspeed
GitHub
GitHub - lightseekorg/tokenspeed: TokenSpeed is a speed-of-light LLM inference engine.
TokenSpeed is a speed-of-light LLM inference engine. - lightseekorg/tokenspeed
❤2👍1
eagle-hq/EAGLE-4
Official Inference Code of EAGLE-4
Language: Python
#eagle #gpu #llm_inference #sglang #speculative_decoding #tokenspeed #vllm
Stars: 889 Issues: 5 Forks: 28
https://github.com/eagle-hq/EAGLE-4
Official Inference Code of EAGLE-4
Language: Python
#eagle #gpu #llm_inference #sglang #speculative_decoding #tokenspeed #vllm
Stars: 889 Issues: 5 Forks: 28
https://github.com/eagle-hq/EAGLE-4
GitHub
GitHub - eagle-hq/EAGLE-4: Official Inference Code of EAGLE-4
Official Inference Code of EAGLE-4. Contribute to eagle-hq/EAGLE-4 development by creating an account on GitHub.
👍2