StayLameBro/backburner
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
Language: Python
#apple_silicon #ios #iphone #llama_cpp #llm_inference #local_llm #macos #metal #qwen #sme2 #speculative_decoding
Stars: 693 Issues: 4 Forks: 66
https://github.com/StayLameBro/backburner
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
Language: Python
#apple_silicon #ios #iphone #llama_cpp #llm_inference #local_llm #macos #metal #qwen #sme2 #speculative_decoding
Stars: 693 Issues: 4 Forks: 66
https://github.com/StayLameBro/backburner
GitHub
GitHub - StayLameBro/backburner: Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB…
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable - StayLameBro/backburner
👍3❤1
eagle-hq/EAGLE-4
Official Inference Code of EAGLE-4
Language: Python
#eagle #gpu #llm_inference #sglang #speculative_decoding #tokenspeed #vllm
Stars: 889 Issues: 5 Forks: 28
https://github.com/eagle-hq/EAGLE-4
Official Inference Code of EAGLE-4
Language: Python
#eagle #gpu #llm_inference #sglang #speculative_decoding #tokenspeed #vllm
Stars: 889 Issues: 5 Forks: 28
https://github.com/eagle-hq/EAGLE-4
GitHub
GitHub - eagle-hq/EAGLE-4: Official Inference Code of EAGLE-4
Official Inference Code of EAGLE-4. Contribute to eagle-hq/EAGLE-4 development by creating an account on GitHub.
👍2