gyf304/vmcli
A set of utilities (vmcli + vmctl) for macOS Virtualization.framework
Language: Swift
#cli #m1 #macos #virtual_machine #vm
Stars: 354 Issues: 0 Forks: 9
https://github.com/gyf304/vmcli
A set of utilities (vmcli + vmctl) for macOS Virtualization.framework
Language: Swift
#cli #m1 #macos #virtual_machine #vm
Stars: 354 Issues: 0 Forks: 9
https://github.com/gyf304/vmcli
GitHub
GitHub - gyf304/vmcli: A set of utilities (vmcli + vmctl) for macOS Virtualization.framework
A set of utilities (vmcli + vmctl) for macOS Virtualization.framework - gyf304/vmcli
dipampaul17/KVSplit
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
Language: Python
#apple_silicon #generative_ai #kv_cache #llama_cpp #llm #m1 #m2 #m3 #memory_optimization #metal #optimization #quantization
Stars: 222 Issues: 1 Forks: 5
https://github.com/dipampaul17/KVSplit
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
Language: Python
#apple_silicon #generative_ai #kv_cache #llama_cpp #llm #m1 #m2 #m3 #memory_optimization #metal #optimization #quantization
Stars: 222 Issues: 1 Forks: 5
https://github.com/dipampaul17/KVSplit
GitHub
GitHub - dipampaul17/KVSplit: Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache…
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with &am...