Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
Language: Python
#llm #llm_tools #vllm
Stars: 243 Issues: 1 Forks: 5
https://github.com/Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
Language: Python
#llm #llm_tools #vllm
Stars: 243 Issues: 1 Forks: 5
https://github.com/Chen-zexi/vllm-cli
GitHub
GitHub - Chen-zexi/vllm-cli: A command-line interface tool for serving LLM using vLLM.
A command-line interface tool for serving LLM using vLLM. - Chen-zexi/vllm-cli
vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router
GitHub
GitHub - vllm-project/semantic-router: An open, programmable decision layer for models and compute.
An open, programmable decision layer for models and compute. - vllm-project/semantic-router
nokia-applied-research/AnyJev
Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)
Language: Python
#calibration #decision_model #jev #jev_model #llm #system_one #transformers #vllm
Stars: 802 Issues: 5 Forks: 108
https://github.com/nokia-applied-research/AnyJev
Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)
Language: Python
#calibration #decision_model #jev #jev_model #llm #system_one #transformers #vllm
Stars: 802 Issues: 5 Forks: 108
https://github.com/nokia-applied-research/AnyJev
GitHub
GitHub - nokia-applied-research/AnyJev: Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training.…
Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request) - nokia-applied-research/AnyJev
❤3👍1