open-mmlab/mmdeploy
OpenMMLab Model Deployment Framework
Language: C++
#deployment #model_converter #ncnn #onnxruntime #openvino #pplnn #sdk #tensorrt
Stars: 267 Issues: 4 Forks: 34
https://github.com/open-mmlab/mmdeploy
OpenMMLab Model Deployment Framework
Language: C++
#deployment #model_converter #ncnn #onnxruntime #openvino #pplnn #sdk #tensorrt
Stars: 267 Issues: 4 Forks: 34
https://github.com/open-mmlab/mmdeploy
GitHub
GitHub - open-mmlab/mmdeploy: OpenMMLab Model Deployment Framework
OpenMMLab Model Deployment Framework. Contribute to open-mmlab/mmdeploy development by creating an account on GitHub.
ollaya-dev/ollaya
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
Language: Rust
#calibration #classification #decision_models #gliclass #jev #laya #llm_routing #local_inference #nli #ollama #onnx #onnxruntime #rust #typesafe #zero_shot_classification
Stars: 741 Issues: 3 Forks: 36
https://github.com/ollaya-dev/ollaya
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
Language: Rust
#calibration #classification #decision_models #gliclass #jev #laya #llm_routing #local_inference #nli #ollama #onnx #onnxruntime #rust #typesafe #zero_shot_classification
Stars: 741 Issues: 3 Forks: 36
https://github.com/ollaya-dev/ollaya
GitHub
GitHub - ollaya-dev/ollaya: Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 25 model…
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 25 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/system...
👍3🔥2❤1