Project Bringing Hardware Accelerated Language Models to Android Devices

We introduce MLC LLM for Android – a solution that allows large language models to be deployed natively on Android devices, plus a productive framework for everyone to further optimize model performance for their use cases. Everything runs locally and accelerated with native GPU on the phone.

We can run Vicuña-7b on Android Samsung Galaxy S23.

Github https://github.com/mlc-ai/mlc-llm/tree/main/android

Demo: https://mlc.ai/mlc-llm/#android

#ai #assistant #gpt #android

#OpenAI was sketchy before they started killing #whistleblowers.

Quick reminder who is on their board of directors.

Unsubscribe from them, stop using chat #GPT. The company is controlled by some evil people.

https://x.com/IanCarrollShow/status/1876008747241492556

#Gates #pfizer #resilience #inqtel #CIA