Shulou(Shulou.com)11/24 Report--

According to CTOnews.com, June 5, most chatbots currently need to process messages and reply through the cloud, while IT House has previously reported an open source project called MLC LLM. The language model can be compiled and run locally. Recently, Professor Chen Tianqi, assistant to CMU, said that the independent MLC Chat App is now on the Apple App Store. Interested friends can download it and try it.

According to the MLC LLM project, ▲ source Chen Tianqi said: "MLC LLM is a general solution that allows any language model to be natively deployed on a different set of hardware backends and local applications, as well as an efficient framework for everyone to further optimize the model performance of their own use cases. Everything runs locally, does not require server support, and is accelerated through local GPU on mobile phones and laptops.

▲ source Apple App StoreCTOnews.com query GitHub page found that the developers of the project come from the Catalyst program of Carnegie Mellon University, the SAMPL machine learning research group, as well as the University of Washington, Shanghai Jiaotong University and OctoML. They also have a related project called Web LLM, which runs AI chatbots entirely in web browsers.

▲ drawing source App Store page of MLC Chat AppMLC Chat: click here to view

MLC LLM's GitHub page: click here to see

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.