Shulou(Shulou.com)11/24 Report--

Recently, MediaTek unveiled its new generation of flagship 5G generative AI mobile chip Tianji 9300, an innovative all-core architecture design combined with a new generation of AI processor APU, as well as MediaTek's unique cutting-edge technology, powerful performance provides support for generative AI applications and creates a vivid and fulfilling generative AI experience. At the same time, MediaTek shares resources with many AI enterprises in the industry, creating a sufficient AI ecology on the mobile side.

The brand-new seventh generation AI processor APU 790is created for generative AI. With the increasing demand for generative AI applications, the advantages of end-to-side generative AI such as convenience and security are highlighted. Of course, the deployment of an end-side AI large language model requires strong AI computing power.

Tian Ji 9300 is equipped with MediaTek's seventh generation AI processor APU 790. it is designed for generative AI and has a hardware-level generative AI engine, which can achieve more high-speed and secure edge AI computing. Depth adaptation Transformer model for operator acceleration, the speed is eight times that of the previous generation.

At the same time, the performance and energy efficiency of the APU 790 have been significantly improved, the integer and floating-point computing capabilities have increased by twice as much as the previous generation, and the Zurich ETHZv5.1 AI-Benchmark Mobile Soc has scored 2109 points. AI's performance has been the highest, and the power consumption has been reduced by 45%. With the support of powerful AI performance, pictures can be generated in less than 1 second. Tianji 9300's powerful AI computing power, innovative all-core CPU architecture and Immortalis-G720 GPU all lay a solid performance foundation for end-to-side operation of generative AI.

At the same time, based on the characteristics of 100 million-level parameter large language model, MediaTek developed the mixed precision INT4 quantization technology, combined with MediaTek's unique memory hardware compression technology NeuroPilot Compression, which can make more efficient use of memory bandwidth, greatly reduce the occupation of terminal memory by AI large model, break through the memory limit of mobile phone for end-to-side operation of AI large language model, and help larger parameter model to land on the end-side.

Based on the above, Tianji 9300 landed on the side of vivo flagship mobile phone for the first time with a 7 billion-parameter AI large language model with a processing speed of up to 20 Tokens per second. Not only that, MediaTek has broken through the industry limit and has successfully run a large language model with 13 billion parameters on the side with vivo. Even, Tianji 9300 has taken the lead in realizing the AI large language model with 33 billion parameters successfully running on the mobile chip, leading the industry.

Tianji 9300 also supports multimodal generative AI models to create rich and interesting end-to-side experiences such as "Wensheng Poetry", "Wensheng Picture" and "Wensheng interesting Map".

It can be seen that the AI computing power and end-to-side generating AI ability of Tianji 9300 has been leading the industry, which is enough to make users AI creativity anytime, anywhere.

End-to-side skill expansion of generative AI model, bringing a comprehensive and rich end-to-side generative AI experience

Different from the cloud-side generation AI solution, due to the difference of hardware environment, the deployment of end-to-side generation AI also needs to consider factors such as mobile phone memory, storage capacity, load limit and so on. To this end, MediaTek took the lead in putting forward advanced solutions.

APU 790supports generative AI model end-to-side skill expansion technology NeuroPilot Fusion, which can continuously carry out low-rank adaptive (LoRA,Low-Rank Adaptation) fusion on the end-side based on the basic large model. Under the enabling of the hybrid AI, it can be based on a basic large model and complete the fusion of N functions on the end-side through cloud training, giving the basic large model more comprehensive and richer generative AI application capabilities.

For example, based on the AI model end-to-side skill expansion technology, "Tusheng GIF Motion Picture" function, users can change different styles and even expressions according to a photo, play with their own style emojis, and change emojis Xiaoda in seconds.

AI development platform NeuroPilot accelerated end-to-side generation AI ecological layout is based on powerful AI computing power, advanced memory hardware compression technology, AI model end-to-side skill expansion and other technologies. Tianji 9300's APU 790 promotes the speed and breadth of end-to-side generation AI to a new level. At the same time, in order to accelerate the deployment and popularization of generative AI in the end-side, MediaTek has also built a rich AI ecology with its AI development platform NeuroPilot, from the underlying hardware to the tool chain, model center and development ecology, helping the ecology to deploy end-to-side generative AI applications quickly and efficiently.

AI development platform NeuroPilot supports Android, Meta LIama 2, Wen Xin Yiyan big model, Baichuan intelligent Baichuan big model and other cutting-edge mainstream AI big models.

More importantly, NeuroPilot has a complete and advanced tool chain, which includes not only NeuroPilot Compression low-rank adaptive fusion, but also Speculative Decoding speculative decoding acceleration and model optimization and transformation.

MediaTek's Tianji developer Center can also provide end-to-side generation AI landing one-stop developer resources to share end-to-side model deployment cases to improve development efficiency. At present, more than 20 generative AI partners have joined the ecological co-construction.

MediaTek also works with industry contract partners to create a wonderful generative AI application experience. Hong soft's generative AI super-resolution technology is based on Tianji 9300 APU edge computing power, which can improve performance by 30% compared to the previous generation. When shooting at 25x magnification, using the generative AI super resolution technology, you can get a more realistic image in detail.

The generative AI semantic search technology of Jigan Technology is also based on the edge computing power of Tianji 9300 APU, with a performance improvement of 260% compared with the previous generation. For example, search for photos in the phone's photo album and describe the contents of the photos to accurately find the corresponding photos in milliseconds. And it can also be searched when the network is off, and the privacy will not be disclosed.

Morpho's video call real-time digital split generation technology is also based on the edge computing power of Tianji 9300 APU, with a performance improvement of 26% compared with the previous generation. The general virtual portrait generator needs to manually select the appearance style and takes time. However, based on the real-time digital split generation technology of video call, it is easy for users to operate, and the digital split can be generated instantly by opening a single picture of the camera.

Based on the edge computing power of Tianji 9300 APU, the performance of Hui Carp generation AI anti-glare technology can be improved by 60%. With the blessing of this technology, no matter outdoor or indoor, if there is glare during shooting, the glare interference can be eliminated as long as it is easily dark.

As you can see, under the trend of AI end-to-end cloud convergence, Tianji 9300 shows comprehensive advantages in AI computing power, generating AI user experience and ecology, setting a new benchmark for a new generation of flagship end-to-side generative AI experience.

In addition, MediaTek and other pioneers of generative AI are continuing to carry out technological innovation and ecological layout, vigorously promote hybrid AI computing, provide a unique and efficient solution for end-to-side generative AI deployment, and strive to promote the wide application of generative AI in the end-side, so that more users can experience personalized end-side AI applications and build a panoramic intelligent new experience, so that technology can better serve the public.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.