Shulou(Shulou.com)11/24 Report--

MediaTek's latest flagship generation of 5G generative AI mobile chip Tianji 9300, its innovative full-core architecture design and the latest AI processor APU and other MediaTek feature technologies combine to provide powerful power for generative AI applications to achieve an engaging, rich and diverse generative AI experience. At the same time, MediaTek has also cooperated deeply with a large number of AI enterprises in the industry to jointly construct a vibrant AI ecosystem on mobile platforms.

The brand-new seventh generation AI processor APU790 is born for generative AI. With the increasing demand of users for generative AI applications, the advantages of convenience and security of end-side generative AI are highlighted. Of course, deploying end-side AI large language models requires strong AI computing support.

Tianji 9300 is equipped with MediaTek's seventh generation AI processor APU790, designed for generative AI, with hardware-level generative AI engine, which can realize higher-speed and safer edge AI calculation, and deeply adapt Transformer model for operator acceleration, which is 8 times faster than the previous generation.

At the same time, the performance and energy efficiency of APU 790 have been significantly improved. The integer operation and floating point operation capability have been increased to twice that of the previous generation. Zurich ETHZv5.1 AI-Benchmark Mobile Soc scored 2109 points. AI performance has been successfully dominated, and power consumption has been reduced by 45%. With powerful AI performance support, images can be generated in less than 1 second. Tianji 9300's powerful AI computing power, innovative full-core CPU architecture and Immortalis-G720 GPU all lay a solid performance foundation for end-side running generative AI.

At the same time, based on the characteristics of the 100 million-level parameter large language model, MediaTek has developed mixed precision INT4 quantization technology, combined with MediaTek's unique memory hardware compression technology NeuroPilot Compression, which can make more efficient use of memory bandwidth, greatly reduce the terminal memory occupied by AI large model, break through the memory limit of mobile phone for end-side operation of AI large language model, and assist larger parameter model to land on the end side.

Based on the above, Tianji 9300 first landed 7 billion parameter AI large language model on the side of vivo flagship mobile phone, and the processing speed can reach 20 Tokens per second. Not only that, MediaTek broke through the industry limit and has successfully run a large language model with 13 billion parameters on the end side with vivo. Even Tianji 9300 has taken the lead in successfully running AI large language models with 33 billion parameters on mobile chips, leading the industry.

Tianji 9300 also supports multi-modal generative AI large model, creating rich and interesting end-side experiences such as "Wensheng Poetry,""Wensheng Picture" and "Wensheng Interesting Picture."

It can be seen that the AI computing power and end-side generative AI capability of Tianji 9300 have led the industry, which is enough to make users 'AI creativity soar anytime and anywhere.

Generative AI model end-side skill expansion brings comprehensive and rich end-side generative AI experience

Different from cloud-side generative AI solutions, due to differences in hardware environments, deployment of end-side generative AI also requires consideration of factors such as mobile phone memory, storage capacity, and load ceiling. To this end, MediaTek took the lead in proposing advanced solutions.

APU790 supports NeuroPilot Fusion, an end-side skill expansion technology for generative AI models, which can continuously perform low-rank adaptation (LoRA) fusion on the end side based on the basic large model. Under the empowerment of hybrid AI, N functions can be fused on the end side based on one basic large model through cloud training, endowing the basic large model with more comprehensive and richer generative AI application capabilities.

For example, based on the AI model end-side skill expansion technology, the function of "generating GIF moving picture," users can change different styles and even expressions according to a photo, play the expression package of personal style, and change the expression package in seconds.

AI development platform NeuroPilot accelerated end-side generative AI ecological layout Based on powerful AI computing power, advanced memory hardware compression technology, AI model end-side skill expansion and other technologies, APU790 of Tianji 9300 has raised the speed and breadth of end-side generative AI to a new level. At the same time, in order to accelerate the deployment and popularization of generative AI on the end-side, MediaTek has also built a rich AI ecosystem with its AI development platform NeuroPilot, from the underlying hardware to the tool chain, model center and development ecosystem, helping the ecosystem to deploy end-side generative AI applications quickly and efficiently.

AI development platform NeuroPilot supports cutting-edge mainstream AI models such as Android, Meta LIama 2, Wenxin Yiyan Big Model, Baichuan Intelligent Baichuan Big Model, etc.

More importantly, NeuroPilot has a complete and advanced tool chain, in addition to NeuroPilot Compression low-rank adaptive fusion, Speculative Decoding speculative decoding acceleration and model optimization and transformation technology.

MediaTek's Tianji Developer Center can also provide end-side generative AI landing one-stop developer resources to share end-side model deployment cases to improve development efficiency. At present, more than 20 generative AI partners have joined the ecological co-construction.

MediaTek also works with industry contract partners to create exciting generative AI app experiences. Rainbow Soft's generative AI super-resolution technology is based on the edge computing power of the Tianji 9300 APU, which can improve performance by 30% compared with the previous generation. When shooting at 25 times magnification, using generative AI super resolution technology, more realistic image effects can be taken.

The generative AI semantic search technology of Extreme Sense Technology is also based on the edge computing capability of Tianji 9300 APU, which can improve the performance by 260% compared with the previous generation. For example, searching photos in the album of mobile phones, describing the content of photos can accurately find corresponding photos within milliseconds. Moreover, it can be searched even when the network is disconnected, and privacy will not be disclosed.

Morpho's real-time digital avatar generation technology for video calls is also based on the edge computing capability of Tianji 9300 APU, which improves performance by 26% compared with the previous generation. A typical virtual portrait generator takes time to manually select facial styles. However, based on the real-time digital avatar generation technology of video call, the user can easily operate, and only need to open the camera single frame picture to generate digital avatar instantly.

Based on the edge computing capability of Tianji 9300 APU, the performance of intelligent AI anti-glare technology can be improved by 60%. With this technology, whether outdoor or indoor, if there is glare when shooting, as long as it is easy to dim, glare interference can be eliminated.

It can be seen that under the trend of AI end-cloud fusion, Tianji 9300 shows comprehensive advantages in AI computing power, generative AI user experience and ecology, setting a new benchmark for the new generation of flagship end-side generative AI experience. Strong generative AI should use Tianji.

At the same time, leaders of generative AI such as MediaTek are vigorously promoting hybrid AI computing through continuous technological innovation and appropriate ecological layout, and designing a set of independent and efficient methods for end-side generative AI deployment, making every effort to promote the popularization of generative AI on the end-side, aiming to enable more users to enjoy personalized services of end-side AI, bring brand-new all-round intelligent experience, and realize scientific and technological achievements benefiting the whole society.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.