Shulou(Shulou.com)11/24 Report--

CTOnews.com November 10 news, this afternoon vivo held a dual-core × image technology communication meeting, the meeting introduced the deep cooperation between vivo and MediaTek, and released the second generation of self-developed image chip V2.

Since 2021, vivo has launched two generations of self-developed chips, V1 and V1 +. The self-developed chip V2 adopts a brand-new iterative AI-ISP architecture, which brings comprehensive improvement of compatibility and functionality, and greatly upgrades the on-chip memory unit, AI computing unit and image processing unit. The FIT dual-core interconnection technology is proposed to establish a brand-new high-speed communication mechanism between the self-developed chip V2 and the Tianji 9200 flagship platform, so that the two chips with completely different architectures and instruction sets can complete the dual-core interconnection synchronization within 1/100 seconds, realizing the optimization coordination and high-speed collaboration of data and computing power.

According to introduction, thanks to the near-memory DLA (vivo self-developed AI deep learning accelerator) module and large-capacity dedicated on-chip SRAM (high-speed low-consumption cache unit), the self-developed chip V2 has re-matched the computing capacity, computing density and data density, greatly improving the capacity and computing speed of the on-chip cache. Compared with DDR external memory design usually adopted by NPU, SRAM data throughput power consumption can be reduced by 99.2% theoretically, and the energy efficiency ratio can be improved by 200% compared with traditional NPU.

The FIT dual-core interconnect and near-memory DLA structure design enables the AI-ISP architecture of the self-developed chip V2 to be established, and complements the ISP algorithm and computing power with the platform chip NPU to achieve the ultimate image processing effect and the ultimate energy efficiency ratio.

CTOnews.com learned that at this communication meeting, vivo also brought advanced self-developed image algorithms such as telephoto image, motion capture, dark light capture, etc. Under the support of self-developed chip V2 curing algorithm capability and new HDR, NR and ProMEMC, vivo mobile image technology will be pushed to a new height.

The "ultra-clear image quality engine" with optical super-resolution algorithm as the core can recover about 35% of the resolution information of more than 5 times focal length;Ultra Zoom EIS technology integrates IMU, OIS and EIS modules, effectively counteracts jitter during high-zoom shooting, ensures the stability of preview picture, and can stably operate lens even if handheld.

In order to solve the shutter delay problem and shorten the gap between mobile phone shooting and professional cameras, vivo has developed "zero delay" capture and a new generation of motion detection algorithms. By optimizing the image processing flow to improve the sensor start-up speed, the shutter delay time is shortened to 30ms, reaching the professional camera level.

In order to meet the full-scene image requirements of professional users, vivo also realizes the dark light capture function through algorithm superposition and photography full-link optimization, greatly improving the sensor's sensitivity in dark light scenes; through multi-frame fusion technology and self-developed RawEnhancement 2.0 algorithm, motion picture superposition and smear elimination are realized, enabling users to easily capture high-quality dynamic pictures in dark light environment.

Vivo will launch Tianji 9200 processor in the world, which is developed based on TSMC's second generation 4nm process technology. Vivo said that it was involved in the research and development of Tianji 9200 flagship platform at an early stage. Through close cooperation between the two parties for 20 months, it brought five joint R & D functions centered on MCQ multi-cycle queue, king glory adaptive image quality mode, chip eye protection, APU frame fusion and AI airport mode.

MCQ multi-cycle queue is a new processing engine redefined to maximize CPU performance. It can support up to 8 channels of data transmission between CPU and UFS, making application software switching and background download wake-up faster and smoother.

King Glory Adaptive Image Quality Mode is a black technology jointly developed by vivo, MediaTek and King Glory based on MAGT game adaptive cycle development. After turning on the adaptive function, under the environment of 26℃, running for 1 hour under the ultimate configuration of King Glory 120 +, the game frame rate is close to full frame, and the mean square error is only 0.92, reaching the top level in the industry.

Chip eye protection technology reduces blue light in real time by monitoring the proportion of blue light in the picture in real time through innovative algorithms and hardening into IP, so that the proportion of high-energy visible blue light is less than 5%, and the color cast degree is reduced by 12%. At the same time, according to the monitoring results, the color effect of the picture is dynamically adjusted to reduce the blue light while ensuring that the screen does not cast color.

APU framework fusion is based on the hardware characteristics of the sixth generation APU of Tianji 9200 flagship platform, which encapsulates MediaTek's underlying general capabilities into the self-developed VCAP heterogeneous computing acceleration platform. Deep optimization is implemented from the bottom layer of the platform to the framework layer, allowing algorithms to coordinate scheduling among multiple processors, bringing significant energy efficiency improvements, and thus introducing camera ultra-clear documents, live text and other functions.

AI airport mode can achieve an average energy saving of 30% during the user's flight; after turning off the flight mode, the network connection can be quickly restored within 1.52 seconds, making the network recovery speed one step faster.

In addition to joint research and development, vivo and MediaTek also carried out joint adjustment on a number of details to help Tianji 9200 flagship platform to play the ultimate performance, Ann Rabbit laboratory running points more than 1.28 million.

In the game scene, vivo brings technology such as game super-division, and optimizes the game experience in multiple links and all-round directions through the rapid start-up engine and network acceleration engine; in the image scene, for the first time, it realizes advanced circular parallax network with extremely low power consumption, greatly optimizes energy efficiency performance, and reduces energy consumption by 15%. Especially in the 4K 60 frame limit video scene, the power consumption of Tianji 9200 is reduced by 25% compared with Tianji 9000.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.