Shulou(Shulou.com)11/24 Report--

CTOnews.com Sept. 25, Douyin announced the launch of the automatic translation function of local dialects. Creators can use this function to convert dialects such as Cantonese, Min, Wu, Southwest Mandarin and Central Plains Mandarin into Putonghua subtitles to facilitate public viewing.

According to reports, creators can click "shoot and upload contributions" in the main interface of Douyin contribution. After uploading the video, use the "automatic subtitle" function and select "convert to Putonghua subtitles". The new function can automatically recognize the dialect speech of the video content, and convert the dialect content in the video into Putonghua subtitles.

At present, the first phase of the new feature has been launched, supporting Cantonese, Min dialect, Wu dialect (Shanghai), Southwest Mandarin (Sichuan), Central Plains Mandarin (Shaanxi, Henan) and so on. More dialect conversion will be supported in the future, and CTOnews.com partners can experience it on their own.

Douyin officials said that as dialects are often spread in oral form, there are few dialect corpus data that can be used for model training, which poses a great challenge to dialect identification and translation. In this regard, the technical team from the volcano engine adopted a self-developed self-supervised pre-training model and a multilingual translation model, which realized the ability to identify dialects under the condition of a very small amount of tagged data, and doubled the training efficiency. it effectively improves the performance of multilingual translation and greatly reduces the resource consumption of model training. " Based on the technical accumulation of daily service Douyin Group business, Douyin dialect subtitles can achieve ultra-low latency and high accuracy, "said the head of its team.

A person in charge of Douyin platform governance said that technology will continue to be used to record real and good life, and the automatic translation function of dialects will continue to be upgraded in the future to serve the spread of local cultures with dialects as the carrier.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.