Shulou(Shulou.com)11/24 Report--

CTOnews.com, September 29 (Xinhua) as generative AI services such as OpenAI's ChatGPT, Microsoft's Bing Chat and Google Bard are increasingly used as alternatives to search engines, they have also encountered resistance from individuals and companies who do not want their site data to be used for AI model training.

Today, Google announced a new approach in which website developers can choose to allow their Bard and Vertex AI services to access their content, or choose not to train these API models.

In a blog post, Google announced the launch of Google-Extended, a new control that website developers can use to manage whether their sites help Bard and Vertex AI.

Websites can currently provide a list of rejected crawlers via robots.txt, and Google believes that all AI model providers should provide similar transparency and control. However, with the expansion of AI applications, websites will face the increasing complexity of managing different uses on a large scale. Google said it would share more information as soon as possible.

CTOnews.com found in the Google support documentation that Google-Extended does not have a separate HTTP request user agent (UA) string, and the fetching is done through the existing Google UA string; robots.txt user-agent token can be used for control.

In addition to today's announcement, Google said it would "explore other machine-readable ways to select and control websites." It contains a link where these sites can register mailing lists, where they will receive other updates about Google's improved site control.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.