Shulou(Shulou.com)11/24 Report--

Beijing time on February 15 morning news, According to reports, Google chat robot demonstration site rollover caused its share price to plummet more than 7% that day, But Microsoft's demonstration activities also appeared factual errors.

Last week's tech scene saw a mini-boom in chatbots, with Microsoft and Google both trying to pre-empt it by showcasing early versions of AI search. Microsoft announced that its AI search attracted more than 1 million people in just 48 hours.

This technology can provide direct answers to users 'questions as if they were created by real people. Microsoft CEO Satya Nadella said the technology "may revolutionize knowledge work."

But for those worried about accuracy, AI leaves a lot to be desired.

At Microsoft's demo, this ChatGPT-like technology embedded in Bing Search analyzed Gap and Lululemon's earnings. But industry insiders compared the answers with the original earnings report and found that the chatbot missed some data and even fabricated some content.

"Bing AI gave some completely wrong answers during the presentation, but no one noticed. Independent search engine researcher Dmitri Brereton writes,"Instead, everyone rejoices at Bing's hype. "

Brereton found that in addition to errors in financial data, Microsoft's answers to vacuum cleaner specifications and Mexico travel plans in the presentation may have factual errors. Brereton wasn't originally trying to pick on microsoft. He stumbled on them when he carefully compared microsoft's answers to google's.

AI experts call this phenomenon "illusion," meaning that tools generated from large language models have a tendency to fabricate content. Last week, Google introduced a competing AI tool that also had factual errors in its presentation-but the errors were quickly discovered.

Both companies are stepping up efforts to integrate new forms of generative AI into search engines, hoping to show off their strengths in this area after ChatGPT ignites the industry craze. ChatGPT was launched last November by startup OpenAI, which has raised tens of billions of dollars through Microsoft, and competing startups such as Stability AI and Hugging Face have also received billions of dollars in funding.

Google and Microsoft are taking a different approach to the technology: Google has been slow to integrate AIGC (Artificial Intelligence Generated Content) technology into its search engine because of concerns about reputational risks and security issues, while Microsoft stressed last week that it is possible to open the technology to some members of the public in the short term.

"I don't think this technology should sit in the lab," Nadella said."It should be safely rolled out. "

But during Bing AI's presentation, there were some problems with the company's earnings data.

Microsoft marketing executive Yusuf Mehdi visited Gap's investor relations site during the presentation and then asked Bing AI to summarize "the essentials" based on the retailer's third-quarter earnings report, which was released in November.

"Cool, saves a lot of time. "said Meherty.

Below is a screenshot of Microsoft's demo process:

Here are the errors in this summary:

Gap reported a gross margin of 37.4%. But after removing Yeezy-related charges, adjusted gross margin was 38.7%.

Gap's operating margin was 4.6 percent instead of 5.9 percent. The 5.9% figure does not appear in the company's earnings report at all.

Adjusted diluted earnings per share were $0.71 instead of $0.42, which was also not found in the earnings report. Gap's earnings report includes an adjusted income tax gain of about $0.33.

Gap lowered its full-year forecast last August and said in its third-quarter earnings report that "fourth-quarter sales are likely to decline by about single digits year-on-year." So full-year revenue should decline, not "lower double-digit growth." There is no operating margin or earnings per share forecast.

Gap's fiscal 2022 third-quarter earnings report Microsoft said the company was aware of these mistakes and they also expected Bing AI to make some mistakes.

"We are aware of the report and have improved the experience by analyzing the issue. A Microsoft spokesperson said,"We acknowledge that there is still some work to be done and expect that the system may make some mistakes during the preview, which is why feedback is critical to help us learn and improve the model." "

Microsoft then asked Bing AI to compare Gap and Lululemon's earnings. Meherty wants bing to extract data from both reports and create a table.

"Look how amazing the results are. He said,"Like this, a form, the answer to this question is there. Imagine how long it would take to do it the other way around. "

Here are the results of Bing AI:

Here are a few errors in the table, starting with profit margins:

-Lululemon's gross margin is 55.9%, not 58.7%.

- The company's operating margin is 19 percent, not 20.7 percent

- Diluted earnings per share for Lululemon was $2, adjusted earnings per share was $1.62, and diluted earnings per share for Bing was $1.65.

Gap cash and cash equivalents were $67.9 million, not $1.4 billion.

Gap inventory is $3.04 billion, not $1.9 billion.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.