According to a report by misinformation watchdog NewsGuard, ChatGPT was more likely to misrepresent information in Chinese than in English. While the models themselves are multilingual, the languages ​​are separate overlapping regions of the dataset, and the models have no mechanism to compare how certain phrases or predictions differ between those regions.

According to TechCrunch , when a user asks ChatGPT to respond in English, it essentially grabs all the English data it has, the same goes for Chinese.

In March, Baidu introduced “Ernie Bot,” a chatbot based on the Chinese search giant’s Ernie artificial intelligence (AI) model. As the tech race between the US and China continues to rage, Baidu’s investment in and development of AI has attracted even more attention.

According to Reuters, Baidu cited test results conducted by China Science Daily using the AGIEval and C-Eval datasets, two benchmarks used to evaluate the performance of AI models.

Ernie 3.5 demonstrated outstanding ability in a Chinese test whose content is based on entrance and proficiency tests, such as those for college entrance exams or bar exams.

In another Chinese test with 13,000 multiple-choice questions covering 50 different topics, Ernie 3.5 continued to outperform the two OpenAI competitors. However, when taking a third test developed by a group of universities in the US, which included questions on science and society, Ernie 3.5 was completely left behind by ChatGPT and GPT 4.

Baidu CTO Haifeng Wang said that just three months after releasing the beta version of Ernie Bot, Baidu's large language model (LLM) built on Ernie 3.0, Ernie 3.5 has achieved improvements in efficiency, functionality, and performance. These improvements are evident in writing, query answering, reasoning, and code generation, as well as in training performance and inference performance, the CTO said.

Baidu also said the new model will support plug-ins from Baidu and third parties. The company said the “Baidu Search” plug-in has been integrated and will equip Ernie Bot with the ability to generate accurate, real-time information. Plug-ins are additional applications that enable AI to work in specific situations, such as summarizing long texts and generating more accurate answers.

Baidu's Ernie Bot ranked first among "China's ChatGPTs," according to a June test conducted by Xinhua. Baidu has pushed to integrate Ernie Bot into other products, such as cloud services, and announced a $139 million venture capital fund to invest in Chinese generative AI startups, according to SCMP .

It is foreseeable that large language models will increasingly penetrate more fields, becoming a key factor driving the digital economy, said Baidu CEO and co-founder Robin Li.