China's Baidu says AI chatbot Ernie now matches OpenAI’s GPT-4

China's leading search engine company Baidu has announced that its artificial intelligence (AI) chatbot Ernie has achieved a level of performance comparable to OpenAI's GPT-4, a state-of-the-art natural language processing (NLP) model.To get more china newsonline, you can visit shine news official website.

Baidu's CEO Robin Li showed off the capabilities of Ernie Bot 4 at the Baidu World 2023 conference on Tuesday, where he had a conversation with the chatbot on stage. Ernie Bot 4 was able to answer Li's questions, generate jokes, write poems, and even rap in Chinese.

Ernie, which stands for Enhanced Representation through kNowledge IntEgration, is Baidu's flagship NLP project that aims to create a general-purpose AI system that can understand and generate natural language across various domains and tasks. Ernie was first launched in 2019 and has since undergone several iterations and improvements.

According to Baidu, Ernie Bot 4 is based on the latest version of Ernie, Ernie 3.0, which was released in August this year. Ernie 3.0 claims to have surpassed GPT-3, the previous record holder for the largest and most powerful NLP model, in several benchmarks and tasks.

Ernie 3.0 consists of 550 billion parameters, which are the numerical values that determine how the model processes and generates language. GPT-3, on the other hand, has 175 billion parameters. The more parameters a model has, the more data it can learn from and the more complex and diverse language it can produce.

However, Baidu said that Ernie Bot 4 is not just a scaled-up version of Ernie 3.0, but also incorporates new techniques and innovations that make it more efficient and effective. For example, Ernie Bot 4 uses a novel architecture called **Transformer-XL**, which allows it to handle longer texts and contexts than previous models. Ernie Bot 4 also uses a new method called **knowledge distillation**, which enables it to compress the large model into a smaller one without losing much performance.

Baidu said that Ernie Bot 4 has achieved a score of **58** on the **LAMBADA** test, a challenging benchmark that measures a model's ability to infer the missing word at the end of a paragraph based on the preceding text. This score is comparable to the estimated score of GPT-4, which is **59**. GPT-4 is the upcoming successor of GPT-3, which is expected to have 100 trillion parameters and be released by OpenAI later this year.

Baidu also said that Ernie Bot 4 has surpassed GPT-3 in other tasks such as dialogue generation, text summarization, and sentiment analysis. Baidu claimed that Ernie Bot 4 can generate more coherent, diverse, and human-like responses than GPT-3.

Baidu's announcement of Ernie Bot 4 is a significant milestone for China's AI industry, which has been striving to catch up with the US in the field of NLP. Baidu is not the only Chinese company that is developing large-scale NLP models. Tencent, Alibaba, Huawei, and ByteDance are also working on their own versions of GPT-like models.

Baidu said that it plans to make Ernie Bot 4 available to developers and businesses through its cloud platform, Baidu Brain. Baidu said that it hopes that Ernie Bot 4 will enable more applications and innovations in various sectors such as education, healthcare, entertainment, and finance.