Machines equipped with artificial intelligence (AI) have performed better than human beings in a high-level test of reading comprehension. Two natural language processing tools received higher test scores than humans in recent exams.
One of the tools is a product of the American software maker Microsoft. The other was created by the Chinese online seller Alibaba Group. The company said that a deep-learning model developed by its Institute of Data Science of Technologies was the first to beat a human score in the reading comprehension test.
The test is called the Stanford Question Answering Dataset. It was developed by researchers at Stanford University in California. It has over 100,000 questions and answers. They are based on information found in over 500 stories from the Wikipedia website. The answers to all the questions come from the reading material.
The AI-powered machines were tested on whether they could provide exact answers to the questions after processing large amounts of information.
Alibaba said its deep neural (神经的) network model received an “Exact Match” score of 82.44 on the Stanford test. Microsoft reported that a team at Microsoft Research Asia had a score of 82.65. It said the human score on the same questions and answers was 82.304. Many research organizations also appeared on the list—all with scores below 82.
Alibaba said it has already used its reading comprehension model in different parts of its business. For example, the company is using machines to answer many incoming telephone calls from customers. The company says in the future, the technology could enable machines to guide visitors through museums or provide advice to medical patients.
Microsoft noted that, overall, people are still much better than machines at understanding the complexity and nuances (细微差别) of language.
