Researchers from Stanford University have released the second edition of the Stanford Question Answering Dataset (SQuAD) to help AI, such as Siri, learn when it lacks enough information to answer a question accurately. The dataset consists of over 50,000 unanswerable questions designed to appear answerable based off information in the accompanying paragraphs. Humans can easily identify when a question is unanswerable, but AI systems have a harder time, which limits the ability of automated assistants and other services to accurately respond to users’ queries. For example, when asked who the King of England is, a human would recognize that England does not have a king, while AI systems are more likely to say the deceased King George VI, who was the last King of the United Kingdom.
↧