AI system finally passes 8th-grade science test

Aristo AI program

The Aristo AI software has matched an eighth-grader’s ability to pass a science test. (AI2 Illustration)

Five years after the late Seattle billionaire Paul Allen challenged researchers to come up with an artificial intelligence program smart enough to pass an eighth-grade science test, that feat has been declared accomplished — by the hometown team.

The Allen Institute for Artificial Intelligence, or AI2, announced today that its Aristo software scored better than 90% on a multiple-choice test geared for eighth graders, and better than 80% on a test for high school seniors.

There are caveats, of course: The exam, which was based on New York Regents aptitude tests, excluded questions that depended on interpreting pictures or diagrams. Those questions would have required visual interpretation skills that aren’t yet programmed into Aristo. Questions requiring a direct answer (that is, essay questions) were also left out. And for what it’s worth, Aristo would have been useless outside the areas of science in which it was trained.

Nevertheless, the exercise illustrated how far AI has come just since 2016, when all of the programs competing in the $80,000 Allen AI Science Challenge flunked.

Get the full story on GeekWire.

About Alan Boyle

Aerospace and science editor for GeekWire, creator of Cosmic Log, author of "The Case for Pluto: How a Little Planet Made a Big Difference," president of the Council for the Advancement of Science Writing. Check out "About Alan Boyle" for more fun facts.
This entry was posted in GeekWire and tagged , , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.