VentureBeat

Can AI really compete with human data scientists? OpenAI’s new benchmark puts it to the test

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now OpenAI has introduced a new tool to measure ...
Gizmodo

OpenAI Claims Its New Model Reached Human Level on a Test for ‘General Intelligence.’ What Does That Mean?

A new artificial intelligence (AI) model has just achieved human-level results on a test designed to measure “general intelligence”. On December 20, OpenAI’s o3 system scored 85% on the ARC-AGI ...
ZDNet

With AI models clobbering every benchmark, it's time for human evaluation

Artificial intelligence has traditionally advanced through automatic accuracy tests in tasks meant to approximate human knowledge. Carefully crafted benchmark tests such as The General Language ...
SiliconANGLE

AI startup Sierra’s new benchmark shows most LLMs fail at more complex tasks

Generative artificial intelligence startup Sierra Technologies Inc. is taking it upon itself to “advance the frontiers of conversational AI agents” with a new benchmark test that evaluates the ...
The Conversation

An AI system has reached human level on a test for ‘general intelligence’. Here’s what that means

Michael Timothy Bennett receives funding from the Australian government. Elija Perrier receives funding from the Australian government. A new artificial intelligence (AI) model has just achieved human ...