Month: March 2024

Enlarge (credit: Getty Images / Benj Edwards)

On Tuesday, Anthropic's Claude 3 Opus large language model (LLM) surpassed OpenAI's GPT-4 (which powers ChatGPT) for the first time on Chatbot Arena, a popular crowdsourced leaderboard used by AI researchers to gauge the relative capabilities of AI language models. "The king is dead," tweeted software developer Nick Dobos in a post comparing GPT-4 Turbo and Claude 3 Opus that has been making the rounds on social media. "RIP GPT-4."

Since GPT-4 was included in Chatbot Arena around May 10, 2023 (the leaderboard launched May 3 of that year), variations of GPT-4 have consistently been on the top of the chart until now, so its defeat in the Arena is a notable moment in the relatively short history of AI language models. One of Anthropic's smaller models, Haiku, has also been turning heads with its performance on the leaderboard.

"For the first time, the best available models—Opus for advanced tasks, Haiku for cost and efficiency—are from a vendor that isn't OpenAI," independent AI researcher Simon Willison told Ars Technica. "That's reassuring—we all benefit from a diversity of top vendors in this space. But GPT-4 is over a year old at this point, and it took that year for anyone else to catch up."

Enlarge / Will the fragile Xbox balloon pop if that cage is opened? (credit: Aurich Lawson / Getty Images)

Since the days of the NES, the one unshakable distinction between the PC and console gaming markets was the latter's "walled garden" approach to game distribution. For decades now, console makers have completely controlled the licensing and sales methods available for games on their own hardware.

So when Microsoft Xbox chief Phil Spencer says that he's open to breaking down that walled garden for his consoles, it's a big deal.

Speaking to Polygon in an interview at last week's Game Developers Conference, Spencer said he could foresee a future in which competing game marketplaces like the Epic Games Store or indie clearinghouse itch.io were available directly on Xbox hardware. “[Consider] our history as the Windows company," Spencer told Polygon. "Nobody would blink twice if I said, 'Hey, when you’re using a PC, you get to decide the type of experience you have [by picking where to buy games].' There’s real value in that."