On the Unpredictability of AI Progress
Date : 2024-02-02
Description
This summary was drafted with mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf
While few people predicted the current revolution in AI, it is actually a 'revolution of predictability', with companies spending huge amounts of money on training runs and feeling secure due to the predictable input-output relations. The post also touches upon the role of architecture in AI development, suggesting that in the limit, everything converges to the same place, albeit at slightly different rates. Furthermore, the post highlights how scaling has been a key factor in recent advancements in image generation, with very little of it being architectural. Overall, the post provides a nuanced perspective on the current state and future direction of AI research.
Read article here
Recently on :
Artificial Intelligence
PITTI - 2026-03-05
Scaling Trust : a Missing Piece in Multi-Agent Worlds
Humanity’s ability to build complex civilizations relies on an "invisible infrastructure" - the shared culture, institutions, a...
PITTI - 2026-01-14
Cultural, Ideological and Political Bias in LLMs
Transcription of a talk given during the work sessions organized by Technoréalisme on December 9, 2025, in Paris. The talk pres...
WEB - 2025-11-13
Measuring political bias in Claude
Anthropic gives insights into their evaluation methods to measure political bias in models.
WEB - 2025-10-09
Defining and evaluating political bias in LLMs
OpenAI created a political bias evaluation that mirrors real-world usage to stress-test their models’ ability to remain objecti...
WEB - 2025-07-23
Preventing Woke AI In Federal Government
Citing concerns that ideological agendas like Diversity, Equity, and Inclusion (DEI) are compromising accuracy, this executive ...