Tagged articles

language bias

3 articles · Page 1 of 1
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jul 5, 2026 · Artificial Intelligence

Did OpenAI’s Original Scaling Law Contain a Fatal Bug That Wasted Trillion‑Scale Compute?

The article argues that the original scaling law proposed by OpenAI was flawed due to an optimizer bug, leading the AI community to waste massive compute on oversized models, and it examines subsequent corrections, hidden assumptions, and language‑bias implications.

AI Compute EfficiencyData vs Model SizeLarge Language Models
0 likes · 8 min read
Did OpenAI’s Original Scaling Law Contain a Fatal Bug That Wasted Trillion‑Scale Compute?
Alibaba Cloud Developer
Alibaba Cloud Developer
Dec 26, 2019 · Artificial Intelligence

How Decomposed Linguistic Representations Overcome Language Priors in VQA

This article reviews a AAAI 2020 paper that introduces a language‑attention based Visual Question Answering model which decomposes questions into type, object, and concept expressions to mitigate language bias, explains its modular architecture, and demonstrates superior performance on VQA‑CP v2 through extensive experiments and ablations.

Attention MechanismVQA-CPVisual Question Answering
0 likes · 14 min read
How Decomposed Linguistic Representations Overcome Language Priors in VQA