OpenAI’s first Jalapeño results show a custom inference chip that prioritizes per‑watt AI work and latency over raw speed, detailing system‑level design, AI‑assisted development, and benchmark gains across multiple large models while outlining the limits of the current data.
OpenAI and Broadcom unveiled Jalapeño, the company’s first AI‑designed ASIC for LLM inference, achieving a nine‑month tape‑out thanks to deep AI involvement in the design flow, and promising per‑watt performance that surpasses current leading solutions.
OpenAI unveiled its custom AI inference chip Jalapeño, co‑designed with Broadcom, claiming far‑better power‑efficiency than existing high‑end GPUs and signaling a strategic shift that could erode Nvidia’s near‑monopoly in AI hardware.
OpenAI has partnered with Broadcom to launch Jalapeño, a purpose‑built AI inference ASIC designed in nine months, promising superior performance‑per‑watt, integrated networking, and a full‑stack AI hardware‑software optimization cycle that could lower inference costs and reshape future data‑center deployments.
