Skip to content
Tagged articles

Microsoft Research

8 articles · Page 1 of 1
AI Frontier Lectures
AI Frontier Lectures
Nov 16, 2026 · Artificial Intelligence

NextLat: World Model Constrains LLM Reasoning, 3.3x Faster Speculative Decoding

Microsoft Research and MIT propose Next Latent Prediction Transformer (NextLat), which adds a latent state prediction loss during training to compress history into belief states, achieving 98.7% valid route generation on Manhattan taxi data, 54.8% accuracy on Countdown arithmetic, and up to 3.3x speculative decoding speedup on a 1.3B model.

Language ModelLatent DynamicsMIT
0 likes · 15 min read
NextLat: World Model Constrains LLM Reasoning, 3.3x Faster Speculative Decoding
Frontline Investigation
Frontline Investigation
Oct 22, 2026 · Industry Insights

Why Faster AI Drafts Don't Shorten Delivery: The Verification Bottleneck

The article argues that while generative AI accelerates draft creation, overall delivery time may not shrink because verification, fact-checking, and responsibility confirmation become new bottlenecks, citing Microsoft Research studies showing knowledge workers shift effort to validation and integration rather than drafting.

Critical ThinkingDelivery EfficiencyGenerative AI
0 likes · 7 min read
Why Faster AI Drafts Don't Shorten Delivery: The Verification Bottleneck
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 4, 2026 · Artificial Intelligence

Sliding Window Attention Beats Linear Attention: Microsoft's 0-Training Baseline Matches Costly Post-Training

Microsoft research shows sliding window attention with four attention sinks achieves 99% performance recovery on knowledge tasks without any post-training, matching linear attention methods requiring hundreds of millions of tokens while outperforming them 2-10x on long-context benchmarks.

KV CacheLinear attentionLong Context
0 likes · 9 min read
Sliding Window Attention Beats Linear Attention: Microsoft's 0-Training Baseline Matches Costly Post-Training
DataFunTalk
DataFunTalk
Apr 19, 2025 · Artificial Intelligence

Microsoft Research's Open‑Source Native 1‑Bit LLM BitNet b1.58 2B4T: Design, Performance, and Deployment

Microsoft Research released BitNet b1.58 2B4T, the first open‑source native 1‑bit large language model with 2 billion parameters, 1.58‑bit effective precision and a 0.4 GB footprint, achieving full‑precision performance while enabling efficient CPU and GPU inference for edge AI applications.

1-bit quantizationCPU inferenceLLM
0 likes · 10 min read
Microsoft Research's Open‑Source Native 1‑Bit LLM BitNet b1.58 2B4T: Design, Performance, and Deployment
Network Intelligence Research Center (NIRC)
Network Intelligence Research Center (NIRC)
May 22, 2023 · Artificial Intelligence

How Microsoft Leverages LLMs to Auto‑Generate Cloud Incident Root Causes and Fixes

Microsoft researchers fine‑tuned GPT‑3.x models with LoRA on over 40,000 cloud incident records, evaluated them with six NLP metrics and human interviews, and found that LLMs can generate root‑cause analyses and mitigation steps comparable to BERT models, especially for machine‑detected failures.

AI for operationsGPT-3LLM
0 likes · 8 min read
How Microsoft Leverages LLMs to Auto‑Generate Cloud Incident Root Causes and Fixes
DataFunTalk
DataFunTalk
Jul 9, 2022 · Artificial Intelligence

Graph Neural Networks Enter the Transformer Era – Seminar by Dr. Zheng Shuxin

The LOGS seminar on July 9, 2022 featured Dr. Zheng Shuxin from Microsoft Research presenting an overview of Transformer models, their success in NLP and CV, recent breakthroughs in applying Transformers to graph data, and future directions for graph processing.

AI SeminarGraph Neural NetworksMicrosoft Research
0 likes · 4 min read
Graph Neural Networks Enter the Transformer Era – Seminar by Dr. Zheng Shuxin