Skip to content
Tagged articles

low-latency inference

4 articles · Page 1 of 1
Data STUDIO
Data STUDIO
Sep 21, 2026 · Artificial Intelligence

Jev: The $0.042/M Token 'System 1' Model for Fast Semantic Judgments

TypeSafe's Jev model returns calibrated probability distributions over predefined options instead of generating text, enabling 100ms semantic decisions like classification and routing at $0.042 per million input tokens, with production adoption in customer service, browser automation, CI/CD, and game agents within days of release.

AI decision-makingJevSystem 1 model
0 likes · 21 min read
Jev: The $0.042/M Token 'System 1' Model for Fast Semantic Judgments
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Aug 13, 2026 · Artificial Intelligence

dots.tts: Open‑Source Continuous Autoregressive TTS Model for Sustainable, Scalable Voice Synthesis

dots.tts is a 2‑billion‑parameter, fully continuous, end‑to‑end autoregressive TTS model released by the Xiaohongshu dots team, offering state‑of‑the‑art zero‑shot voice cloning, low‑step inference, 1‑to‑1 audio‑text streaming, and an extensible training pipeline for research and deployment.

TTSaudio-text streamingautoregressive
0 likes · 22 min read
dots.tts: Open‑Source Continuous Autoregressive TTS Model for Sustainable, Scalable Voice Synthesis
Machine Heart
Machine Heart
Jun 1, 2026 · Artificial Intelligence

Thought-Aligner: Enabling Agents to Think Twice Before Acting

Thought-Aligner introduces a lightweight, plug‑in safety layer that corrects unsafe reasoning in AI agents during the millisecond window between thought generation and action execution, dramatically improving behavioral safety while preserving task usefulness across benchmark and real‑world deployments.

AI Safetyagent alignmentbenchmark evaluation
0 likes · 11 min read
Thought-Aligner: Enabling Agents to Think Twice Before Acting
JD Tech
JD Tech
Nov 28, 2025 · Artificial Intelligence

How JD Ads Uses Large Language Models to Transform Advertising

This article details JD Advertising's shift from generic to domain‑specific large models, the design of AI‑driven ad agents, the end‑to‑end GRAM retrieval‑alignment system, CTR‑guided AIGC for creatives, ultra‑low‑latency inference techniques, and ARM‑based optimizations that together reshape modern ad marketing.

CTR optimizationLarge Language Modelsadvertising AI
0 likes · 19 min read
How JD Ads Uses Large Language Models to Transform Advertising