Tagged articles
speech synthesis
61 articles · Page 1 of 1
This article details the architecture of a production-ready AI voice cloning system that clones a voice from just 1 minute of audio, covering audio frontend processing, speaker encoding with WavLM or ECAPA-TDNN2, Flow Matching acoustic modeling, BigVGAN vocoder, inference pipeline latency under 2 seconds, and key engineering challenges like noise robustness, multilingual support, and safety.
BigVGANCosyVoiceECAPA-TDNN2
0 likes · 13 min read

RVCBench introduces a comprehensive benchmark evaluating 18 voice cloning models across 18 robustness tests covering input shifts, generation challenges, output distortions, and adversarial audio perturbations, revealing that clean-condition performance does not predict real-world reliability and that model architecture matters more than size.
Model EvaluationNeurIPS 2026RVCBench
0 likes · 22 min read


AntTechOct 19, 2026 · Artificial Intelligence
Ant Group's Ming-3.0 open-source speech series includes five models for synthesis, audio understanding, and recognition, featuring director-mode emotion control, paralinguistic tags, low-frame-rate architecture, context-aware ASR with hotwords, and top benchmark scores on MMAU, VoiceBench, and BigBenchAudio.
ASRMing-3.0Speech Recognition
0 likes · 11 min read

This article compares Kokoro (local ONNX TTS), Edge TTS (community Edge client), and Azure AI Speech (official cloud API) across offline support, licensing, cost, latency, and voice quality per language, providing a practical testing framework for selection.
Azure SpeechKokoroONNX
0 likes · 15 min read

FireRedTTS3 unifies 24‑language, 21‑dialect zero‑shot voice cloning, natural‑language voice design, and precise local editing in a single model by injecting semantic information into a continuous speech representation (RedAE) and leveraging a lightweight LLM‑DiT generation framework, achieving state‑of‑the‑art results on four public benchmarks.
LLM-DiTMultilingual TTSRedAE
0 likes · 13 min read

IndexTTS 2.5 adds zero‑sample voice cloning for Chinese, English, Japanese, Spanish and Arabic, doubles inference speed, introduces flexible speech‑rate control, and improves emotion and timbre fidelity, with detailed benchmarks and a systematic multilingual modeling study supporting its design choices.
Emotion TransferMultilingual TTSText-to-Speech
0 likes · 10 min read

VUI Labs’ Luna‑TTS model has claimed the top spot on Hugging Face TTS Arena and the Artificial Analysis Speech Arena, surpassing Google and other major providers, thanks to a diffusion‑based architecture, innovative tokenization, GRPO‑driven reinforcement learning, real‑time streaming, and massive multilingual data engineering.
AI voiceLuna-TTSVUI Labs
0 likes · 14 min read

dots.tts is a 2‑billion‑parameter, fully continuous, end‑to‑end autoregressive TTS model released by the Xiaohongshu dots team, offering state‑of‑the‑art zero‑shot voice cloning, low‑step inference, 1‑to‑1 audio‑text streaming, and an extensible training pipeline for research and deployment.
TTSaudio-text streamingautoregressive
0 likes · 22 min read

The article dissects GPT‑Live’s lifelike voice experience, explaining how the shift from a serial cascaded pipeline to a full‑duplex architecture, advanced round‑turn management, and task‑delegation mechanisms together eliminate latency, preserve conversational nuance, and raise new safety and product‑design challenges.
AI safetyGPT‑Livefull-duplex
0 likes · 26 min read

Qwen-Audio-3.0-TTS launches two variants—Flash with ~300 ms latency and Plus with higher naturalness—offering multilingual support for 16 languages, superior WER/CER and speaker similarity scores, free‑style natural‑language control, fine‑grained tag editing, and robust performance in noisy environments, all backed by benchmark results that crown Plus as the top performer on the Artificial Analysis leaderboard.
AI ModelMultilingual TTSQwen-Audio-3.0-TTS
0 likes · 7 min read


Geek LabsJun 18, 2026 · Artificial Intelligence
This article reviews eight open‑source text‑to‑speech systems—from lightweight, CPU‑only models to multilingual, podcast‑focused engines—detailing their architectures, language coverage, benchmark scores, licensing, and practical use‑case recommendations.
AIText-to-Speechbenchmark
0 likes · 15 min read

This guide explains why TTS evaluation requires a three‑metric “iron triangle” (WER/CER, speaker similarity, and naturalness), introduces community benchmarks such as Seed‑TTS‑eval, TTSDS2, TTS Arena and TTSD‑eval, and provides a concrete six‑stage pipeline and best‑practice checklist for reproducible, production‑ready assessment.
CI pipelineOpen-source benchmarksSeed-TTS-eval
0 likes · 11 min read

The article reveals that 80% of AI voice‑cloning failures stem from poor recording quality, analyzes three fatal sample defects—noise pollution, high‑frequency loss, and invalid segments—and proposes a three‑step “Extract → Enhance → Select” pipeline using BS‑RoFormer, DeepFilterNet3 and NISQA, boosting similarity from 68% to 89%.
AIaudio preprocessingdeep learning
0 likes · 16 min read

UniLS, the first end‑to‑end audio‑driven framework that jointly generates speaking and listening facial motions for digital humans, achieves state‑of‑the‑art speaking accuracy, improves listening naturalness by 44.1 %, and runs at over 500 FPS, as demonstrated on the CVPR 2026‑accepted paper with extensive quantitative and user studies.
CVPR 2026audio-driven animationdigital humans
0 likes · 9 min read

This article provides a detailed side‑by‑side analysis of three open‑source speech AI projects—Microsoft's VibeVoice, NVIDIA's PersonaPlex, and Xiaomi's OmniVoice—covering their positioning, core models, technical highlights, multilingual support, performance metrics, licensing, and recommended use cases.
AIAutomatic Speech RecognitionText-to-Speech
0 likes · 15 min read

This article dissects Step‑Audio2, an industrial‑grade multimodal large language model that unifies speech understanding, translation, dialogue and audio generation in a single causal LM, detailing its inference pipeline, key implementation tricks, deployment modes, strengths, limitations, and suitable application scenarios.
PythonStep-Audio2Token2Wav
0 likes · 10 min read

After a week of anonymous dominance on OpenRouter, Xiaomi revealed that the top‑ranking Hunter Alpha and Healer Alpha models are its MiMo‑V2‑Pro and MiMo‑V2‑Omni, respectively, and introduced the MiMo‑V2‑TTS voice model, detailing their massive parameters, benchmark scores, pricing, multimodal capabilities, and a clever blind‑test launch strategy.
AI agentMiMo-V2Xiaomi
0 likes · 11 min read

Xiaomi introduces MiMo-V2-TTS, a self‑developed speech‑synthesis large model that combines a custom audio tokenizer, multi‑codebook architecture, massive pre‑training on over a hundred million hours of data and multi‑dimensional reinforcement learning to deliver fine‑grained style control, dialect support, role‑play and high‑quality singing, aiming to give AI agents expressive, human‑like voices.
Multilingual TTSaudio tokenizerlarge model
0 likes · 6 min read

This article reviews the most capable open‑source Chinese text‑to‑speech models that run entirely on CPU in 2026, compares their quantization and speed features, recommends acceleration engines, outlines five hard‑won optimization rules, and provides a concise selection guide for various deployment scenarios.
CPU inferenceChinese TTSONNX Runtime
0 likes · 6 min read

IndexTTS‑2, an open‑source zero‑shot TTS system from B‑Station, enables precise duration control, emotion‑tone separation, and bilingual synthesis, offering a modern uv‑based installation, GPU‑accelerated inference, and benchmark‑leading WER and emotional similarity scores compared to contemporary models.
AIIndexTTS-2duration control
0 likes · 10 min read

This article details NIO's AI‑driven voice‑cloning solution for its in‑car NIO Radio, explaining the business background, pain points of traditional production, the TTS‑VC framework and modular workflow, evaluation metrics, and the resulting cost savings, efficiency gains, and scalability across dozens of cities.
AIAutomotiveText-to-Speech
0 likes · 10 min read

This article explains the technical challenges and innovative AI solutions behind preserving speaker identity, emotion, and timing while translating video content into multiple languages, covering speech generation modeling, speaker segmentation, adversarial reinforcement learning, proper‑noun adaptation, and audio‑visual alignment techniques.
AI voice cloningaudio-visual alignmentcross-modal translation
0 likes · 22 min read

IndexTTS2 introduces a cross‑modal, multi‑language voice translation system that preserves speaker identity, acoustic space, and multi‑source timbre, while tackling challenges like voice personality loss, subtitle cognitive load, localization costs, multi‑speaker diarization, and cultural adaptation through novel time‑coding, adversarial RL, and diffusion‑based lip‑sync techniques.
adversarial reinforcement learningcross-language TTSlip-sync
0 likes · 20 min read

This article presents a comprehensive practice summary of building an intelligent digital‑human system, covering six core modules—LLM content generation, LLM interaction, TTS synthesis, visual driving, audio‑video engineering, and backend services—while detailing data collection, signal processing, ASR annotation, speaker clustering, model optimization (V1‑V4), evaluation metrics, and future research directions.
AI voiceDigital HumanLLM
0 likes · 23 min read

This article details the end‑to‑end workflow for creating intelligent digital humans for live streaming, covering large‑language‑model‑driven content generation, multi‑stage TTS architecture, extensive audio‑signal processing, speaker clustering, front‑end text normalization, back‑end acoustic modeling, and quantitative evaluation of model improvements.
AIDigital HumanTTS
0 likes · 22 min read

This tutorial explains how to create a Python-based speech synthesis tool by installing required packages, configuring Xunfei Open Platform credentials, implementing a Tkinter GUI, and using WebSocket communication to convert text into audio with selectable voice profiles.
GUIText-to-SpeechWebSocket
0 likes · 8 min read

This guide introduces the open‑source Realtime Voice Cloning project, explains its key features, and provides detailed installation and usage instructions—including environment setup, dependency installation, cloning the repository, and running the demo tool—to enable real‑time voice transformation with Python.
AIPythonopen-source
0 likes · 5 min read

GPT‑4o’s speech multimodal system discretizes audio into semantic and acoustic tokens, integrates these tokens with large language models through multi‑stage instruction tuning, and employs hierarchical zero‑shot text‑to‑speech decoding, enabling low‑latency, streaming, and prompt‑driven voice synthesis for applications like gaming.
AudioLMGPT-4oLLM integration
0 likes · 33 min read

This tutorial walks through setting up Spring AI 0.8.1 with Spring Boot 3.1.1, configuring Alibaba Tongyi model access, and implementing chat, streaming, image, and audio generation endpoints using Java code and vector database integrations.
Alibaba AIImage GenerationJava
0 likes · 9 min read

This tutorial demonstrates how to obtain Baidu TTS credentials, construct the required signature, send an HTTP request using PHP's cURL library, and save the returned audio data as an MP3 file, providing a complete code example for developers.
API IntegrationBaidu TTSPHP
0 likes · 5 min read


58 TechAug 25, 2023 · Artificial Intelligence
This article introduces the AI sales assistant from 58.com, detailing its background, a few‑shot voice cloning approach using real dialogue data, multi‑accent naturalness optimization, deployment architecture, and future plans, while evaluating performance metrics and discussing challenges in speech synthesis quality and stability.
AI sales assistantFew-Shot LearningText-to-Speech
0 likes · 19 min read

The article presents 58 Tongcheng AI Lab's AI sales assistant, detailing its background, a few‑shot voice‑cloning pipeline built on real dialogue data, data preprocessing, FastSpeech2‑based acoustic modeling, multi‑accent style transfer, deployment architecture, controllable synthesis parameters, and future research directions.
AI sales assistantFastspeech2TTS
0 likes · 20 min read

Meta’s chief AI scientist Yann LeCun warned that current large language models still fall short of human and even dog intelligence, citing their lack of real‑world understanding, while Meta unveiled three new generative AI models—Voicebox for speech, MusicGen for music, and I‑JEPA for image reasoning—showcasing both progress and remaining limitations.
Computer VisionGenerative AIartificial intelligence
0 likes · 7 min read

This step‑by‑step tutorial shows how to set up a Stable Diffusion web UI, install the required Python environment and GPU‑enabled PyTorch, add Chinese localization and optional LoRA or Deforum extensions, generate realistic human images, create animated videos, and add speech with D‑ID, all ready for deployment on your own AI website.
DeforumGitPython
0 likes · 9 min read

Make-An-Audio, a collaborative text‑to‑audio model from Zhejiang University, Peking University and Volcano Speech, uses a Distill‑then‑Reprogram strategy to generate high‑quality, controllable sound effects from any modality, showcasing impressive demos and promising future AIGC applications.
AIGCText-to-Audioaudio generation
0 likes · 7 min read

This article provides a comprehensive overview of Volcano Engine's virtual digital human platform, detailing its definition, AI‑driven and human‑driven classifications, 2D and 3D technical architectures, multi‑modal perception, interaction capabilities, application scenarios, and future development directions.
2D avatar3D avatarComputer Vision
0 likes · 15 min read

iQIYI’s IQDubbing system leverages AI‑driven voice conversion to automatically generate high‑quality, expressive dubbing in dozens of languages and over 50 character voice styles, streamlining multilingual film and TV localization, reducing reliance on scarce actors, and earning positive audience feedback, patents and industry awards.
AI dubbingFilm Productionmultilingual speech
0 likes · 13 min read

The MSMC‑TTS system, a multi‑stage multi‑codebook VQ‑VAE based neural text‑to‑speech solution, delivers near‑human audio quality (MOS 4.41) with a compact 3.12 MB acoustic model, substantially surpassing Mel‑Spectrogram FastSpeech baselines in naturalness and efficiency.
Compact RepresentationMulti-Stage ModelingText-to-Speech
0 likes · 10 min read

This article explains the architecture of outbound call robots, classifies dialogue system types, details pipeline and end‑to‑end task‑oriented designs, highlights technical challenges such as dialects and transcription errors, and presents optimization techniques like ASR correction and script improvement.
ASR correctionNLUai-optimization
0 likes · 12 min read

This article reviews neural speech synthesis, explains why large high‑quality paired data are essential, and presents a range of low‑resource solutions—including semi‑supervised pre‑training, cross‑language transfer, speaker embedding, and Conformer‑based model upgrades—demonstrating how the Zuoyebang team built a robust TTS system with as little as 7‑minute speaker recordings.
ConformerFastspeech2low-resource TTS
0 likes · 15 min read

This article reviews Alibaba's digital‑human (virtual avatar) research over the past few years, covering the product’s evolution, a six‑stage pipeline for building digital humans, solutions to key challenges in realism, multimodal interaction, and the open‑source MMTK algorithm library.
Digital HumanEmotion Modelingbehavior decision
0 likes · 12 min read

This tutorial explains how to create a lightweight speech synthesis tool using iFlytek's WebAPI, covering required environment setup, API credential acquisition, GUI design with Tkinter, and detailed Python code for WebSocket communication, audio handling, and WAV file generation.
PythonText-to-SpeechWebSocket
0 likes · 8 min read

This article provides a hands‑on guide to using the pyttsx3 library for offline text‑to‑speech conversion in Python, covering installation, basic playback, voice property adjustments, multilingual support, and conditional speech examples with counters.
PythonText-to-Speechconditional speech
0 likes · 7 min read

ByteDance’s AI‑Lab leader Dr Yin Xiang discusses how the company’s intelligent speech technologies—spanning voice synthesis, recognition, and multimodal interaction—have been integrated across its global content platforms since 2017, boosting productivity in short videos, audiobooks, education, and more.
AIByteDancecontent creation
0 likes · 13 min read

The paper presents a speaker‑aware module (SAM) that enables high‑quality voice conversion using only a single utterance of the target speaker, addressing the small‑data challenge in speech timbre transfer and achieving state‑of‑the‑art performance on the Aishell‑1 benchmark.
LPCNetdeep learningsingle-sample
0 likes · 12 min read

This guide walks you through installing, configuring, and using five Python text‑to‑speech libraries—gTTS, Baidu AIP, pyttsx3, pywin32, and speech—to generate personalized audio files, adjust voice properties, and automate playback.
PythonText-to-SpeechgTTS
0 likes · 5 min read

This guide walks through downloading Jacob's DLL and JAR, configuring the Java environment, setting up an Eclipse project, and writing Java code that leverages the SAPI COM interfaces to synthesize Chinese text into a WAV file on Windows, complete with step‑by‑step screenshots and a full source example.
COMJacobJava
0 likes · 5 min read

The iQIYI M2VoC Challenge at ICASSP 2021 invites researchers to tackle low‑resource multi‑speaker, multi‑style voice cloning by providing Mandarin datasets, few‑shot and extremely few‑shot tracks with strict data rules, MOS‑based subjective evaluation, and a $9,600 prize pool for top submissions.
AIICASSPchallenge
0 likes · 10 min read

This guide shows how to create an offline Android app that converts any text to speech using the platform‑provided TextToSpeech class, covering UI layout with EditText and Button, a singleton SpeechUtils helper, language, pitch and rate configuration, and full code snippets for a working demo.
AndroidJavaTextToSpeech
0 likes · 5 min read

The article reviews Interspeech 2019, summarizing major trends and representative papers in end‑to‑end speech recognition, synthesis, natural language understanding, speaker recognition, and speech translation, while also highlighting best student papers and providing resources for further study.
AIInterspeech 2019Natural Language Understanding
0 likes · 24 min read

This article provides a comprehensive overview of voice conversion technology, covering its definition, parallel and non‑parallel data approaches, classic and deep‑learning methods such as DTW, GMM, seq2seq, PPG, VAE, Flow, GAN, and practical applications and challenges in iQIYI’s products.
ASRGANVAE
0 likes · 8 min read

This article introduces Alibaba's new e‑book collection of five ICASSP‑accepted papers that showcase advances in speech recognition, synthesis, and emotion detection, detailing novel models like DFSMN, A‑LSTM, and speaker‑adaptation techniques that dramatically improve speed, size, and accuracy.
AI voiceEmotion RecognitionICASSP
0 likes · 6 min read

Tencent Cloud's intelligent speech platform combines high‑accuracy ASR, advanced WaveNet‑based TTS, and solutions for noise, far‑field, and dialect challenges, enabling voice input, transcription, and customer‑service bots, with real‑world deployments in finance, museums, hotels, and other industry scenarios.
ASRHuman-Computer InteractionSpeech Recognition
0 likes · 8 min read

This article reviews the development roadmap, current industry status, challenges, typical deployment scenarios, and optimization methods for speech recognition (ASR) and speech synthesis (TTS), and shares several Tencent Cloud intelligent voice case studies to illustrate practical applications.
AISpeech Recognitioncloud computing
0 likes · 9 min read

This article presents a linear‑network‑based speaker‑adaptation method for text‑to‑speech that achieves synthesis quality comparable to large‑scale training using only a few hundred target‑speaker utterances, and introduces a low‑rank‑plus‑diagonal compression to improve stability with scarce data.
acoustic modelingartificial intelligencelinear network
0 likes · 9 min read

Researchers propose a Deep Feedforward Sequential Memory Network (DFSMN) for speech synthesis that matches BLSTM quality while using only a quarter of the model size and achieving four times faster inference, making it ideal for memory‑constrained, real‑time edge devices.
DFSMNdeep learningneural networks
0 likes · 10 min read

This paper introduces a Deep Feedforward Sequential Memory Network (DFSMN) for statistical parametric speech synthesis that matches BLSTM quality with only a quarter of the model size and four times faster inference, making it ideal for memory‑constrained, real‑time IoT devices.
DFSMNIoT devicesdeep learning
0 likes · 10 min read

This article examines the current landscape of intelligent voice technology—including speech recognition, synthesis, voiceprint identification, and acoustic event detection—highlighting technical hurdles, evaluation metrics, recent advances such as WaveNet, and a wide range of practical applications from mobile devices to smart hardware and enterprise solutions.
Speech RecognitionTencent CloudWaveNet
0 likes · 16 min read

AI RAP is an end‑to‑end AI service that lets users generate personalized rap with a single click by combining location‑sensitive attention and an inference mask to achieve perfect alignment, beat‑synchronous timing, multi‑character voice timbres, sub‑second synthesis, and a scalable architecture supporting millions of daily users.
AIAttention MechanismTacotron
0 likes · 5 min read

The article reports on Liulishuo’s participation in Interspeech 2017 and the SLaTE 2017 workshop, summarizing key research papers on noise‑robust ASR, attention‑based models, TensorFlow training, modern TTS systems, speaker identification datasets, and includes a hiring announcement for AI engineers.
AIInterspeechSpeech Recognition
0 likes · 7 min read

Baidu’s speech synthesis system, developed since 2013 to give machines natural Chinese voices, tackles millions of tonal variations through phonetic compression and optimized acoustic models, balances trade‑offs in data and scalability, and offers a free open platform that lets developers integrate high‑quality text‑to‑speech into apps, advancing equal access to information.
BaiduHMMText-to-Speech
0 likes · 6 min read
