Tagged articles
ONNX
20 articles · Page 1 of 1
This article compares Kokoro (local ONNX TTS), Edge TTS (community Edge client), and Azure AI Speech (official cloud API) across offline support, licensing, cost, latency, and voice quality per language, providing a practical testing framework for selection.
Azure SpeechKokoroONNX
0 likes · 15 min read

This guide walks through training custom locomotion policies for the $399 Microduck bipedal robot using reinforcement learning in MuJoCo simulation on UCloud GPU instances, covering environment setup, walking and running policy training, ONNX export, simulation validation, and Hugging Face deployment.
GPU Cloud TrainingHugging FaceMicroduck
0 likes · 12 min read

This article explains why traditional keyword search fails on synonyms, introduces Spring AI's local ONNX‑based EmbeddingModel to convert text into high‑dimensional vectors, shows how to store and query those vectors with SimpleVectorStore, and compares production‑grade vector store options.
EmbeddingJavaONNX
0 likes · 6 min read


大转转FEMay 7, 2026 · Artificial Intelligence
WebNN brings hardware‑accelerated AI inference to web pages, letting developers run millisecond‑level face detection, real‑time filters, and semantic segmentation locally without cloud calls, while improving latency, privacy, and cost through a unified JavaScript API that maps to CPUs, GPUs or NPUs.
AI inferenceEdgeGPU
0 likes · 16 min read

This article analyzes why AI‑driven testing tools often become performance bottlenecks, identifies I/O and serialization as the main culprits, and presents concrete optimizations—including headless browser flags, mmap, gRPC streaming, model lightweighting, multi‑level caching, and Kubernetes‑based co‑scheduling—that together reduce latency by up to 90% and boost throughput severalfold.
AI TestingCachingKubernetes
0 likes · 7 min read

Facing 53.64 ms per‑image latency in a Flask‑served Vision Transformer classifier, we iteratively optimized the pipeline—switching to ONNX Runtime, leveraging TensorRT, replacing Pillow with OpenCV, eliminating URL downloads, and finally batching requests—reducing average server‑side processing to 8.34 ms, a 6.4× speedup.
FlaskONNXPython
0 likes · 28 min read

This article explains how enterprise architects can integrate ONNX‑based machine‑learning inference directly into Java applications, covering tokenizer integration, GPU acceleration, deployment patterns, and lifecycle management to achieve secure, scalable, and observable AI services without relying on Python runtimes.
AI inferenceGPUJava
0 likes · 16 min read

PHP‑ORT is a high‑performance PHP extension that brings SIMD‑accelerated tensor operations and optional ONNX Runtime integration to PHP, offering multi‑core parallelism, extensive type support, and memory‑efficient processing for machine‑learning, scientific, and data‑intensive applications.
ExtensionONNXPHP
0 likes · 6 min read

This article walks through TensorRT's core optimization features, auxiliary debugging tools, and a step‑by‑step SMPLer‑X case study, showing how graph simplification, mixed‑precision, and engine generation cut inference latency to roughly 22‑29% of the original runtime.
GPU InferenceModel AccelerationONNX
0 likes · 6 min read

This article walks through exporting a PyTorch image‑classification model to ONNX, identifying a hidden layer node, adding it as an output, and using ONNX Runtime to retrieve both the final prediction and the intermediate feature tensor.
ONNXONNX RuntimePyTorch
0 likes · 5 min read

Developers face a variety of AI model formats—GGUF, PyTorch (.pt/.pth), Safetensors, and ONNX—each with distinct structures, advantages, drawbacks, and hardware support, and this article analyzes their metadata organization, quantization options, security considerations, and suitability for different deployment scenarios.
AI model formatsGGUFONNX
0 likes · 15 min read

This guide walks through setting up Meta XR SDK in Unity, using Building Blocks to add camera rigs, hand tracking and passthrough, binding interaction events, accessing hand‑tracking data via OVRSkeleton/OVRHand, and integrating ONNX machine‑learning models for XR experiments.
BuildingBlocksHandTrackingMetaXR
0 likes · 7 min read

This comprehensive guide examines the leading large‑model storage formats—including Hugging Face Transformers, TensorFlow SavedModel, ONNX, TorchScript, and GGUF—detailing their file structures, serialization methods, strengths, weaknesses, and typical use‑cases, helping developers and researchers select the optimal format for their specific AI workloads.
AI DeploymentGGUFModel Formats
0 likes · 21 min read

This comprehensive tutorial walks you through YOLOv8 object detection—from environment setup and dataset preparation to model training, validation, testing, and conversion to ONNX and TensorRT—providing clear commands, code snippets, and visual results for each step.
Model TrainingONNXObject Detection
0 likes · 8 min read

TransformersPHP brings Hugging Face’s Transformer models to PHP, enabling developers to run thousands of pre‑trained NLP models locally for tasks like text generation, summarisation, and translation, with simple installation, ONNX‑based execution, and a Python‑like pipeline API.
AINLPONNX
0 likes · 8 min read

This tutorial demonstrates how to train a MNIST digit‑recognition model using the Rust‑based Burn framework on top of the cross‑platform wgpu API, covering model export from PyTorch to ONNX, code generation, data loading, training loops, and performance comparison across CPU, GPU, and other backends.
BurnGPUMNIST
0 likes · 13 min read

This article explains how the homework‑help platform uses computer‑assisted language learning and neural network models to automatically evaluate spoken poetry, detailing the evaluation dimensions, reliability metrics like Pearson correlation and kappa, data‑driven feature extraction, ONNX deployment, and continuous model improvement through patented automatic data feedback.
AILanguage LearningONNX
0 likes · 3 min read

This article provides a comprehensive guide on YOLOv5, covering its background from YOLOv3, detailed code analysis of the model architecture, step‑by‑step instructions for running detect.py, configuring yolov5s.yaml, exporting the model to TorchScript JIT and ONNX formats, and practical inference examples using PyTorch and ONNX Runtime.
JITONNXObject Detection
0 likes · 16 min read

The TFCC framework, developed by WeChat's backend team, delivers high‑performance, easy‑to‑use, and universal deep‑learning inference by supporting numerous ONNX and TensorFlow operations, optimizing model structures, constants, and operators, and providing a versatile runtime and math library for both CPU and GPU platforms.
ONNXTFCCTensorFlow
0 likes · 8 min read

This article demonstrates how to convert traditional scikit‑learn and hmmlearn machine‑learning models into ONNX format and integrate them into a C++ gRPC service for fast online inference, covering environment setup, model conversion, custom operators, performance testing, and end‑to‑end pipeline construction.
C++ONNXPython
0 likes · 22 min read
