Skip to content
Tagged articles

edge AI

120 articles · Page 1 of 2
Big Data and Microservices
Big Data and Microservices
Nov 15, 2026 · Industry Insights

AI Shifts from Dashboards to Factory Floors: 24 Cross-Sector Deployments (Nov 15, 2026)

This daily observation tracks 24 AI deployments across manufacturing, healthcare, agriculture, transport, finance, governance, and terminals on Nov 15, 2026, highlighting embodied AI quality inspectors, flexible production lines, agricultural robots, medical agents, financial multi-agent systems, city-scale intelligent bodies, AI glasses, and token economy infrastructure.

AI applicationsagricultural AIedge AI
0 likes · 41 min read
AI Shifts from Dashboards to Factory Floors: 24 Cross-Sector Deployments (Nov 15, 2026)
Big Data and Microservices
Big Data and Microservices
Nov 14, 2026 · Industry Insights

AI Advances from Pilots to Agent Clusters: 25 Industry Cases (Nov 2026)

This November 2026 daily observation analyzes 25 AI+industry cases across manufacturing, healthcare, agriculture, transport, finance, governance, and rural sectors, revealing a shift from pilot projects to agent cluster collaboration and data flywheel growth, with detailed metrics on efficiency gains, cost reductions, and deployment scale.

AI agentsagricultural AIedge AI
0 likes · 40 min read
AI Advances from Pilots to Agent Clusters: 25 Industry Cases (Nov 2026)
Big Data and Microservices
Big Data and Microservices
Nov 13, 2026 · Industry Insights

AI Moves from Demo to Deployment: Daily Cross-Industry Applications (Nov 13, 2026)

This daily observation analyzes 28 AI application cases across manufacturing, healthcare, agriculture, transportation, finance, governance, terminals, investment promotion, rural governance, and industry, revealing measurable efficiency gains, cost reductions, and AI's evolution into foundational infrastructure reshaping production workflows.

AI applicationsdigital transformationedge AI
0 likes · 38 min read
AI Moves from Demo to Deployment: Daily Cross-Industry Applications (Nov 13, 2026)
Big Data and Microservices
Big Data and Microservices
Nov 10, 2026 · Industry Insights

AI Industry Applications Evolve to Agent Clusters & Data Flywheels: Nov 2026 Observations

This report analyzes 23 AI application cases across manufacturing, healthcare, agriculture, transportation, finance, governance, terminals, and rural sectors from Nov 1-10, 2026, highlighting the shift from pilot projects to autonomous agent clusters, data flywheels, and commercialized vehicle-road-cloud integration, with AI dividends reaching county-level villages and edge hardware launching a new spatial computing cycle.

AI agentsedge AIfinancial AI
0 likes · 21 min read
AI Industry Applications Evolve to Agent Clusters & Data Flywheels: Nov 2026 Observations
Big Data and Microservices
Big Data and Microservices
Nov 5, 2026 · Industry Insights

AI's Shift from Hype to Infrastructure: 5 Cross-Industry Trends (Nov 5, 2026)

This daily observation covers AI applications across manufacturing, healthcare, agriculture, rural governance, transportation, finance, social governance, and consumer terminals on November 5, 2026, highlighting five key trends: multi-agent collaboration, rural AI penetration, vehicle-road-cloud commercialization, edge AI hardware, and capital-driven industrial investment, with concrete metrics from real-world deployments.

AI applicationsagricultureedge AI
0 likes · 31 min read
AI's Shift from Hype to Infrastructure: 5 Cross-Industry Trends (Nov 5, 2026)
Big Data and Microservices
Big Data and Microservices
Nov 4, 2026 · Industry Insights

AI Agents Go Autonomous: 21 Cross-Industry Deployments with Quantified Results (Nov 2026)

This daily observation tracks 21 benchmark cases across 10 sectors where AI agents have moved from pilot to autonomous execution, delivering measured gains in manufacturing, healthcare, transportation, finance, and governance, while highlighting trends like county-level adoption, compliance frameworks, and edge-device hardware cycles.

AI agentsautonomous executioncompliance frameworks
0 likes · 30 min read
AI Agents Go Autonomous: 21 Cross-Industry Deployments with Quantified Results (Nov 2026)
TechVision Expert Circle
TechVision Expert Circle
Nov 2, 2026 · Artificial Intelligence

AI-Powered Screwdriver Teardown: Edge Vision, Torque Control & Power Trade-offs

An engineering teardown of the Arrowspace S1 AI screwdriver reveals how a 2 MP camera, polarized lighting, and a 0.5 TOPS NPU identify screw types in milliseconds, while a 1 kHz strain-gauge sensor and PID loop achieve ±5% torque accuracy — all within a 0.5 W compute budget powered by a single 18650 cell.

Computer VisionEdge InferenceHardware Teardown
0 likes · 13 min read
AI-Powered Screwdriver Teardown: Edge Vision, Torque Control & Power Trade-offs
Big Data and Microservices
Big Data and Microservices
Nov 1, 2026 · Industry Insights

AI Agents Reach Production Scale: 19 Quantified Cases Across Manufacturing, Healthcare, Transport

This daily AI industry report analyzes 19 real-world deployments across manufacturing, healthcare, agriculture, transportation, finance, governance, terminals, investment promotion, and rural management, showing AI agents transitioning from pilots to scalable production with quantified metrics like 95% temperature accuracy in steelmaking, 30% faster diagnosis in county hospitals, and 15% traffic delay reduction in Beijing.

AI agentsagricultural AIedge AI
0 likes · 32 min read
AI Agents Reach Production Scale: 19 Quantified Cases Across Manufacturing, Healthcare, Transport
Big Data and Microservices
Big Data and Microservices
Oct 19, 2026 · Industry Insights

AI Agents Evolve from Tools to Systems: 18 Cross-Industry Cases Reveal Rural Adoption & Edge Hardware Cycle

This daily observation tracks 18 AI deployments across 10 industries including manufacturing, healthcare, agriculture, and transportation, revealing key trends: AI agents are maturing from standalone tools into integrated systems that execute tasks, benefits are reaching county and rural areas, compliance frameworks are emerging, and edge AI hardware is triggering a new device replacement cycle.

AI agentsdigital twinsedge AI
0 likes · 31 min read
AI Agents Evolve from Tools to Systems: 18 Cross-Industry Cases Reveal Rural Adoption & Edge Hardware Cycle
Big Data and Microservices
Big Data and Microservices
Oct 14, 2026 · Industry Insights

AI Moves from Consultation to Execution: 19 Real-World Deployments Across 9 Sectors (Oct 2026)

A daily observation covering 19 latest AI deployment cases across manufacturing, healthcare, agriculture, rural governance, transportation, finance, social governance, terminals, and investment promotion, showing AI shifting from advisory to operational roles with industrial agents entering factory cores, government agents handling 2M+ citizen requests, and on-device 30B models enabling offline complex reasoning.

AI applicationsTrustworthy AIagriculture AI
0 likes · 28 min read
AI Moves from Consultation to Execution: 19 Real-World Deployments Across 9 Sectors (Oct 2026)
Big Data and Microservices
Big Data and Microservices
Oct 9, 2026 · Industry Insights

AI Agents Shift from Chat to Execution: 14 Real-World Deployments Across 10 Sectors (Oct 9, 2026)

This daily observation tracks 14 AI deployments across manufacturing, healthcare, agriculture, transport, finance, governance, rural development, terminals, and investment promotion, revealing a shift from conversational AI to autonomous agents, with data flywheels and domain knowledge as key enablers.

AI DeploymentAI agentsdata flywheel
0 likes · 26 min read
AI Agents Shift from Chat to Execution: 14 Real-World Deployments Across 10 Sectors (Oct 9, 2026)
Machine Heart
Machine Heart
Sep 24, 2026 · Artificial Intelligence

Edge AI Token Factories: Banma Smart's AutoOmni 2.0 Enables Deep AI Usage in Cars

At the 2026 Yunqi Conference, Banma Smart unveiled AutoOmni 2.0-23B-A3B, a sparse MoE edge model that achieves near-cloud performance on vehicle-grade chips, addressing memory, latency, and concurrency constraints while enabling privacy-preserving, low-cost AI with certified safety frameworks for mass production.

AI safetyASPICE CertificationAutoOmni
0 likes · 24 min read
Edge AI Token Factories: Banma Smart's AutoOmni 2.0 Enables Deep AI Usage in Cars
macrozheng
macrozheng
Sep 23, 2026 · Mobile Development

Run LLMs on 6GB Android Phones with OlliteRT: OpenAI-Compatible LAN API

OlliteRT is an open-source Android app that runs large language models locally via Google's LiteRT runtime, exposing an OpenAI-compatible API over LAN for lightweight always-on tasks like RSS summarization and smart home automation, with monitoring, logging, and security features.

AndroidGemmaLLM
0 likes · 11 min read
Run LLMs on 6GB Android Phones with OlliteRT: OpenAI-Compatible LAN API
Big Data and Microservices
Big Data and Microservices
Sep 11, 2026 · Artificial Intelligence

Models Change Fast, Memory Lasts Forever: The Real AI Moat

This article argues that AI models are transient compute resources while user memory is a persistent asset, analyzing MemVerge's MemoryBox as a local-first memory layer that separates memory from models, enables multi-model scheduling, and addresses data sovereignty amid the shift to edge AI.

AI MemoryMemVergeMemoryBox
0 likes · 15 min read
Models Change Fast, Memory Lasts Forever: The Real AI Moat
Architecture Digest
Architecture Digest
Sep 2, 2026 · Artificial Intelligence

OlliteRT: Turn Old Android Phones into Local LLM API Servers

OlliteRT is an open-source Android app that transforms old phones into local LLM servers exposing OpenAI-compatible APIs, supporting models like Gemma 4 E2B and Qwen 2.5 1.5B with configurable hardware acceleration, monitoring, and Home Assistant integration, all running offline on 5-10W power.

AndroidGemmaHome Automation
0 likes · 10 min read
OlliteRT: Turn Old Android Phones into Local LLM API Servers
DataFunTalk
DataFunTalk
Sep 2, 2026 · Artificial Intelligence

How Edge AI Agents Run on Phones and PCs: Architecture Deep Dive

The article breaks down the three‑layer foundation—compute unlocking with Arm SME2, model slimming via Tencent's ultra‑low‑bit quantization, and deployment using ExecuTorch and Windows on Arm—that enables large AI agents to operate efficiently on mobile, PC, and other edge devices.

Arm SME2ExecuTorchMNN
0 likes · 3 min read
How Edge AI Agents Run on Phones and PCs: Architecture Deep Dive
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 1, 2026 · Artificial Intelligence

How Diffusion Language Models Deliver 5× Faster Agent Inference Than Token‑by‑Token Generation

A joint test by Diffusion Intelligence and Acrab shows that diffusion language models can speed up edge‑side agents by about five times compared to traditional autoregressive models, thanks to parallel token generation and global‑content framing, promising faster, more flexible AI experiences on devices.

AI accelerationagent inferenceautoregressive models
0 likes · 10 min read
How Diffusion Language Models Deliver 5× Faster Agent Inference Than Token‑by‑Token Generation
DataFunTalk
DataFunTalk
Sep 1, 2026 · Artificial Intelligence

Cracking the Last Mile of Edge Agents: Quantization, Instruction Sets, and Deployment

The article examines how large‑model agents can finally run on phones, PCs, cars and IoT devices by tackling three engineering layers—unlocking compute with Arm SME2, slimming models through ultra‑low‑bit quantization, and deploying with ExecuTorch and Windows on Arm—presented at the free Arm Create 2026 events.

Arm SME2ExecuTorchMNN
1 likes · 3 min read
Cracking the Last Mile of Edge Agents: Quantization, Instruction Sets, and Deployment
Ubuntu
Ubuntu
Aug 27, 2026 · Artificial Intelligence

Ubuntu‑Ready Arduino VENTUNO Q: $299 AI Board for Local LLMs & Robot Control

The Arduino VENTUNO Q, priced at $299 and shipped with Ubuntu, combines a Qualcomm Dragonwing IQ‑8275 NPU delivering up to 40 TOPS for on‑device large‑language‑model inference with an STM32H5 MCU handling sub‑millisecond real‑time control, offering integrated support for offline voice assistants, multi‑camera vision, ROS 2 robotics, and industrial CAN‑FD interfaces, positioning it as a ready‑to‑use edge AI platform distinct from Raspberry Pi or generic Ubuntu PCs.

ArduinoLLMNPU
0 likes · 11 min read
Ubuntu‑Ready Arduino VENTUNO Q: $299 AI Board for Local LLMs & Robot Control
AI Architecture Path
AI Architecture Path
Aug 19, 2026 · Artificial Intelligence

Needle2: 45M‑Parameter Open‑Source Edge Agent – 14 MB Model, 28 MB Runtime for Offline Tool Calls

Needle2 tackles the twin constraints of cloud‑dependency and heavyweight local models by offering a 45 M‑parameter, 14 MB single‑file model that runs in a constant ~28 MB memory footprint, specializing in tool calling, device control, and JSON extraction on ultra‑light hardware such as Raspberry Pi, VR headsets, and ESP32‑S3, while providing detailed architecture, benchmark, deployment, and fine‑tuning guidance.

LoRANeedle2SAN architecture
0 likes · 15 min read
Needle2: 45M‑Parameter Open‑Source Edge Agent – 14 MB Model, 28 MB Runtime for Offline Tool Calls
Architect's Must-Have
Architect's Must-Have
Jul 31, 2026 · Industry Insights

10 Hot AI Open‑Source Projects on GitHub This Week – The Last One Even Jensen Huang Praises

This article reviews the ten fastest‑growing AI open‑source projects on GitHub over the past week, detailing each project's core capabilities, technical architecture, and ecosystem impact while highlighting three emerging trends: AI agents becoming production tools, the rise of edge‑centric lightweight deployment, and accelerated open‑source contributions from major tech firms.

AI agentsGitHubMachine Learning
0 likes · 22 min read
10 Hot AI Open‑Source Projects on GitHub This Week – The Last One Even Jensen Huang Praises
Architects' Tech Alliance
Architects' Tech Alliance
Jul 27, 2026 · Industry Insights

2026 AI Supercomputing Center Trends: Heterogeneous Architecture, Green Cooling, and Edge Collaboration

The 2026 intelligent computing center report analyzes the shift from training‑centric GPU stacks to heterogeneous AI super‑factories dominated by inference, outlines new cooling and optical technologies, and explains how national policies drive a cloud‑edge hierarchy focused on utilization, energy efficiency, and domestic ecosystem development.

AI infrastructureAI supercomputingdomestic chips
0 likes · 5 min read
2026 AI Supercomputing Center Trends: Heterogeneous Architecture, Green Cooling, and Edge Collaboration
Machine Heart
Machine Heart
Jul 24, 2026 · Artificial Intelligence

Jetson-PI Enables Real‑Time VLA on Robots, Boosting Jetson Orin Control Frequency 8.66×

The paper presents Jetson-PI, an open‑source VLA real‑time control framework for low‑power edge devices that tackles inference latency and perception‑action misalignment through foresight‑aligned asynchronous correction, confidence‑based scheduling, and edge‑engine optimizations, raising Jetson Orin control frequency from 0.7 Hz to 6.06 Hz and improving task success rates on LIBERO benchmarks and a real‑world clothing‑folding robot.

Asynchronous InferenceJetson OrinRobotics
0 likes · 15 min read
Jetson-PI Enables Real‑Time VLA on Robots, Boosting Jetson Orin Control Frequency 8.66×
TechVision Expert Circle
TechVision Expert Circle
Jul 21, 2026 · Artificial Intelligence

Apple’s New Siri Public Beta Redefines Mobile Assistants with LLM‑Based Agent Architecture

Apple’s July 2026 public beta of Siri replaces its legacy intent‑based pipeline with a large‑language‑model‑driven agent architecture, introducing multimodal perception, persistent memory, and a three‑tier edge‑cloud inference system that reshapes mobile assistants while emphasizing privacy through on‑device processing and differential‑privacy techniques.

AppleLLMSiri
0 likes · 13 min read
Apple’s New Siri Public Beta Redefines Mobile Assistants with LLM‑Based Agent Architecture
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 28, 2026 · Artificial Intelligence

Om AI Unveils Three Edge AI Models for Continuous Perception to Action

Om AI announced a three‑model VLX suite—VLX‑Flow, VLX‑Seek and VLX‑Go—designed to keep video streams continuously feeding a device‑side brain, using incremental visual memory and linear attention to meet the low‑latency, resource‑constrained demands of real‑world cameras, drones and robots.

Linear attentionOm AIStreaming video
0 likes · 12 min read
Om AI Unveils Three Edge AI Models for Continuous Perception to Action
Machine Heart
Machine Heart
Jun 7, 2026 · Artificial Intelligence

Can Edge Models Serve as the First Layer of Intelligence on Devices?

The article examines why emerging wearables, smart glasses, and in‑car systems need a "first‑layer" on‑device AI that preprocesses multimodal inputs, outlines the missing input, application, and system capabilities required for edge models, and discusses how subsequent edge and cloud stages should share the workload.

device intelligenceedge AIlatency
0 likes · 6 min read
Can Edge Models Serve as the First Layer of Intelligence on Devices?
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 5, 2026 · Artificial Intelligence

Google Gemma 4 12B: Offline Multimodal AI on a 16 GB Laptop Beats 26B Model

Google DeepMind’s Gemma 4 12B model, released under Apache 2.0, runs fully offline on a 16 GB laptop, uses a novel no‑encoder unified architecture, delivers 80 token/s with only 9 GB VRAM, and matches the quality of the 26 B predecessor while powering advanced agentic and multimodal demos.

Apache 2.0Gemma 4benchmark
0 likes · 13 min read
Google Gemma 4 12B: Offline Multimodal AI on a 16 GB Laptop Beats 26B Model
TechVision Expert Circle
TechVision Expert Circle
Jun 5, 2026 · Industry Insights

When Laptops Run Trillion‑Parameter Models Locally, Is the Cloud‑AI Era Over?

The article examines Nvidia’s RTX 5090 Ti and Project DIGITS announcements, showing how desktop GPUs and AI engines now enable trillion‑parameter models on laptops, and analyzes the resulting shift from cloud‑centric AI to edge computing, including cost, latency, data‑sovereignty benefits and the challenges enterprises face.

AI hardwareAI inferenceDesktop GPU
0 likes · 14 min read
When Laptops Run Trillion‑Parameter Models Locally, Is the Cloud‑AI Era Over?
Architect's Guide
Architect's Guide
May 31, 2026 · Artificial Intelligence

10 Hot Open‑Source AI Projects on GitHub This Week (Last One Praised by Jensen Huang)

This article reviews the ten fastest‑growing open‑source AI projects on GitHub over the past week, detailing each project's core capabilities, architecture, and impact while highlighting three emerging trends: AI agents becoming production tools, the rise of edge and lightweight deployments, and accelerated open‑source contributions from major tech firms.

AI agentsQuantum AIedge AI
0 likes · 22 min read
10 Hot Open‑Source AI Projects on GitHub This Week (Last One Praised by Jensen Huang)
Alibaba International Intelligent Technology
Alibaba International Intelligent Technology
May 29, 2026 · Artificial Intelligence

Turning Cutting-Edge AI into a Cocktail at Zhejiang University’s Academic Bar

Alibaba International hosted an Academic Bar at Zhejiang University where experts presented multilingual e‑LLM models, next‑generation recommendation systems, AI‑driven optical design, safety frameworks for agents, a benchmark for e‑commerce chatbots, virtual user research, an Agent Harness architecture, and edge‑side large‑model techniques, illustrating the practical convergence of cutting‑edge AI research and industry.

AI agentsAI safetyedge AI
0 likes · 9 min read
Turning Cutting-Edge AI into a Cocktail at Zhejiang University’s Academic Bar
Machine Heart
Machine Heart
May 27, 2026 · Artificial Intelligence

Samsung’s Bold Move from Foundation Models to Physical AI: Leveraging ROM‑Based Architecture and New Benchmarks

Samsung is rapidly building its own foundation model ecosystem, introducing the memory‑based Meki architecture to leverage ROM for edge AI, the multi‑domain M2RL reinforcement‑learning paradigm, and the LiveClawBench 3‑dimensional benchmark to evaluate physical‑world AI, signaling a strategic shift from cloud‑centric to physical AI deployment.

LiveClawBenchMemory-Based ArchitectureMulti-Domain RL
0 likes · 8 min read
Samsung’s Bold Move from Foundation Models to Physical AI: Leveraging ROM‑Based Architecture and New Benchmarks
Machine Heart
Machine Heart
May 26, 2026 · Artificial Intelligence

AI‑Written Training Framework Powers 1B‑Parameter MiniCPM5 for Edge AI

The article analyzes MiniCPM5‑1B, a 1‑billion‑parameter edge‑friendly language model whose training framework, ForgeTrain, was generated entirely by AI, achieving Megatron‑level quality with 10% faster speed and enabling low‑cost, low‑latency deployment on devices ranging from laptops to smartphones.

AI training frameworkForgeTrainMiniCPM5
0 likes · 16 min read
AI‑Written Training Framework Powers 1B‑Parameter MiniCPM5 for Edge AI
AIWalker
AIWalker
May 19, 2026 · Artificial Intelligence

How EUPE’s Three‑Stage Distillation Lets an 86M Model Run Classification, Segmentation and VLM on iPhone in 62 ms (SOTA)

EUPE introduces a three‑stage “scale‑then‑shrink” distillation pipeline that first trains a large proxy model to absorb heterogeneous expert knowledge and then compresses it into an 86M encoder, achieving state‑of‑the‑art performance on image classification, dense prediction and vision‑language tasks on an iPhone with only 62 ms latency.

EUPEViTedge AI
0 likes · 16 min read
How EUPE’s Three‑Stage Distillation Lets an 86M Model Run Classification, Segmentation and VLM on iPhone in 62 ms (SOTA)
Machine Heart
Machine Heart
May 13, 2026 · Artificial Intelligence

Super‑Charging MiniCPM‑V 4.6 on One RTX 4090: 1B‑Parameter Multimodal Model Sets New Efficiency Bar

MiniCPM‑V 4.6, a 1.3 B‑parameter multimodal LLM, outperforms larger rivals such as Qwen3.5‑0.8B and Gemma 4 on both accuracy and speed, thanks to early ViT token compression and 4×/16× visual token reduction, delivering sub‑100 ms latency and over 2.6 k token/s throughput on a single RTX 4090 while also running offline on mobile devices.

MiniCPM-VRTX 4090edge AI
0 likes · 16 min read
Super‑Charging MiniCPM‑V 4.6 on One RTX 4090: 1B‑Parameter Multimodal Model Sets New Efficiency Bar
AI Explorer
AI Explorer
May 1, 2026 · Artificial Intelligence

How a 400B Model on iPhone Redefines the Phone as Your AI “Digital Passport”

Running a 400‑billion‑parameter model locally on the iPhone demonstrates a leap in model compression and edge AI, turning the device into a cognitive agent that handles tasks without apps, while Apple’s upcoming iOS 27 visual‑intelligence features and hardware upgrades cement its role as the core AI ‘digital passport’.

400B modelAI agentsedge AI
0 likes · 6 min read
How a 400B Model on iPhone Redefines the Phone as Your AI “Digital Passport”
AsiaInfo Technology: New Tech Exploration
AsiaInfo Technology: New Tech Exploration
Apr 23, 2026 · Artificial Intelligence

From Transparent Forwarding to Space AI: Analyzing Satellite‑borne AI Base Stations

The article examines the limitations of traditional transparent‑forwarding satellite links, proposes a dual‑engine "communication + AI" architecture for satellite‑borne AI base stations, explores resource‑pooling, space‑app‑store micro‑services, and real‑world use cases in wildfire detection, maritime navigation and renewable‑energy grid management, and outlines the path toward 6G‑enabled space‑ground computing networks.

6GAI base stationSpace Computing
0 likes · 23 min read
From Transparent Forwarding to Space AI: Analyzing Satellite‑borne AI Base Stations
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Apr 14, 2026 · Artificial Intelligence

Two‑Year‑Old Chinese Forecast Gains Global Consensus as Meta, METR and Others Confirm the Same AI Scaling Law

A Chinese research team’s 2024 "density law"—which predicts that the parameters needed for a given LLM performance halve every 3.5 months—has been independently validated by Meta’s scaling ladder, METR’s time‑horizon report, and subsequent analyses, revealing a unified exponential growth curve that reshapes expectations for inference cost, edge AI feasibility, and optimal model‑development strategies.

AI scalingLLM density lawMETR
0 likes · 11 min read
Two‑Year‑Old Chinese Forecast Gains Global Consensus as Meta, METR and Others Confirm the Same AI Scaling Law
James' Growth Diary
James' Growth Diary
Apr 13, 2026 · Frontend Development

Local Inference & Edge AI: Why Front‑End AI Is the Next Battlefield

Edge AI runs AI models directly in browsers or devices, offering zero latency, zero API cost, and full privacy, and the article explains the three technical breakthroughs that make it possible, compares WebLLM, Transformers.js and Ollama, and provides a hybrid architecture with concrete engineering challenges and solutions that can cut total AI costs by 40‑55% for typical front‑end applications.

OllamaTransformers.jsWebGPU
0 likes · 20 min read
Local Inference & Edge AI: Why Front‑End AI Is the Next Battlefield
Geek Labs
Geek Labs
Apr 11, 2026 · Mobile Development

How Google AI Edge Enables True On‑Device LLMs for Android

Google AI Edge introduces two open‑source projects—Gallery and LiteRT‑LM—that let Android developers run large language models locally without network connectivity, offering offline inference, privacy protection, GPU/NPU acceleration, and streaming output for real‑time AI experiences.

AndroidGalleryLLM
0 likes · 9 min read
How Google AI Edge Enables True On‑Device LLMs for Android
AI Explorer
AI Explorer
Apr 10, 2026 · Artificial Intelligence

Google AI Edge Gallery: Offline Mobile AI Model Playground

Google’s open‑source AI Edge Gallery lets Android and iOS devices run large language models such as Gemma 4 entirely offline, eliminating network latency and privacy concerns; the app showcases six modular AI features, offers a simple install path, and signals Google’s push toward a standardized edge‑AI ecosystem.

Gemma 4Google AI Edge GalleryKotlin
0 likes · 8 min read
Google AI Edge Gallery: Offline Mobile AI Model Playground
SuanNi
SuanNi
Apr 3, 2026 · Artificial Intelligence

How Gemma 4 Packs Cloud‑Grade AI Into Your Pocket Devices

Google’s newly released Gemma 4 series delivers a range of open‑source LLMs—from 2.3 B to 31 B parameters—optimized for edge devices through per‑layer embeddings, mixed‑expert MoE, hybrid attention, and extensive hardware support, achieving top‑tier benchmark scores while running efficiently on phones and IoT.

Gemma 4benchmarkedge AI
0 likes · 10 min read
How Gemma 4 Packs Cloud‑Grade AI Into Your Pocket Devices
Lao Guo's Learning Space
Lao Guo's Learning Space
Mar 31, 2026 · Artificial Intelligence

March 2026 AI Frontier: Open‑Source Model 2.0, Agent Explosion, and the Three‑Giant Showdown

The March 2026 AI landscape features a 2.0 era of open‑source large models led by DeepSeek‑R1, a breakout year for AI Agents with hierarchical planning and robust tool calls, and a cost‑driven showdown among GPT‑5.4, Claude Opus 4.6 and Gemini 3.1 Pro, reshaping capabilities, pricing, and deployment strategies across cloud and edge.

AI agentsAI marketAI models
0 likes · 10 min read
March 2026 AI Frontier: Open‑Source Model 2.0, Agent Explosion, and the Three‑Giant Showdown
AI Architecture Path
AI Architecture Path
Mar 30, 2026 · Artificial Intelligence

Can Wi‑Fi Turn Your ESP32 Into a Camera‑Free Human Pose Detector?

RuView, an open‑source edge‑AI project built on a CMU Wi‑Fi DensePose paper, claims to achieve wall‑penetrating human pose estimation, vital sign monitoring, and ultra‑fast presence detection using only standard Wi‑Fi signals and low‑cost ESP32 hardware, while sparking intense community debate over its claimed capabilities and reproducibility.

AI perceptionESP32RuView
0 likes · 8 min read
Can Wi‑Fi Turn Your ESP32 Into a Camera‑Free Human Pose Detector?
AIWalker
AIWalker
Mar 23, 2026 · Artificial Intelligence

Dynamic Dense Computing and Minimal End‑to‑End Design: YOLO-Master & YOLO26

By introducing a dynamic mixture‑of‑experts routing scheme and an end‑to‑end architecture that eliminates NMS and DFL, YOLO‑Master and YOLO26 dramatically cut compute waste and latency on edge devices, achieving up to 43% faster CPU inference while keeping model accuracy, with all code openly released.

Computer VisionMixture of ExpertsYOLO
0 likes · 7 min read
Dynamic Dense Computing and Minimal End‑to‑End Design: YOLO-Master & YOLO26
TechVision Expert Circle
TechVision Expert Circle
Mar 10, 2026 · Industry Insights

From Virtual Factories to Self‑Healing Digital Twins: The Next Turning Point

The article traces digital twin evolution from early 2018‑2021 mirror simulations through real‑time perception to the emerging self‑healing closed‑loop in 2025‑ onward, detailing the four‑layer architecture, key 2026 technologies, real‑world deployments, and remaining challenges for manufacturers.

Digital TwinSelf-HealingTime Series Models
0 likes · 17 min read
From Virtual Factories to Self‑Healing Digital Twins: The Next Turning Point
AI Engineering
AI Engineering
Mar 3, 2026 · Artificial Intelligence

Alibaba Qwen‑3.5 Small Models: 0.8B Parameters Enable Video on Edge Devices

Alibaba released four Qwen‑3.5 models (0.8B‑9B) that use a Gated DeltaNet hybrid‑attention architecture and native multimodal training to achieve 262k‑token contexts, outperform larger rivals on visual, reasoning, and math benchmarks, and run video analysis on phones and laptops, though they still demand significant VRAM.

Gated DeltaNetQwen3.5benchmark
0 likes · 6 min read
Alibaba Qwen‑3.5 Small Models: 0.8B Parameters Enable Video on Edge Devices
Weekly Large Model Application
Weekly Large Model Application
Feb 27, 2026 · Industry Insights

Edge AI’s 2026 Boom: Taalas HC1’s Disruption and China’s Key Takeaways

The article explains how the Taalas HC1 edge‑AI chip, with 17,000 tokens/s inference speed, 90 % lower power and 1/20 the cost of Nvidia H200 GPUs, proves that dedicated, non‑general‑purpose silicon can overcome latency, privacy and expense barriers, making on‑device large‑model deployment essential in 2026 and offering a strategic roadmap for Chinese chip makers.

AI chipsChinaTaalas HC1
0 likes · 12 min read
Edge AI’s 2026 Boom: Taalas HC1’s Disruption and China’s Key Takeaways
TechVision Expert Circle
TechVision Expert Circle
Feb 17, 2026 · Industry Insights

10 Digital Trends CTOs Must Watch in 2026

The article outlines ten actionable digital trends for 2026—from AI agents and large‑model inference cost strategies to platform engineering maturity, FinOps‑driven multi‑cloud governance, zero‑trust deepening, edge AI deployment, data contracts, and value‑centric tech organization—explaining why each matters and how CTOs can quickly build competence.

AI AgentData ContractFinOps
0 likes · 15 min read
10 Digital Trends CTOs Must Watch in 2026
AI Engineering
AI Engineering
Feb 9, 2026 · Artificial Intelligence

Three Unconventional Ways to Run OpenClaw on Edge Devices

The article showcases three low‑cost edge deployments of OpenClaw—a $25 Moto phone using Termux, a $5 ESP32‑S3 board running a pure‑C MimiClaw, and the BotDrop Android app that turns an old phone into an AI agent host—detailing setup steps, challenges, and security considerations.

AI agentsAndroidESP32
0 likes · 10 min read
Three Unconventional Ways to Run OpenClaw on Edge Devices
Old Meng AI Explorer
Old Meng AI Explorer
Jan 23, 2026 · Artificial Intelligence

How a 4B‑Parameter AgentCPM‑Explore Beats 30B Models in Long‑Range Tasks

AgentCPM‑Explore, a 4‑billion‑parameter open‑source agent model, breaks the conventional belief that larger models always perform better by achieving state‑of‑the‑art results on eight long‑duration benchmarks, surpassing many 8B and even some 30B models while enabling efficient edge deployment.

AIagent modelsedge AI
0 likes · 12 min read
How a 4B‑Parameter AgentCPM‑Explore Beats 30B Models in Long‑Range Tasks
AI Frontier Lectures
AI Frontier Lectures
Jan 15, 2026 · Artificial Intelligence

What Makes YOLO26 the Next Leap in Edge AI Object Detection?

YOLO26, the latest Ultralytics release, introduces a unified model family with five sizes, removes distribution focal loss, offers end‑to‑end inference without NMS, adds progressive loss balancing and the MuSGD optimizer, and delivers up to 43% faster CPU performance, making it ideal for edge and real‑world vision applications.

Object DetectionYOLO26edge AI
0 likes · 12 min read
What Makes YOLO26 the Next Leap in Edge AI Object Detection?
Subtle Storm
Subtle Storm
Jan 7, 2026 · Artificial Intelligence

Which Factors Will Define AI in 2026? A Deep Dive into Emerging Trends

The article analyzes how AI in 2026 will shift from conversational hype to actionable agents, featuring paradigm changes toward act‑oriented agents, a split between edge‑efficient and slow‑thinking models, deep multimodal fusion, and embodied intelligence that turns AI into a practical digital colleague.

2026 AI trendsAI agentsEmbodied AI
0 likes · 7 min read
Which Factors Will Define AI in 2026? A Deep Dive into Emerging Trends
Network Intelligence Research Center (NIRC)
Network Intelligence Research Center (NIRC)
Dec 31, 2025 · Artificial Intelligence

Why AI Inference Is Slow and How Cutting‑Edge Tech Boosts It in Industrial Settings

The article analyzes the severe inference bottlenecks of large language models, CNNs, and recommendation systems and presents a suite of research‑driven accelerations—including token‑level pipeline parallelism (HPipe), KV‑cache clustering (ClusterAttn), quantization (QoKV), heterogeneous edge frameworks (DeepZoning, PICO), delay‑aware edge‑cloud scheduling (DECC), and operator choreography (RACE)—validated on real‑world industrial workloads.

AI inferenceModel Accelerationedge AI
0 likes · 16 min read
Why AI Inference Is Slow and How Cutting‑Edge Tech Boosts It in Industrial Settings
PaperAgent
PaperAgent
Dec 4, 2025 · Artificial Intelligence

Mistral 3 Unveiled: How Its New Open‑Source Models Redefine Performance and Cost

Mistral AI’s latest open‑source release, Mistral 3, introduces three compact dense models and the powerful Mistral Large 3 MoE model, outperforming domestic rivals in benchmarks, offering strong multilingual and multimodal capabilities, and delivering the lowest cost‑performance ratio among open‑source LLMs.

Mistral 3Mixture of ExpertsMultilingual AI
0 likes · 4 min read
Mistral 3 Unveiled: How Its New Open‑Source Models Redefine Performance and Cost
Data Party THU
Data Party THU
Nov 21, 2025 · Artificial Intelligence

Unlocking 2025 Multi-Agent AI: Core Tech, Frameworks, and Emerging Trends

This article analyzes the technical foundations, development frameworks, real‑time inference optimizations, typical industry deployments, and future research directions of multi‑agent systems in 2025, highlighting protocols like FIPA‑ACL and MCP, tools such as LangGraph and ADP3.0, and edge‑computing breakthroughs.

AI ArchitectureFrameworksdistributed computing
0 likes · 16 min read
Unlocking 2025 Multi-Agent AI: Core Tech, Frameworks, and Emerging Trends
Sohu Tech Products
Sohu Tech Products
Nov 5, 2025 · Artificial Intelligence

How nndeploy Simplifies the Last Mile of On-Device AI Deployment

nndeploy is an open‑source, high‑performance on‑device AI deployment framework that abstracts the repetitive “last‑mile” workflow into a visual drag‑and‑drop DAG, offering multi‑platform inference, optimization, and ready‑to‑use model configs, enabling developers to go from prototype to production in minutes.

AI DeploymentOn-device Inferenceedge AI
0 likes · 15 min read
How nndeploy Simplifies the Last Mile of On-Device AI Deployment
DataFunTalk
DataFunTalk
Nov 3, 2025 · Artificial Intelligence

What’s Next for AIoT? Key Insights from the 2026 China AIoT Industry Conference

The 2026 China AIoT Industry Annual Conference gathered over 200 experts and 600,000 online viewers to unveil AIoT 2.0 trends, from mobile IoT breakthroughs and edge AI solutions to global connectivity, Web3 integration, and award‑winning innovations shaping the future of intelligent connectivity.

5GAIoTIoT
0 likes · 13 min read
What’s Next for AIoT? Key Insights from the 2026 China AIoT Industry Conference
Architects' Tech Alliance
Architects' Tech Alliance
Oct 29, 2025 · Artificial Intelligence

Why China’s AI Chip Industry Is Poised for a Breakthrough – Trends, Challenges, and Future Outlook

This comprehensive analysis examines the strategic importance, technical challenges, innovation pathways, and market landscape of domestic AI chips in China, highlighting key players, regional clusters, core applications such as intelligent computing, autonomous driving, and robotics, and projecting future industry bottlenecks and opportunities.

AI chipsChina semiconductorFP8
0 likes · 18 min read
Why China’s AI Chip Industry Is Poised for a Breakthrough – Trends, Challenges, and Future Outlook
Baidu Tech Salon
Baidu Tech Salon
Oct 16, 2025 · Artificial Intelligence

How Baidu’s Large‑Model Security Guard Won Vivo’s Top Security Partner Award

At the 2025 Vivo Developer Conference, Baidu Security earned the Best Security Technology Partner award for its edge‑focused large‑model security solution, which tackles multi‑layered threats on devices through comprehensive content protection, tailored edge defenses, advanced attack detection, and a rigorous evaluation framework.

AI securityBaidu SecurityContent moderation
0 likes · 5 min read
How Baidu’s Large‑Model Security Guard Won Vivo’s Top Security Partner Award
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
Oct 13, 2025 · Artificial Intelligence

How Quantization, Pruning, and Distillation Shrink AI Models for Edge Devices

This article explains the principles, key methods, and practical effects of model quantization, pruning, and knowledge distillation, comparing their advantages and disadvantages, and showing how combining these techniques enables compact, high‑performance AI models on resource‑constrained devices.

edge AIknowledge distillationmodel compression
0 likes · 7 min read
How Quantization, Pruning, and Distillation Shrink AI Models for Edge Devices
Architects' Tech Alliance
Architects' Tech Alliance
Sep 28, 2025 · Artificial Intelligence

How AI Workloads Are Redefining Network Architecture: Key Requirements and Topologies

The article examines how the rapid growth of AI models and workloads is reshaping network design, highlighting the need for ultra‑high bandwidth, sub‑millisecond latency, reliability, scalable topologies like Fat‑Tree and Dragonfly, and robust security and QoS mechanisms across data‑center, cloud, and edge environments.

AI networkingHigh Bandwidthdata center
0 likes · 11 min read
How AI Workloads Are Redefining Network Architecture: Key Requirements and Topologies
Data Party THU
Data Party THU
Aug 18, 2025 · Artificial Intelligence

Why Google’s Gemma 3 270M Model Is a Game‑Changer for Edge AI

Google’s newly released Gemma 3 270M is a compact 270‑million‑parameter language model that combines a large token vocabulary, energy‑efficient INT4 quantization, strong instruction‑following, and production‑ready checkpoints, making it ideal for fine‑tuning, on‑device deployment, and a wide range of low‑latency AI tasks.

Gemma 3Google AILanguage Model
0 likes · 7 min read
Why Google’s Gemma 3 270M Model Is a Game‑Changer for Edge AI
DevOps
DevOps
Aug 16, 2025 · Artificial Intelligence

Google Unveils Gemma 3 270M: A Tiny, High‑Efficiency Open‑Source AI Model

Google has released the open‑source Gemma 3 270M model—a compact, 270‑million‑parameter AI that runs on as little as 2 GB RAM, supports over 140 languages, handles images, and offers strong instruction‑following performance, making it ideal for edge devices and custom fine‑tuning.

Gemma 3Google AIedge AI
0 likes · 5 min read
Google Unveils Gemma 3 270M: A Tiny, High‑Efficiency Open‑Source AI Model
AntTech
AntTech
Jul 28, 2025 · Information Security

Securing AI Agents on Devices by 2025: Key Findings from the New Report

The newly released “Terminal Agent Security 2025” report, unveiled at the World AI Conference, systematically categorizes AI agent risks, outlines detection and defense methods, and proposes three protection pathways—single‑agent safety, trustworthy multi‑agent interconnection, and AI‑terminal security—to guide the emerging ecosystem of intelligent edge devices.

2025agent trustedge AI
0 likes · 6 min read
Securing AI Agents on Devices by 2025: Key Findings from the New Report
Data Thinking Notes
Data Thinking Notes
Jul 6, 2025 · Artificial Intelligence

How Quantization Shrinks Giant AI Models for Edge Devices

This article explains why quantizing massive AI models is essential for deploying them on resource‑constrained devices, outlines core quantization concepts, techniques, and methods, compares their pros and cons, and presents practical application scenarios such as smartphones, autonomous driving, IoT, and edge computing.

AI DeploymentPerformance Optimizationedge AI
0 likes · 9 min read
How Quantization Shrinks Giant AI Models for Edge Devices
Architect
Architect
May 31, 2025 · Artificial Intelligence

Edge Intelligence Implementation in the Vivo Official App: Architecture, Feature Engineering, and Model Deployment

The article details how edge intelligence is applied to the Vivo official app to improve product recommendation on the smart‑hardware floor by abstracting the problem, designing feature engineering pipelines, training TensorFlow models, converting them to TFLite, and deploying inference on mobile devices, while also covering monitoring and performance considerations.

Mobile AppRecommendation SystemTensorFlow Lite
0 likes · 19 min read
Edge Intelligence Implementation in the Vivo Official App: Architecture, Feature Engineering, and Model Deployment
Amap Tech
Amap Tech
May 27, 2025 · Artificial Intelligence

Gaode Map Custom Voice Pack: End‑to‑End TTS Model Architecture and Deployment

This article explains how Gaode Map leverages lightweight edge TTS models, dual‑autoregressive large‑model data augmentation, and a configurable audio‑processing DAG to enable users to create highly realistic personalized voice packs from just three recorded sentences.

Data AugmentationGaode MapsTTS
0 likes · 8 min read
Gaode Map Custom Voice Pack: End‑to‑End TTS Model Architecture and Deployment
vivo Internet Technology
vivo Internet Technology
May 21, 2025 · Artificial Intelligence

How Vivo’s App Leverages Edge AI to Personalize Product Recommendations

This article details how Vivo’s official app implements edge intelligence to dynamically rank and recommend hardware products on its homepage, covering problem abstraction, data collection, feature engineering, model design, TensorFlow‑Lite conversion, on‑device inference, and monitoring for a personalized user experience.

AndroidMachine LearningTensorFlow Lite
0 likes · 19 min read
How Vivo’s App Leverages Edge AI to Personalize Product Recommendations
AIWalker
AIWalker
May 14, 2025 · Artificial Intelligence

How HGO‑YOLO Achieves 87.4% Accuracy at 56 FPS with Only 4.6 MB Parameters

This paper presents HGO‑YOLO, a lightweight real‑time anomaly‑behavior detector that integrates HGNetv2 and GhostConv into YOLOv8, achieving 87.4% mAP with just 4.6 MB of parameters and 56 FPS on CPU, and validates its performance across multiple datasets and hardware platforms.

Computer VisionObject DetectionYOLO
0 likes · 25 min read
How HGO‑YOLO Achieves 87.4% Accuracy at 56 FPS with Only 4.6 MB Parameters
Architects' Tech Alliance
Architects' Tech Alliance
May 14, 2025 · Artificial Intelligence

How Cambricon’s AI Chip Roadmap Shapes the Future of Intelligent Computing

This article provides an in‑depth technical analysis of Cambricon’s AI chip portfolio—including terminal, cloud, and edge processors—detailing their micro‑architectures, key innovations such as chiplet technology and memory optimisation, roadmap plans, and real‑world applications in data centers, surveillance and autonomous driving.

AI chipsCambriconChiplet technology
0 likes · 14 min read
How Cambricon’s AI Chip Roadmap Shapes the Future of Intelligent Computing
Architects' Tech Alliance
Architects' Tech Alliance
Mar 25, 2025 · Industry Insights

How Near‑Memory Computing Can Power Edge LLMs: A 2025 Storage Framework

The article analyzes the challenges of deploying large language models on cloud servers—such as latency, security, and constant connectivity—and explains how near‑memory computing architectures (PNM, PIM, CIM) can integrate storage and processing to enable efficient, high‑performance edge AI deployments, outlining the trade‑offs of each approach.

artificial intelligenceedge AIindustry insights
0 likes · 5 min read
How Near‑Memory Computing Can Power Edge LLMs: A 2025 Storage Framework
DeWu Technology
DeWu Technology
Feb 12, 2025 · Artificial Intelligence

Edge Intelligence for Intelligent Video Cover Recommendation

The article describes an edge‑based video‑cover recommendation system for DeWu that leverages the MNN SDK and a lightweight MobileNetV3 model, performing on‑device inference with quantization and parallel processing to automatically select high‑quality covers, achieving sub‑second latency and boosting click‑through rates by up to 18 %.

Inference OptimizationVideo Coveredge AI
0 likes · 12 min read
Edge Intelligence for Intelligent Video Cover Recommendation
DevOps
DevOps
Feb 5, 2025 · Artificial Intelligence

Top 10 AI Development Trends for 2025

The article outlines ten major AI trends expected in 2025, including the rise of intelligent agents, fierce competition among multimodal large models, breakthroughs in text‑to‑video generation, long‑term memory, quantum computing, edge models, embodied intelligence, humanoid robots, AI self‑looping with synthetic data, and the enduring scaling laws of large models.

2025 trendsAIedge AI
0 likes · 6 min read
Top 10 AI Development Trends for 2025
AI Large Model Application Practice
AI Large Model Application Practice
Nov 28, 2024 · Artificial Intelligence

Can Tiny Multimodal Models Power Edge AI? Meet OmniVision-968M

This article explores how compact multimodal models like OmniVision-968M enable efficient generative AI on edge devices, detailing their architectural advantages, benchmark superiority over larger models, and step‑by‑step instructions for local installation and visual inference using NexaSDK.

AI inferenceMultimodal ModelOmniVision-968M
0 likes · 9 min read
Can Tiny Multimodal Models Power Edge AI? Meet OmniVision-968M
Architects' Tech Alliance
Architects' Tech Alliance
Nov 26, 2024 · Artificial Intelligence

Get Ready for a Shakeout in Edge NPUs

The article examines the rapid growth and increasing complexity of edge AI NPUs, discussing challenges in software and hardware acceleration, supply‑chain constraints, and the need for integrated engine solutions to sustain performance and power efficiency.

NPUedge AIsoftware complexity
0 likes · 9 min read
Get Ready for a Shakeout in Edge NPUs
21CTO
21CTO
May 21, 2024 · Artificial Intelligence

How Google’s Edge AI Makes On‑Device Large Language Models a Reality

Google I/O highlighted the rise of on‑device AI, showing how new neural processors, Edge TPU, and tools like the Edge AI SDK and TensorFlow Lite enable developers to run large language models locally, reducing latency, cost, and privacy concerns while integrating with cloud resources.

AIGoogle I/OOn-device LLM
0 likes · 9 min read
How Google’s Edge AI Makes On‑Device Large Language Models a Reality
DataFunTalk
DataFunTalk
May 20, 2024 · Artificial Intelligence

Deploying OPPO Multi‑Modal Pretrained Models in Edge‑Cloud Scenarios: Techniques and Optimizations

This article presents OPPO's practical research on deploying multi‑modal pre‑training models across mobile devices and cloud, covering edge image‑text retrieval, text‑image generation and understanding optimizations, and lightweight diffusion model techniques, with detailed algorithmic improvements, performance results, and real‑world application cases.

AIGCOPPOdiffusion
0 likes · 18 min read
Deploying OPPO Multi‑Modal Pretrained Models in Edge‑Cloud Scenarios: Techniques and Optimizations
Smart Era Software Development
Smart Era Software Development
Mar 7, 2024 · Artificial Intelligence

2024 AGI Outlook: Trends, Predictions, and a Surprise Bonus

The article analyses the 2024 AI landscape, highlighting a multimodal explosion, the limits of current AI applications, Sora as a concrete step toward AGI, the rise of AI‑native business models, edge‑AI hardware opportunities, the challenges of human‑level models, and the broader societal impacts of an AI‑driven data era.

AGIAI hardwareAI safety
0 likes · 34 min read
2024 AGI Outlook: Trends, Predictions, and a Surprise Bonus
JD Retail Technology
JD Retail Technology
Feb 28, 2024 · Artificial Intelligence

Edge AI at JD Retail: Architecture, Challenges, and Business Practices

This article details JD Retail's edge AI (on‑device intelligence) platform, covering its definition, performance and security challenges, three‑layer cloud‑edge‑device architecture, key components such as high‑performance inference engine, data pipeline, Python VM container, and real‑world applications in traffic distribution and image recognition.

AI ArchitectureJD Retailedge AI
0 likes · 15 min read
Edge AI at JD Retail: Architecture, Challenges, and Business Practices
AsiaInfo Technology: New Tech Exploration
AsiaInfo Technology: New Tech Exploration
Jan 29, 2024 · Artificial Intelligence

Can Vision Transformers Revolutionize Edge AI Video Analysis?

This article examines the rapid rise of edge AI video analytics, explains how Vision Transformers (ViT) overcome the limitations of traditional CNNs, details a technical pre‑research and POC conducted by a Chinese AI firm, evaluates several open‑source large models, and concludes that the OFA model best meets current edge deployment needs.

OFAedge AIvideo analytics
0 likes · 14 min read
Can Vision Transformers Revolutionize Edge AI Video Analysis?
DaTaobao Tech
DaTaobao Tech
Jun 12, 2023 · Artificial Intelligence

Real-Time Video Stream Subject Recognition for E-commerce (MetaSight)

MetaSight introduces a real‑time video‑stream subject recognition system that replaces the traditional capture‑upload‑search flow with continuous, on‑camera product identification, using a sub‑10 MB edge model, global IDs for frame continuity, edge‑cloud collaboration, and batch processing to cut interaction steps, lower server load, and pave the way for future AR/XR shopping experiences.

ARXRedge AI
0 likes · 10 min read
Real-Time Video Stream Subject Recognition for E-commerce (MetaSight)
Alipay Experience Technology
Alipay Experience Technology
May 10, 2023 · Mobile Development

How Alipay’s Homepage Leverages Edge AI for Smarter Refreshes

This article explains how Alipay’s homepage team collaborates with the edge‑intelligence team to use real‑time client‑side behavior data and algorithm platforms, transforming refresh strategies across time, space, and event dimensions, improving recommendation efficiency, reducing duplication, and delivering measurable performance gains.

edge AIfrontendmobile
0 likes · 15 min read
How Alipay’s Homepage Leverages Edge AI for Smarter Refreshes
Alipay Experience Technology
Alipay Experience Technology
Nov 28, 2022 · Artificial Intelligence

Why Edge Intelligence Is Shaping the Future of Mobile Apps

This article explains the concept of edge intelligence, its advantages over cloud‑based AI, the technical challenges of deploying AI on mobile devices, Ant Group's development timeline, core technology stack, and future directions for edge‑cloud collaboration.

ai-optimizationedge AImobile AI
0 likes · 10 min read
Why Edge Intelligence Is Shaping the Future of Mobile Apps
AsiaInfo Technology: New Tech Exploration
AsiaInfo Technology: New Tech Exploration
Sep 19, 2022 · Industry Insights

How Edge AI Is Transforming Vertical Industries: Challenges, Technologies, and Real‑World Cases

This article examines the rapid growth of edge AI, outlines its current development, identifies technical and deployment challenges, presents key innovations such as RepRetinaFace and DeepStream, and showcases a 5G‑enabled smart construction solution with concrete performance data and implementation details.

5GDeepStreamVertical Industry
0 likes · 15 min read
How Edge AI Is Transforming Vertical Industries: Challenges, Technologies, and Real‑World Cases
ByteDance Terminal Technology
ByteDance Terminal Technology
Jul 29, 2022 · Artificial Intelligence

Pitaya: ByteDance’s End‑Side AI Engineering Platform Overview

Pitaya, built by ByteDance’s Client AI and MLX teams, is a comprehensive end‑side AI engineering platform that provides a full workflow from model development and data preparation to deployment, monitoring, and federated learning, supporting large‑scale commercial scenarios across multiple apps.

AI PlatformFederated LearningMachine Learning
0 likes · 14 min read
Pitaya: ByteDance’s End‑Side AI Engineering Platform Overview
DaTaobao Tech
DaTaobao Tech
Jul 15, 2022 · Artificial Intelligence

Edge AI Model Evaluation and Optimization with TensorFlow, JAX, and TVM

The article demonstrates how to evaluate, compress, and convert deep‑learning models for edge devices using TensorFlow, JAX, and TVM—showing a faster iPhone‑based MNIST training benchmark, FLOPs measurement scripts, TFLite/ONNX/CoreML conversion, TVM compilation with auto‑tuning, and up to 50 % speed improvements on mobile NPU hardware.

JAXTVMTensorFlow
0 likes · 29 min read
Edge AI Model Evaluation and Optimization with TensorFlow, JAX, and TVM
Alibaba Terminal Technology
Alibaba Terminal Technology
Jun 22, 2022 · Artificial Intelligence

How Fast Can Your Smartphone Run ML Models? Exploring Edge AI Optimization

This article examines the computational capabilities of modern mobile devices for machine learning, compares training times on a MacBook and iPhone, explains model evaluation metrics like FLOPs, and provides step‑by‑step guides for converting and optimizing models using TensorFlow, PyTorch, ONNX, JAX, and TVM for edge deployment.

JAXTVMTensorFlow
0 likes · 29 min read
How Fast Can Your Smartphone Run ML Models? Exploring Edge AI Optimization
ITPUB
ITPUB
Jun 20, 2022 · Artificial Intelligence

Edge AI Boosts Mobile Search Ranking: Inside Meituan’s On‑Device Re‑ranking

This article details Meituan’s implementation of on‑device deep learning models for search re‑ranking, covering the motivations for edge intelligence, feature engineering, feedback sequence modeling, model architecture, deployment optimizations, experimental results, and future directions, offering practical insights for developers building large‑scale AI on mobile.

Real-time feedbackedge AIfeature engineering
0 likes · 28 min read
Edge AI Boosts Mobile Search Ranking: Inside Meituan’s On‑Device Re‑ranking