Dec 9, 2024 · Artificial Intelligence

Large Model Application Engineering: ZhiLight Inference Framework and Zhihu Direct Answer System

The article details Zhihu's technical salon on large‑model engineering, covering the RAG‑based Zhihu Direct Answer system, the open‑source ZhiLight inference framework, prompt engineering, agent research, and future plans for integrating AI into product and community workflows.

AI EngineeringAgentInference Framework

0 likes · 8 min read

Large Model Application Engineering: ZhiLight Inference Framework and Zhihu Direct Answer System

Didi Tech

Aug 17, 2019 · Artificial Intelligence

AoE (AI on Edge): Design Principles, Architecture, and Integration Guide

AoE (AI on Edge) is Didi’s open‑source runtime that unifies edge inference frameworks such as NCNN and TensorFlow Lite behind stable, easy‑to‑use and secure interfaces, isolates native code in a separate Android process, offers pre‑/post‑processing abstractions, provides Android/iOS SDKs, and invites developers to contribute via its GitHub repository.

AIAndroidInference Framework

0 likes · 10 min read

AoE (AI on Edge): Design Principles, Architecture, and Integration Guide