BestHub
Sign in
Tag

Inference Framework

0 views collected around this technical thread.

Zhihu Tech Column
Zhihu Tech Column
Dec 9, 2024 · Artificial Intelligence

Large Model Application Engineering: ZhiLight Inference Framework and Zhihu Direct Answer System

The article details Zhihu's technical salon on large‑model engineering, covering the RAG‑based Zhihu Direct Answer system, the open‑source ZhiLight inference framework, prompt engineering, agent research, and future plans for integrating AI into product and community workflows.

AI EngineeringInference FrameworkPrompt Engineering
0 likes · 8 min read
Large Model Application Engineering: ZhiLight Inference Framework and Zhihu Direct Answer System
Didi Tech
Didi Tech
Aug 17, 2019 · Artificial Intelligence

AoE (AI on Edge): Design Principles, Architecture, and Integration Guide

AoE (AI on Edge) is Didi’s open‑source runtime that unifies edge inference frameworks such as NCNN and TensorFlow Lite behind stable, easy‑to‑use and secure interfaces, isolates native code in a separate Android process, offers pre‑/post‑processing abstractions, provides Android/iOS SDKs, and invites developers to contribute via its GitHub repository.

AIAndroidInference Framework
0 likes · 10 min read
AoE (AI on Edge): Design Principles, Architecture, and Integration Guide