OPPO Kernel Craftsman
Oct 28, 2022 · Artificial Intelligence
ShaderNN: A GPU Shader‑Based Lightweight Inference Engine for Mobile AI Applications
ShaderNN is an open‑source, sub‑2 MB GPU‑shader inference engine that runs TensorFlow, PyTorch and ONNX models directly on mobile graphics textures via OpenGL fragment and compute shaders, delivering real‑time, low‑power AI for image‑heavy tasks while eliminating third‑party dependencies and achieving up to 90 % speed gains.
GPUInference EngineShader
0 likes · 11 min read