Rockchip Edge AI
Designing complete edge-AI products: camera to NPU to application, with LLMs on RK3588/RK3576.
An edge-AI product is more than a model. It needs a camera or video ingest (MPP decode for RTSP streams), pre-processing on RGA, NPU inference, CPU post-processing and an application layer (MQTT, REST, UI). RK3588 can decode many 1080p streams while running detection on all three NPU cores; RKLLM brings small LLMs on-device.
Key points
- Budget memory bandwidth: video decode, RGA and NPU all share DDR.
- Use zero-copy DMA buffers between MPP, RGA and RKNN where possible.
- Watch thermals. Sustained NPU + VPU load needs a proper heatsink or the SoC throttles.