Multi-Camera AI NVR on RK3588
Ingest 8–16 RTSP streams, decode on the VPU, run YOLO on all three NPU cores and record to NVMe/SATA.
System blocks
- IP cameras → GbE / 2.5 GbE → MPP hardware decode (H.264/H.265)
- RGA resize/letterbox → RKNN (one model instance per NPU core)
- CPU: tracking, NMS, rules engine → MQTT / REST / web UI
- Recording: NVMe over PCIe 3.0 x4 or SATA through the combo PHY
Software stack
- Debian or Buildroot on the vendor 6.1 kernel
- MPP + RGA + RKNN runtime (C API)
- GStreamer or FFmpeg with Rockchip MPP support
- Web dashboard + MQTT
Watch out for
- DDR bandwidth saturates before NPU TOPS do
- Thermal throttling under sustained decode + NPU load
- Stream reconnect and watchdog logic matter more than the model