LLM向けのSBCについての詳細

Hardware.ai

チャンネル登録者数 1.53万人

9103 回視聴・いいね・ 2025/04/11

This second video gives you the real story on what Luckfox Omni3576 — a Jetson-like SBC powered by the RK3576 SoC — can actually do. I benchmark its performance to compare it against the Jetson Orin Nano and Raspberry Pi 5 using Gemma 2B, Llama 3.1 8B, and Qwen2-VL-2B models, run a few more examples, including multi-modal inference and also measure the power consumption.

#aliexpress links:
s.click.aliexpress.com/e/_EwnUdss Luckfox Omni3576 board
s.click.aliexpress.com/e/_ExaOYU8 Luckfox Omni3576 module
s.click.aliexpress.com/e/_ExScjyg Raspberry Pi 5
s.click.aliexpress.com/e/_oFVbErR Nvidia Jetson Orin Nano

Hardware.ai