Running four AI models fully offline on a Nextion ONX3248G035
A while back I unboxed a Nextion touchscreen dev board and vibe-coded a WiFi auditor onto it . That board has been sitting on my desk ever since, and one question kept nagging: this thing has 8 MB of PSRAM and a dual-core ESP32-S3. Could it run an actual language model? Not talk to one over WiFi — run one. Turns out: yes. Four of them, in fact. No internet, no server, no phone, no PC. Everything in this video is generated by the chip on the board. All four models, on the board, offline. Loading a model from the SD card, then generating. What is actually running The board boots into a menu. Tap a model, it loads and starts generating. All of these were trained from scratch on an M2 Max in well under an hour. Malayalam English Arithmetic Icons Parameters 7.6M 7.6M 1.0M 577K Flash 3.95 MB 3.95 MB 0.41 MB 0.58 MB Speed 13.0 tok/s 14.9 tok/s 20.7 tok/s 3.4 s/image First things first: this is not a Nextion HMI The ONX3248G035 is sold under Nextion branding, and the name is...
