https://stream.andersonr.net/videos/watch/2843cbf6-e446-490e-bfe9-86f38d31d924 ESP32 AI squeezes a 28.9-million-parameter language model onto an eight-dollar ESP32-S3 with no server connection. The trick is keeping a 25-million-parameter embedding table in flash and fetching only the rows needed for each token, while the compute-heavy core stays in faster memory. The maintainer measures roughly 9.5 tokens per second. It’s an architecture experiment, not a chatbot: the TinyStories model writes simple stories but can’t answer questions or code. #github #opensource https://github.com/slvDev/esp32-ai Mon, 27 Jul 2026 06:00:04 GMT https://validator.w3.org/feed/docs/rss2.html PeerTube - https://stream.andersonr.net https://stream.andersonr.net/client/assets/images/icons/icon-1500x1500.png https://stream.andersonr.net/videos/watch/2843cbf6-e446-490e-bfe9-86f38d31d924 All rights reserved, unless otherwise specified in the terms specified at https://stream.andersonr.net/about and potential licenses granted by each content's rightholder.