https://stream.andersonr.net/videos/watch/c35fdc80-5213-4ae5-ad7f-240ba9818568 Swiftlet runs 35B and 80B Qwen mixture-of-experts models on Apple devices by keeping the dense core in memory and streaming routed experts from SSD. QPack files turn each expert fetch into one read, while caching and Metal kernels handle inference. The maintainer reports the 35B model using about 2.5 gigabytes of RAM on an iPhone 17 at roughly one token per second. #github #opensource https://github.com/leonickson1/Swiftlet Tue, 01 Sep 2026 11:59:40 GMT https://validator.w3.org/feed/docs/rss2.html PeerTube - https://stream.andersonr.net https://stream.andersonr.net/client/assets/images/icons/icon-1500x1500.png https://stream.andersonr.net/videos/watch/c35fdc80-5213-4ae5-ad7f-240ba9818568 All rights reserved, unless otherwise specified in the terms specified at https://stream.andersonr.net/about and potential licenses granted by each content's rightholder.