<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
    <channel>
        <title>A 27B Model Now Runs On An iPhone. Here's The Whole Local AI Ladder</title>
        <link>https://stream.andersonr.net/videos/watch/9343b0c5-46cd-41f4-bfab-26353a423144</link>
        <description>Two weeks ago a 27 billion parameter model started running on an iPhone. Nobody added memory to that phone, and nobody added memory to your graphics card either. Four compression tricks landed in the last six months, and each one hands you capability you never paid for in VRAM. This is where every one of them lands, sorted by the only spec that decides what you can actually run at home. ⏱️ CHAPTERS 00:00 - A 27B model on a phone 00:48 - Find your VRAM number 01:08 - Trick 1: run the same layers twice (4 to 8 GB) 02:50 - Trick 2: shrink the bits, not the model (8 to 24 GB) 05:11 - Trick 3: stop the model rambling (24 to 96 GB) 07:03 - Trick 4: only wake the experts you need (96 to 192 GB) 09:19 - The top rung, and the licensing trap 11:30 - The honest ceiling: where local still loses 12:00 - How to pick yours Thank you so much for watching. Please like the video and subscribe to our channel. #ai #localai #ollama #qwen Notice: The content was created with the assistance of AI and may contain inaccuracies or errors. ▬▬▬▬▬▬ 👋 Contact me 👋 ▬▬▬▬▬▬ ➡ LinkTree: https://link.githubawesome.com/linktree ➡ Buy Me A Coffee https://link.githubawesome.com/buymeacoffee</description>
        <lastBuildDate>Tue, 28 Jul 2026 12:36:10 GMT</lastBuildDate>
        <docs>https://validator.w3.org/feed/docs/rss2.html</docs>
        <generator>PeerTube - https://stream.andersonr.net</generator>
        <image>
            <title>A 27B Model Now Runs On An iPhone. Here's The Whole Local AI Ladder</title>
            <url>https://stream.andersonr.net/client/assets/images/icons/icon-1500x1500.png</url>
            <link>https://stream.andersonr.net/videos/watch/9343b0c5-46cd-41f4-bfab-26353a423144</link>
        </image>
        <copyright>All rights reserved, unless otherwise specified in the terms specified at https://stream.andersonr.net/about and potential licenses granted by each content's rightholder.</copyright>
        <atom:link href="https://stream.andersonr.net/feeds/video-comments.xml?videoId=9343b0c5-46cd-41f4-bfab-26353a423144" rel="self" type="application/rss+xml"/>
    </channel>
</rss>