<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[ANORAK]]></title><description><![CDATA[Watch is eating play. Video got frictionless; it never got interactive. We're building the medium that closes the gap: interactive generative video.]]></description><link>https://blog.anorak.tech</link><image><url>https://substackcdn.com/image/fetch/$s_!tl7a!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39d8a03c-8643-4450-83ee-1d311ff791a1_1280x1280.png</url><title>ANORAK</title><link>https://blog.anorak.tech</link></image><generator>Substack</generator><lastBuildDate>Tue, 17 Nov 2026 11:29:49 GMT</lastBuildDate><atom:link href="https://blog.anorak.tech/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Anorak]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[anorak3@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[anorak3@substack.com]]></itunes:email><itunes:name><![CDATA[Anorak]]></itunes:name></itunes:owner><itunes:author><![CDATA[Anorak]]></itunes:author><googleplay:owner><![CDATA[anorak3@substack.com]]></googleplay:owner><googleplay:email><![CDATA[anorak3@substack.com]]></googleplay:email><googleplay:author><![CDATA[Anorak]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[News: Anorak Secures $5m Pre-Seed Funding]]></title><description><![CDATA[By Anorak]]></description><link>https://blog.anorak.tech/p/news-anorak-secures-5m-pre-seed-funding</link><guid isPermaLink="false">https://blog.anorak.tech/p/news-anorak-secures-5m-pre-seed-funding</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Wed, 11 Nov 2026 16:21:39 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/01ad5e7b-faf7-4538-93e0-f73cd8ed62d8_8000x4500.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Some news we&#8217;re very excited to share: Anorak has raised $5m in pre-seed funding.</p><p>It&#8217;s a pretty significant milestone for us, and a big vote of confidence in what we&#8217;re building and, more importantly, what we believe interactive entertainment can become.</p><p>When we had the idea for Anorak, the ambition was simple to describe, if not quite so simple to deliver: make any pursuit playable.</p><p>At Hutch, we learned just how passionate people can be about the things they love. Car enthusiasts weren&#8217;t just playing our games; they were obsessing over every detail, sharing their knowledge and building communities around a common interest. We started asking ourselves: what if you could create that kind of experience for <em>any</em> interest, no matter how niche?</p><p>That&#8217;s the opportunity we&#8217;re pursuing at Anorak. From anglers and sneakerheads to birdwatchers, padel players and everything in between, we think there&#8217;s a huge world of underserved communities waiting for entirely new forms of entertainment (even if they don&#8217;t know it yet!).</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ay46!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ay46!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg 424w, https://substackcdn.com/image/fetch/$s_!ay46!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg 848w, https://substackcdn.com/image/fetch/$s_!ay46!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!ay46!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ay46!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg" width="1456" height="922" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:922,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2838534,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/224464997?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ay46!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg 424w, https://substackcdn.com/image/fetch/$s_!ay46!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg 848w, https://substackcdn.com/image/fetch/$s_!ay46!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!ay46!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F306d1b4c-b826-4fab-a56d-329908e29e2c_5290x3349.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Left-to-right: Co-founders Tak Fung (running the AI lab in Chengdu), Shaun Rutland (CEO) and Jonathan Alpine (CCO)</figcaption></figure></div><p>It&#8217;s fantastic to have Backed VC and Play Ventures co-leading this round, alongside Supercell and MTG, with some brilliant angel investors on board too, including Justin Waldron, co-founder of Zynga. To have the backing of people who have helped shape the games and entertainment industries feels like a real endorsement of our vision.</p><p>The funding gives us the resources to grow our already 20-strong team across London and Chengdu, bring our first playable formats to market and build towards opening up our creator platform in early 2027.</p><p>There&#8217;s a lot to do, there will be lots of challenges (foreseen and not so!) but that&#8217;s exactly what makes this exciting.</p><p>A huge thank you to our investors, our team and everyone who&#8217;s been part of getting us here. We&#8217;re only just getting started.</p><p><strong>Let&#8217;s make any pursuit playable.</strong></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech/&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech/"><span>Visit ANORAK</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/p/news-anorak-secures-5m-pre-seed-funding?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://blog.anorak.tech/p/news-anorak-secures-5m-pre-seed-funding?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p>]]></content:encoded></item><item><title><![CDATA[Experiment: Tackling ‘The Beautiful Game’]]></title><description><![CDATA[By Bob, Generative AI Noodler]]></description><link>https://blog.anorak.tech/p/experiment-tackling-the-beautiful</link><guid isPermaLink="false">https://blog.anorak.tech/p/experiment-tackling-the-beautiful</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Tue, 10 Nov 2026 09:16:38 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/702df26d-5842-4779-bd7f-4adb440a5df6_1786x1569.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Making generated video follow the game: can a simple football game simulation become convincing match-like footage&#8212;and without changing the action? We continue to explore different ways in which traditional game development might work alongside interactive generative video.</strong></p><p>In this experiment we let a football game simulation determine and indicate what&#8217;s happening on the pitch, then task generative video models with deciding how it all looks. I mean, we did give them plenty of pointers&#8230;</p><p>Getting the desired results here is no small task. Set of tasks, even. We&#8217;re asking the model to do three things at once: repeat the play, replace the blockout (rough 3D draft of a game) with the right players and kits, and make the result appear like real footage. What could possibly go wrong?</p><p>Quite a bit, as it happens. Spoiler alert.</p><p>We&#8217;ll take you through what we tried before training a LoRA (a lightweight add-on used to customise AI models without retraining the entire system) specifically for football: the design experiments, the inconsistencies we found, and the questions raised.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;fe7cc6c6-8081-43cf-ba43-57368329a29a&quot;,&quot;duration&quot;:null}"></div><p><em>The same passage of play: the blockout on the left and an H3 Max output on the right. Both are combined in one six-second video, playing at their original speed.</em></p><p></p><p><span data-color="#93c47d" style="color: rgb(147, 196, 125);">01 / What we tried</span></p><h2>Build the play first then create the imagery</h2><p>The design question was whether we could keep the logic and responsiveness expected of a modern game [simulation, in this case] while giving the gamer a much richer visual experience. Crucially, the video model shouldn&#8217;t decide whether a pass connects or a shot is saved; t<strong>hose variables are dictated by the gameplay.</strong></p><p>We started with a deliberately simple blockout. Capsules and boxes indicate and describe player positions, movement and team identity. Both the ball and camera follow the intended passage of play. The generative video model has to supply the human articulation, kits, grass, stadium and broadcast-like videography.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ovJ5!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png 424w, https://substackcdn.com/image/fetch/$s_!ovJ5!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png 848w, https://substackcdn.com/image/fetch/$s_!ovJ5!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png 1272w, https://substackcdn.com/image/fetch/$s_!ovJ5!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!ovJ5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png" width="1456" height="290" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:290,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43081,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/224224993?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ovJ5!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png 424w, https://substackcdn.com/image/fetch/$s_!ovJ5!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png 848w, https://substackcdn.com/image/fetch/$s_!ovJ5!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png 1272w, https://substackcdn.com/image/fetch/$s_!ovJ5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3d1bd9a-903e-43c1-b6cd-5282f145c949_1674x333.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div></figure></div><p><strong>Give the model more than a look.</strong></p><p>We paired the motion reference with an appearance sheet (a blueprint for the AI to understand exactly how a character looks from multiple angles and in different poses) and a structured prompt. The sheet describes the broadcast look and team strips while the prompt asks for the action to stay completely synchronised: pass, control, shot, save. It also spells out which blockout shapes belong to each team.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!m7ec!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!m7ec!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg 424w, https://substackcdn.com/image/fetch/$s_!m7ec!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg 848w, https://substackcdn.com/image/fetch/$s_!m7ec!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!m7ec!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!m7ec!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg" width="1024" height="576" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:576,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:137586,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/224224993?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!m7ec!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg 424w, https://substackcdn.com/image/fetch/$s_!m7ec!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg 848w, https://substackcdn.com/image/fetch/$s_!m7ec!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!m7ec!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b62b43e-4491-47a0-8071-e6dfa602756a_1024x576.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>The supplied appearance reference. It describes what the scene should look like; the simulation describes what should happen.</em></p><p></p><p><strong>One passage. Five pipelines.</strong></p><p>We ran a benchmark comparison test evaluating the performance and quality of different video models and combinations; different deployment methods (running a model locally on our hardware vs. managed cloud services) and contrasting variants of a heavy-duty model against a lightweight version.</p><p>Specifically, we compared Minimax H3 on Anorak compute, a turbo variant, hosted H3, hosted H3 Max and Seedance 2.0 Mini. The outputs below are the second-pass (no, not <em>that</em> kind of pass) comparison used in the earlier simulation we showed you. Watch the bodies, ball, camera and background as well as the overall finish.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;51501fca-adda-486f-a4c4-9dc7e0c6fcf7&quot;,&quot;duration&quot;:null}"></div><p><em>In order: Source simulation, Anorak original, Anorak turbo (labelled &#8220;distill&#8221;), hosted H3, hosted H3 Max and Seedance 2.0 Mini. Use fullscreen for a closer look (better on desktop). This is just a one-off example of each pipeline, not a definitive scorecard. Keep in mind that using the same setting number (seed) won&#8217;t give us identical videos on different platforms. </em></p><p></p><p><span data-color="#93c47d" style="color: rgb(147, 196, 125);">02 / What isn&#8217;t consistent</span></p><h2>Three problems in one generation.</h2><p>It helps to segment what we are asking the models to do and look at each separately. A clip can look good on one of these dimensions and fall short on another. The difficult part is getting all three to work together.</p><p><span data-color="#93c47d" style="color: rgb(147, 196, 125);">01</span></p><p><strong>Repeat the play pattern</strong></p><p>The runs, pass, first touch, shot and save need to happen as they do in the simulation. Yes, the model can generate a plausible attack&#8230; but may change a player&#8217;s route, add someone to the scene or reinterpret the action. For a workable game, the footage obviously needs to show the play that follows from the player&#8217;s decisions, not some albeit sometimes realistic-looking random action.</p><p><span data-color="#93c47d" style="color: rgb(147, 196, 125);">02</span></p><p><strong>Replace the players and kits</strong></p><p>The blocks need to become people, with the right team identity and kit throughout the clip. In these examples, one output leaves a magenta cylinder on the pitch; another turns it into a person but keeps the magenta. Shirt details and numbers can also vary. Following a shape or colour is only part of the job!</p><p><span data-color="#93c47d" style="color: rgb(147, 196, 125);">03</span></p><p><strong>Make it feel like real footage</strong></p><p>Players need convincing strides, foot plants and contact with the ball and overlapping bodies need to stay separate. The camera, crowd, grass and stadium all contribute to the broadcast feel. Some outputs here have a convincing finish; others lose crowd detail or show unclear limbs. The blockout has no articulated bodies, so the model has to invent much of this, with the help of the appearance sheet.</p><h2><span data-color="#93c47d" style="color: rgb(147, 196, 125);">Getting the play right, the players right and the picture right are separate achievements. To get where we&#8217;d want to get to with this, we need them in the same clip. Every time.</span></h2><p>That&#8217;s the story that&#8217;s emerging from this experiment: we can see pieces of the result we&#8217;re looking for (which is promising) but asking for the whole transformation in one generation appears to push the limits of these systems. The experiment examples don&#8217;t establish that any one task is solved. We also saw variation across reruns, so repeatability remains a question across all three problems (let&#8217;s call them challenges &#128578;).</p><p><strong>A safeguard, with a clear boundary.</strong></p><p>Our experiment associates each final video with the settings used to make it: the setup, the choices made, the starting number (seed), and the motion. Playback can compare recorded ball-contact events with the live passage and fall back to the blockout when they diverge.</p><p>That check compares event metadata but it doesn&#8217;t inspect the generated pixels, detect an extra player (or streaker) on the pitch or verify the kit. It protects the link to the recorded passage but it doesn&#8217;t guarantee the footage accurately follows the reference.</p><p><strong>One important lesson about comparisons.</strong></p><p>When you change both where a model runs and how it is sped up at the same time, it&#8217;s hard to tell which one caused the result. In fact, our earlier notes were wrong; degradation that we blamed on the speeding-up method (distillation) actually happened in the standard version, too. Moving forward, we need to test these settings separately.</p><p></p><h2><span data-color="#93c47d" style="color: rgb(147, 196, 125);">Lessons learnt and what&#8217;s next&#8230;</span></h2><ol><li><p><strong>Sticking to the Reference</strong><br>Using a <em>Control LoRA</em> and locking down keyframes helps stop the AI from drifting away from our source imagery. The main challenge now is keeping the movement natural while freezing player details.</p></li><li><p><strong>Trying a 3-Step Process</strong><br>Instead of doing everything at once, we might split the work into three steps: one for the motion, one to add the players/kits, and one for the final video look. The risk is that later steps might accidentally mess up the movement or add extra wait time.</p></li><li><p><strong>Deciding What to Train</strong><br>Instead of trying to fix every glitch with one massive update, we want to train a custom LoRA for just one specific step. This helps us pinpoint exactly where the AI needs the most help.</p></li><li><p><strong>Testing the New Plan</strong><br>We will test our current method against this new 3-step setup and custom LoRAs. We will score the movement, outfits, and video quality separately, checking the footage after every step to see exactly where it breaks.</p></li></ol><p><strong>What we want to see improve</strong></p><ul><li><p><strong>Play pattern:</strong> the intended movement, ball contacts, timing and outcome.</p></li><li><p><strong>Players and kits:</strong> complete replacement of the blockout, with stable identities and team strips.</p></li><li><p><strong>Footage quality:</strong> believable bodies, contact, camera and environment.</p></li><li><p><strong>All three together:</strong> repeatable success across runs and unfamiliar passages, at a practical generation cost.</p></li></ul><p></p><h3><span data-color="#93c47d" style="color: rgb(147, 196, 125);">The next milestone is a dependable connection between the decision a player makes and the action they see.</span></h3><h3><span data-color="#93c47d" style="color: rgb(147, 196, 125);">Stay tuned.</span></h3><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech/&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech/"><span>Visit ANORAK</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/p/experiment-tackling-the-beautiful?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://blog.anorak.tech/p/experiment-tackling-the-beautiful?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Experiment: Your Pet Story]]></title><description><![CDATA[By Sean]]></description><link>https://blog.anorak.tech/p/experiment-your-pet-story</link><guid isPermaLink="false">https://blog.anorak.tech/p/experiment-your-pet-story</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Thu, 05 Nov 2026 10:24:50 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/95ad38bc-2f28-44a7-80ae-155d988a75f6_1212x1131.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Okay. Who would like to see their pet/s going on fantastic, beautifully animated adventures? </p><p>I can see quite a few hands up&#8230;</p><p>Take a photo of your cat or dog and moments later they&#8217;re in an interactive video experience for you to play with on your phone.</p><p>Check in for a few minutes each day and they&#8217;ll have been off travelling the world, getting up to mischief, catching sunshine, chasing shadows, while bringing back paintings of local scenery and souvenirs for your collection.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;23c8e77f-b9f5-406d-8a58-ba8cdeb12113&quot;,&quot;duration&quot;:null}"></div><p>It&#8217;s not a lookalike. It&#8217;s your pet. With the same markings, the same face &#8211; maybe even the same attitude, though that&#8217;s difficult to pull from a 2D image &#8211; for now! Perhaps we could incorporate text prompts: jumpy, skittish, floppy, curious, sedentary (except at mealtimes).</p><p>The tricky bit right now is the sheer complexity &#8212; there&#8217;s a lot of real-time generation and a lot of workflow that requires time to optimise.</p><p>Development is currently paused as we have so many other ideas and experiments in the pipeline and only so much capacity, so here&#8217;s a little preview &#8216;ad&#8217; I made to give you a flavour, and if we gauge some interest, you never know, we may pick it up and work on a playable demo for you&#8230;</p><p>What sort of features would you like to see? </p><p>And what kind of adventures (or mischief) would you like to see <em>your</em> pet get up to?</p><p>Let us know in the comments.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech/&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech/"><span>Visit ANORAK</span></a></p>]]></content:encoded></item><item><title><![CDATA[Experiment: The Perfect Loop (And No One’s Watching)]]></title><description><![CDATA[By Farms]]></description><link>https://blog.anorak.tech/p/experiment-the-perfect-loop-and-no</link><guid isPermaLink="false">https://blog.anorak.tech/p/experiment-the-perfect-loop-and-no</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Tue, 03 Nov 2026 10:20:08 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/587d1eb3-f50a-4d67-a321-a2fb7fd2045a_1920x1080.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>We built a dress-up app entirely out of generated video, with user-triggered outfit changes taking place while the character dances, all in a seamless loop. It took 1,548 clips that all had to be right; far too many to check by human eye. Nobody has time (or resources) for that. So we needed that oversight to be baked in. The majority of it, at least&#8230;</p><p>Here&#8217;s how we made the process reliable at scale: diffusion &#8216;recipes&#8217; that make the right pre-generated clip likely to appear (as well as in perfect sequence), and self-healing systems that measure every clip, fixing the ones that need fixing.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!-dnP!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-dnP!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png 424w, https://substackcdn.com/image/fetch/$s_!-dnP!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png 848w, https://substackcdn.com/image/fetch/$s_!-dnP!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png 1272w, https://substackcdn.com/image/fetch/$s_!-dnP!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!-dnP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png" width="1084" height="1860" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1860,&quot;width&quot;:1084,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2475753,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!-dnP!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png 424w, https://substackcdn.com/image/fetch/$s_!-dnP!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png 848w, https://substackcdn.com/image/fetch/$s_!-dnP!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png 1272w, https://substackcdn.com/image/fetch/$s_!-dnP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F355dd988-7f83-40d7-93e6-6b88b7f8b891_1084x1860.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>Every clip has to be right</h3><p>A photoreal character dances on a loop. You get to pick and modify her outfit on the fly by scrolling through various clothing choices for each body section; head, torso, legs, and feet. Tap a new hat and she pulls the old one off, throws it away, hops, and lands wearing the new one. Nothing is generated while you play. </p><p>We create every outfit&#8217;s loop, and every change between outfits, up front, and the app cuts between them on the exact frame where they line up. How did we do it? </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ZptK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ZptK!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png 424w, https://substackcdn.com/image/fetch/$s_!ZptK!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png 848w, https://substackcdn.com/image/fetch/$s_!ZptK!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png 1272w, https://substackcdn.com/image/fetch/$s_!ZptK!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ZptK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png" width="1456" height="415" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:415,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:681818,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ZptK!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png 424w, https://substackcdn.com/image/fetch/$s_!ZptK!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png 848w, https://substackcdn.com/image/fetch/$s_!ZptK!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png 1272w, https://substackcdn.com/image/fetch/$s_!ZptK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e9f8c6b-d027-49fb-b95f-0d20a371a93e_2868x818.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>So. We have 10 items of clothing in total to choose from. This doesn&#8217;t sound like much, but those ten items amount to: </p><ul><li><p><strong>36</strong> unique outfit combinations/loops</p></li><li><p><strong>1,512</strong> transitions:</p></li><li><p><strong>1,548 c</strong>lips (built from roughly <strong>12,000</strong> videos once every intermediate step is counted) </p></li></ul><p>Because the app cuts straight from one clip to the next, a single sketchy one is enough to break the illusion. Thankfully, generated video goes wrong in familiar ways, which gave us clear problems to solve:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!GEFj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!GEFj!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png 424w, https://substackcdn.com/image/fetch/$s_!GEFj!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png 848w, https://substackcdn.com/image/fetch/$s_!GEFj!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png 1272w, https://substackcdn.com/image/fetch/$s_!GEFj!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!GEFj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png" width="1456" height="557" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:557,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1455921,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!GEFj!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png 424w, https://substackcdn.com/image/fetch/$s_!GEFj!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png 848w, https://substackcdn.com/image/fetch/$s_!GEFj!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png 1272w, https://substackcdn.com/image/fetch/$s_!GEFj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26c949a2-a0f0-4c9d-9fcc-e3d5b3d00477_2027x776.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>On its own, a generation pipeline is what a control engineer (the human at the steering wheel) would call an <em>open loop</em>. Following the prompt, you put a seed in and get a video clip out. Every attempt is a bit of a dice role, and there&#8217;s no automatic way to check the result. That job is left to a human; fine for a handful of clips but you can appreciate how it&#8217;s completely unfeasible when we&#8217;re dealing with thousands (and with a releasable dress-up app like this we&#8217;d likely incorporate many more clothing items than feature in this demo; we could be talking tens or even hundreds of thousands of clips).</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!kYko!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png 424w, https://substackcdn.com/image/fetch/$s_!kYko!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png 848w, https://substackcdn.com/image/fetch/$s_!kYko!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png 1272w, https://substackcdn.com/image/fetch/$s_!kYko!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!kYko!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png" width="1456" height="348" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:348,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:128482,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!kYko!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png 424w, https://substackcdn.com/image/fetch/$s_!kYko!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png 848w, https://substackcdn.com/image/fetch/$s_!kYko!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png 1272w, https://substackcdn.com/image/fetch/$s_!kYko!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff53c700e-2e87-47a8-9c82-f4bfabe15413_1939x463.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div></figure></div><p>We <em>closed</em> the loop in two ways: first, we make the plant (the video generation model) better behaved, so the correct clip is the most likely one. Basic probability. Second, we wrap every generation in a feedback loop that measures the clip and repairs it when it falls short.</p><h3>1 &#183; Recipes that make the correct clip likely</h3><p>Prevention is better than cure. Before measuring anything, we build the generation process using specialised diffusion recipes (steps that guide a diffusion model from random noise to a coherent, motion-consistent video) that prevent entire categories of problems from happening in the first place.</p><h4>Ring denoising for seamless loops</h4><p>A video model normally generates from a first frame to a last frame, and the last frame has never &#8216;seen&#8217; the first. Ask it for a loop and you get a clip that <em>almost</em> comes back to where it started, then jumps. Not good. Generating a bridge back to the start afterwards doesn&#8217;t fix it either: the bridge jumps too.</p><p>So our loop recipe changes how denoising works. It treats the clip as a <strong>ring,</strong> where the frames at the end of the clip are the same as those at the beginning. At every denoising step, the model sees the join from both sides, refining the frames at the beginning and the end at the same time (as one) ensuring there&#8217;s no sudden jump when the video loops.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!7lzz!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!7lzz!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png 424w, https://substackcdn.com/image/fetch/$s_!7lzz!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png 848w, https://substackcdn.com/image/fetch/$s_!7lzz!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png 1272w, https://substackcdn.com/image/fetch/$s_!7lzz!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!7lzz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png" width="1456" height="552" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:552,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:210975,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!7lzz!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png 424w, https://substackcdn.com/image/fetch/$s_!7lzz!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png 848w, https://substackcdn.com/image/fetch/$s_!7lzz!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png 1272w, https://substackcdn.com/image/fetch/$s_!7lzz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd842d1ff-34bd-42ca-8d35-30760cf2434c_1845x699.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The same thinking runs through the rest of the pipeline:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!DJNi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!DJNi!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png 424w, https://substackcdn.com/image/fetch/$s_!DJNi!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png 848w, https://substackcdn.com/image/fetch/$s_!DJNi!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png 1272w, https://substackcdn.com/image/fetch/$s_!DJNi!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!DJNi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png" width="1456" height="903" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/da5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:903,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:355186,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!DJNi!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png 424w, https://substackcdn.com/image/fetch/$s_!DJNi!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png 848w, https://substackcdn.com/image/fetch/$s_!DJNi!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png 1272w, https://substackcdn.com/image/fetch/$s_!DJNi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fda5f2464-e283-4eb9-a771-96360ce087a1_2110x1308.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Recipes like these reduce the scope of things that can go wrong, but they don&#8217;t remove the dice roll. A model can still drop a hat or draw the wrong jacket. That&#8217;s where the feedback loop comes in.</p><h3>2 &#183; Self-healing Systems</h3><p>Every clip in our workflow is made by a System: a generation step wrapped in a measurement and a controller. Drawn the way a control engineer would draw it, it&#8217;s a feedback loop:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!TKut!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!TKut!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png 424w, https://substackcdn.com/image/fetch/$s_!TKut!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png 848w, https://substackcdn.com/image/fetch/$s_!TKut!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png 1272w, https://substackcdn.com/image/fetch/$s_!TKut!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!TKut!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png" width="1456" height="646" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:646,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:216498,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!TKut!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png 424w, https://substackcdn.com/image/fetch/$s_!TKut!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png 848w, https://substackcdn.com/image/fetch/$s_!TKut!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png 1272w, https://substackcdn.com/image/fetch/$s_!TKut!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ee3d774-200f-4c71-8d44-aa266434242a_1833x813.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>The sensor</strong> combines two kinds of measurement. Exact checks handle whatever can be computed: hard cuts, blank frames, and how visible a loop&#8217;s restart is compared with the clip&#8217;s own motion. These are cheap, and they give the same answer every time. Everything else has to be looked at, so we ask a small, fast vision model (Cloudflare&#8217;s Clef) to act as a judge. It gets a single frame and a few plain yes/no questions: Is there exactly one person? Is she wearing the black beanie? Is she wearing the leather jacket? A small judge is reliable when its questions are easy: one well-chosen frame rather than the whole video, and wording that leaves no room for doubt.</p><p><strong>The controller</strong> doesn&#8217;t just reroll the seed and hope. It passes the prompt, the seed and every finding to a language model, which works out what went wrong and rewrites the prompt to address it. Here&#8217;s a real case. She&#8217;s meant to swap her cream sweater for a leather jacket and keep everything else:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!sg0q!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!sg0q!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png 424w, https://substackcdn.com/image/fetch/$s_!sg0q!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png 848w, https://substackcdn.com/image/fetch/$s_!sg0q!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png 1272w, https://substackcdn.com/image/fetch/$s_!sg0q!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!sg0q!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png" width="1456" height="922" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/dce9437b-602b-4754-911a-c2431a249fce_2106x1334.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:922,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:232388,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!sg0q!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png 424w, https://substackcdn.com/image/fetch/$s_!sg0q!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png 848w, https://substackcdn.com/image/fetch/$s_!sg0q!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png 1272w, https://substackcdn.com/image/fetch/$s_!sg0q!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdce9437b-602b-4754-911a-c2431a249fce_2106x1334.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>The judge</strong> doesn&#8217;t need to know why the beanie disappeared; it simply reports that it did. The controller works out the likely cause (pulling a sweater over your head takes your hat with it. We&#8217;ve all been there) and writes the one sentence that addresses it.</p><p><strong>The System</strong> generates again, measures again, and the clip passes. Roughly half of the clips featuring the beanie healed this way, and nobody had to find them first.</p><p>A clip that can&#8217;t be healed isn&#8217;t shipped. It&#8217;s escalated, because a fault the controller can&#8217;t fix usually means something upstream needs a person&#8217;s attention. Human supervision and intervention is still a thing (at Anorak, anyway).</p><h3>Composable by design</h3><p>A System doesn&#8217;t care what&#8217;s inside it; it just provides the overall structure to complete a task. It can use any generation recipe, the sensor any set of checks, and the controller any policy for improving inputs. This makes Systems building blocks in their own right; self-contained units that can be configured for differnt outcomes.</p><p>Outfit loops and transitions use different recipes behind the same measurement and controller, and the workflow simply runs one System for every clip it needs:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!-Rm6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-Rm6!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png 424w, https://substackcdn.com/image/fetch/$s_!-Rm6!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png 848w, https://substackcdn.com/image/fetch/$s_!-Rm6!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png 1272w, https://substackcdn.com/image/fetch/$s_!-Rm6!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!-Rm6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png" width="1456" height="503" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:503,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:433607,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/223251114?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!-Rm6!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png 424w, https://substackcdn.com/image/fetch/$s_!-Rm6!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png 848w, https://substackcdn.com/image/fetch/$s_!-Rm6!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png 1272w, https://substackcdn.com/image/fetch/$s_!-Rm6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcd7715b2-4906-44b4-b809-b98fbcab6595_1825x631.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>That&#8217;s what makes the method repeatable. A new character, a new dance or a bigger wardrobe (more clothing items) is a new input file, not a new pipeline. One more option in every category takes the same workflow from 1,512 transitions to 4,536. Adding a check means improving one sensor, and every clip gets the benefit. A better recipe can be dropped in as the plant, and the loop around it stays the same.</p><p>Quality control usually means people reviewing output. Here it&#8217;s designed into the workflow itself: recipes that make the right clip likely, and a feedback loop that turns a poor clip into a good one. A level of 1,548 clips is about 80 GPU-hours of generation,<strong> and nobody&#8217;s watching&#8230;</strong>*</p><p><strong><span data-color="#d5a6bd" style="color: rgb(213, 166, 189);">So </span><a href="https://dressup.dev.anorakplay.com/"><span data-color="#d5a6bd" style="color: rgb(213, 166, 189);">here&#8217;s the demo</span></a><span data-color="#d5a6bd" style="color: rgb(213, 166, 189);">! Enjoy. Built using AGO: our in-house generative AI orchestration platform that allows us to render complex workflows containing of thousands of videos.</span></strong></p><p><em>*We do still watch the clips, just not all of them. People still decide what good looks like (see <a href="https://blog.anorak.tech/p/when-anyone-can-make-anything-taste">Shaun&#8217;s post </a>on the crucial role of taste). The Systems make sure every clip hits the mark.</em></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech/&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech/"><span>Visit ANORAK</span></a></p><p></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/p/experiment-the-perfect-loop-and-no?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://blog.anorak.tech/p/experiment-the-perfect-loop-and-no?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p><p></p><p></p><p></p><p></p>]]></content:encoded></item><item><title><![CDATA[Experiment: Unmasking Game Environment Controls]]></title><description><![CDATA[By Paul]]></description><link>https://blog.anorak.tech/p/experiment-unmasking-game-environment</link><guid isPermaLink="false">https://blog.anorak.tech/p/experiment-unmasking-game-environment</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Tue, 27 Oct 2026 09:37:44 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/e1e80a4f-99b2-488b-aaa6-7240e4f31451_1200x630.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Remember <a href="https://www.nintendo.com/en-gb/Games/NES/Punch-Out--278656.html?srsltid=AYCX9vIeHqCPkZlNXWVgv2lkFi30QnvGii7MDGBoT6u2v-0XeQ-Cq_X7">Nintendo Punch-Out</a>? In this experiment we took a Nano Banana (Google&#8217;s image generation model) background, projected it onto a 3D boxing ring, and dropped in a boxer generated as video with MiniMax H3 Max (a high-speed generative video model) &#8212; then keyed him, composited him into the scene, and lit the whole thing in real time with shadows, bloom (reproducing the imaging artifacts of real cameras), depth of field and a few other bells and whistles to bring it to life.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!aesg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!aesg!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic 424w, https://substackcdn.com/image/fetch/$s_!aesg!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic 848w, https://substackcdn.com/image/fetch/$s_!aesg!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic 1272w, https://substackcdn.com/image/fetch/$s_!aesg!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!aesg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic" width="792" height="1412" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1412,&quot;width&quot;:792,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:74806,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/heic&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://anorak3.substack.com/i/217440563?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!aesg!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic 424w, https://substackcdn.com/image/fetch/$s_!aesg!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic 848w, https://substackcdn.com/image/fetch/$s_!aesg!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic 1272w, https://substackcdn.com/image/fetch/$s_!aesg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F380181db-64b6-4232-80f7-6ccae98e0670_792x1412.heic 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>Pick your battles (and battleground)</h3><p>The fun part of the generative aspect is how little of it is fixed. If we&#8217;d fancied Vegas or Madison Square Garden instead of a back-street gym, that would have simply required a different prompt. The fighter takes a bit more work to produce &#8212; he&#8217;s grown from a set of authored key poses that the video model animates between &#8212; but swap those out and you could just as easily be squaring up to your old school bully in the playground.</p><p>I&#8217;ve exposed the controls that show exactly how the scene is constructed. This is essentially what we would call a set of debug menus that would normally be hidden to the player (you lucky people! Invited into the Magic Circle for a quick tinkering). I spent quite a while building out the controls and tuning them to get a particular look and movement.</p><p>It&#8217;s open ended normally, which means it&#8217;s quite easy to break things if you don&#8217;t know what it all does (most but not all of you, I&#8217;d wager), so I have put in restrictions with this version to stop that from happening. But it&#8217;s a great peak under the bonnet and highlights some of the methods and technology we&#8217;re experimenting with.</p><h3>Just a glimpse of what&#8217;s possible</h3><p>When you get hit, the camera jolts back. In a finished product we would obviously go to town on this and incorporate far more complex movement that synchronises with what happens to the character. All of that is controllable in code. It can all be animated and made to spring back, rotate, change FOV (field of view) and do endlessly different things.</p><p>Similarly, all the post effects can be animated as well, so they can all be synchronized to work with different actions in the game. This is where the synergy between the generative aspect and traditional coding happens; the code understands the start/end points, position of the characters feet/fists and frame rate of the generative video component to achieve the look and gameplay we want.</p><p>Stick your gumshield in and try it for yourself <a href="https://fightyman.anorak.tech/">here</a>.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ANORAK Unpacked. Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://anorak.tech"><span>Visit ANORAK</span></a></p>]]></content:encoded></item><item><title><![CDATA[A Week With Our Applied AI Lab in Chengdu]]></title><description><![CDATA[By David Amor, COO]]></description><link>https://blog.anorak.tech/p/a-week-with-our-applied-ai-lab-in</link><guid isPermaLink="false">https://blog.anorak.tech/p/a-week-with-our-applied-ai-lab-in</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Thu, 22 Oct 2026 15:44:33 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/cefe6aa6-26bb-40ba-a50b-643cfec58c75_1235x910.webp" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!1gpk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!1gpk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic 424w, https://substackcdn.com/image/fetch/$s_!1gpk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic 848w, https://substackcdn.com/image/fetch/$s_!1gpk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic 1272w, https://substackcdn.com/image/fetch/$s_!1gpk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!1gpk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic" width="1456" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1702536,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/heic&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://anorak3.substack.com/i/217857147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!1gpk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic 424w, https://substackcdn.com/image/fetch/$s_!1gpk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic 848w, https://substackcdn.com/image/fetch/$s_!1gpk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic 1272w, https://substackcdn.com/image/fetch/$s_!1gpk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F826d7789-7f82-4fae-b099-aa6753405024_5712x4284.heic 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><sup>The UK and China teams together in Chengdu, September 2026.</sup></em></p><h2>Why we&#8217;re in Chengdu</h2><p>Some of the most interesting work in applied AI right now is happening on open-weight models, and a lot of that work is happening in China.</p><p>The big closed models from OpenAI and Anthropic are remarkable. But you meet them through MCP, and you get the controls the provider chooses to expose. Open-weight models are different. We can run them on our own machines, fine-tune them, take them apart and build our own tooling around them. For a studio trying to invent new kinds of play on top of generative video, that control is everything.</p><p>China has a deep bench of engineers who live and breathe these models, and infrastructure that is genuinely world-class. That&#8217;s why Anorak set up an applied AI lab in Chengdu, led by co-founder Tak Fung. This September, we finally went to see it for ourselves.</p><h2>Finally in the same room</h2><p>In mid-September, Shaun, Yaro and David flew from London to Chengdu to spend the week with the team.</p><p>We&#8217;d worked together for months over Slack and video calls, with sprint reviews stretched across a seven-hour time difference. Nothing beats sitting at the same table. We started with a morning of meet-and-greets, then went deep on what everyone is building, demo by demo.</p><p>It was a joy. Seeing their work first-hand, and getting to hang out with the people behind it, was the best part of the trip.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!sJZB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!sJZB!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic 424w, https://substackcdn.com/image/fetch/$s_!sJZB!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic 848w, https://substackcdn.com/image/fetch/$s_!sJZB!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic 1272w, https://substackcdn.com/image/fetch/$s_!sJZB!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!sJZB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic" width="1456" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b4ec1208-d447-41de-964e-049b72355885_5712x4284.heic&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2008292,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/heic&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://anorak3.substack.com/i/217857147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!sJZB!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic 424w, https://substackcdn.com/image/fetch/$s_!sJZB!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic 848w, https://substackcdn.com/image/fetch/$s_!sJZB!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic 1272w, https://substackcdn.com/image/fetch/$s_!sJZB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb4ec1208-d447-41de-964e-049b72355885_5712x4284.heic 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><sup>Going through the demos with the Chengdu team.</sup></em></p><h2>What the team is building</h2><p>Most of the lab&#8217;s work comes back to one question: how do you make a video model do what a game needs it to do? A model that makes a beautiful clip is one thing. A model you can steer, frame by frame, is what turns video into play. A few things we saw:</p><ul><li><p><strong>Pinning down the shot.</strong> The team has built tooling that reliably locks the first and last frames of a generated clip, so a scene starts and ends exactly where the game needs it to.</p></li><li><p><strong>Drawing the path.</strong> Sketch a route across a map, turn the terrain into a 3D model, fly a camera along that route, then use the fly-through to guide the video model. The result is generated footage that follows a path you chose.</p></li><li><p><strong>Adding light to flat video.</strong> Pulling depth and surface detail out of ordinary 2D video, so scenes can be relit and given real shadows.</p></li><li><p><strong>Our own model platform.</strong> A shared inference service that lets anyone at Anorak call open-weight video, segmentation and upscaling models, with the team constantly tuning it for speed and cost.</p></li></ul><p>On top of that, the team is prototyping new game ideas built around generative video, from outdoor adventures to a virtual pet. Not all of it is ready to show yet. Watch this space.</p><h2>Seeing China through our hosts&#8217; eyes</h2><p>For the UK team, the real privilege was seeing China with people who live there. Our hosts showed us their city, fed us relentlessly (the Sichuan spice lived up to its reputation), and answered an endless stream of questions from three jet-lagged visitors from London.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xG8U!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xG8U!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic 424w, https://substackcdn.com/image/fetch/$s_!xG8U!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic 848w, https://substackcdn.com/image/fetch/$s_!xG8U!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic 1272w, https://substackcdn.com/image/fetch/$s_!xG8U!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!xG8U!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic" width="1456" height="1052" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1052,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1359439,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/heic&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://anorak3.substack.com/i/217857147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xG8U!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic 424w, https://substackcdn.com/image/fetch/$s_!xG8U!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic 848w, https://substackcdn.com/image/fetch/$s_!xG8U!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic 1272w, https://substackcdn.com/image/fetch/$s_!xG8U!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f2cb8d-c879-4f81-abfe-be92a2a062f4_3980x2877.heic 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><sup>Out on the streets of Chengdu.</sup></em></p><p>We came home in awe of the place. The transport, the payments, the delivery networks, the pace of building: everything just works, at a scale that is hard to picture until you&#8217;re standing in it. For a company that thinks a lot about infrastructure, it was humbling.</p><p>And then there was karaoke. The China team had already told us they love KTV. They did not exaggerate. We held our own with some big eighties rock anthems, helped along by a bottle of Monkey Shoulder. We won&#8217;t be sharing the recordings.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!sIpX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!sIpX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic 424w, https://substackcdn.com/image/fetch/$s_!sIpX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic 848w, https://substackcdn.com/image/fetch/$s_!sIpX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic 1272w, https://substackcdn.com/image/fetch/$s_!sIpX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!sIpX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic" width="1456" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:724448,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/heic&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://anorak3.substack.com/i/217857147?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!sIpX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic 424w, https://substackcdn.com/image/fetch/$s_!sIpX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic 848w, https://substackcdn.com/image/fetch/$s_!sIpX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic 1272w, https://substackcdn.com/image/fetch/$s_!sIpX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F251eeed3-1b2c-49b0-95d3-625b112ead65_4032x3024.heic 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><sup>KTV night. Some of us sang better than others.</sup></em></p><h2>Why it mattered</h2><p>We flew home tired, well fed and more excited than ever about what this team is doing. The Chengdu lab is at the heart of how Anorak is learning to build games with generative video; turning it from something that simply looks impressive into something that can be shaped and controlled like games (and games that people will want to play).</p><p>Finding novel ways to direct what happens on screen, control how scenes unfold, and give AI-generated environments the consistency and precision that interactive experiences demand. The Chengdu team is developing the technology while already exploring what it could mean for <em>entirely new</em> kinds of games. That&#8217;s what&#8217;s exciting.</p><p>A week together turned colleagues on a video call into friends. Thank you to everyone in Chengdu for being such brilliant hosts. We&#8217;ll be back, and we&#8217;re already practising for the next round of KTV.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech/&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech/"><span>Visit ANORAK</span></a></p>]]></content:encoded></item><item><title><![CDATA[Building the Future of Interactive Video: Realtime Reimagining]]></title><description><![CDATA[By Farms]]></description><link>https://blog.anorak.tech/p/building-the-future-of-interactive-2ca</link><guid isPermaLink="false">https://blog.anorak.tech/p/building-the-future-of-interactive-2ca</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Tue, 20 Oct 2026 07:21:16 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/05621413-5d71-419f-b1e2-370c413311e1_2631x1941.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>At Anorak we believe interactive video is an interesting and underexplored medium for entertainment. Video diffusion models unlock exciting ways to work with dynamic content, but they typically suffer from two major drawbacks that limit their use in high-quality production: control over the output, and speed of generation.</p><p>In this experiment we push at the current limits of these models and share the techniques we use to tighten control and cut end-to-end latency, so we can continuously reimagine a tightly controlled simulation in realtime.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;760cc892-f3af-4c4a-ba0c-63c61b22903c&quot;,&quot;duration&quot;:null}"></div><p><em><sup>Clockwise from top left: the simulation grid, its OpenGL render, the live output from the model, and the prompt.</sup></em></p><p>The example above shows a continuous stream from a simple, live-updating simulation. We encode its representation into the model's latent inputs and reimagine the world in realtime, while preserving the simulation details that matter (in this case, the positions of some simple buildings for a city-builder style game).</p><h3>Architecture</h3><p>First, let&#8217;s get something out of the way: a latent diffusion transformer (DiT) can&#8217;t produce <em>true</em> realtime. These models work over a set of frames simultaneously, producing a chunk of video in one go. So this architecture will always have <em>some</em> lag, because we always need to buffer and process a chunk at a time.</p><p>We can, however, shrink that chunk (the window), optimise the pipeline, and split the work of conditioning and denoising across multiple GPUs so that output chunks are generated faster than new input chunks arrive. The result is a continuous stream that lags behind reality by roughly the window size.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!oU8w!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!oU8w!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic 424w, https://substackcdn.com/image/fetch/$s_!oU8w!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic 848w, https://substackcdn.com/image/fetch/$s_!oU8w!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic 1272w, https://substackcdn.com/image/fetch/$s_!oU8w!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!oU8w!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic" width="1456" height="801" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:801,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:134588,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/heic&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://anorak3.substack.com/i/217839330?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!oU8w!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic 424w, https://substackcdn.com/image/fetch/$s_!oU8w!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic 848w, https://substackcdn.com/image/fetch/$s_!oU8w!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic 1272w, https://substackcdn.com/image/fetch/$s_!oU8w!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0fc27fe4-a06f-49b1-bb65-556ce558788c_2400x1320.heic 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><sup>The pipeline: the simulation is rendered into overlapping windows; GPU 1 encodes frames and prompt, GPU 0 runs the diffusion transformer, and the last frames of each output feed the next window.</sup></em></p><p>The problem with smaller windows is that the signal from the simulation we&#8217;re trying to reimagine becomes very weak. Our solution is a configurable &#8216;alignment&#8217; control.</p><p>Everything the model looks at gets a position: which frame it belongs to, and where in the frame. By default, the reference is placed before the video being generated, as if it were a separate clip that played earlier. The model has to work out for itself that frame 10 of the reference corresponds to frame 10 of the output.</p><p>Alignment puts the reference on top of the output instead: reference frame 10 gets exactly the same position as output frame 10. The correspondence is then built into the positions, so the model doesn&#8217;t have to learn it. The technique comes from a patch for training editing adapters (LoRAs, small add-on models) with aligned guides. We use only the placement, with no extra training.</p><p>On its own this turns out to be too strong. With full alignment, the stock model is too constrained and has no room to &#8220;imagine&#8221; anything. So we added ways to find the middle ground:</p><ul><li><p><strong>Alignment tuning:</strong> a dial between the two placements. 0 is the stock &#8220;separate clip&#8221; placement; 100% is exact overlap. In between, the reference sits partly offset.</p></li><li><p><strong>Aligned steps:</strong> pin the layout early, then let go. Denoising runs in four steps; the early steps decide composition and the later ones decide detail. We keep the reference aligned for only the first few steps, then move it back to the offset position, so layout is locked in while materials and texture are left more to the prompt.</p></li><li><p><strong>Noise ramp:</strong> fade the reference out as the image forms. The reference gets progressively noisier with each step, so it guides strongly at the start and weakly at the end.</p></li><li><p><strong>Source attention:</strong> how loudly the render speaks. This directly scales how much weight the model gives the reference compared with everything else it&#8217;s looking at. Turn it down and the prompt has more say. At zero, the model can&#8217;t see the render at all.</p></li><li><p><strong>Offset copy:</strong> both at once. The reference is given twice: one copy aligned, for frame-by-frame sync, and one in the stock position, for what the scene contains. This pairing comes from the same community work, where the aligned copy kept things in sync and the second copy helped the model make the requested edit. It costs about 40% more compute.</p></li></ul><p>By combining a small window with these optimisations and alignment techniques for turning our simulation into conditioning, we&#8217;ve had moderate success getting the model to stick tightly to the simulation while staying within the required budget of one second of generation per second of video.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;14c34760-c31b-4cdd-9b5b-f0d735121133&quot;,&quot;duration&quot;:null}"></div><p><em><sup>Editing the simulation produces tightly following output, with ~4 s of latency on an RTX PRO 6000</sup></em></p><h3>Keeping long streams stable</h3><p>Continuous streams present another problem. A continuous stream is really many overlapping windows of generation stitched together, and naively passing the &#8220;tail&#8221; of the previous window into the &#8220;head&#8221; of the next creates a feedback loop that leads to degradation.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;f940decd-b0c1-47a7-b5e3-35c4097f78de&quot;,&quot;duration&quot;:null}"></div><p><em><sup>A pathological case: a looping simulation degrading over time as feedback accumulates with each window.</sup></em></p><p>To mitigate this, we combine a few techniques:</p><ul><li><p><strong>Tail noise</strong>, or &#8220;how much to trust the past&#8221;. Before handing the tail over, we can blur it slightly by mixing in some noise. A clean tail gives strong continuity, but it also carries forward any mistakes or drift, which build up over time. A noisier tail lets the model correct itself, at the cost of more visible joins. It&#8217;s a dial between memory and forgetting.</p></li><li><p><strong>Tail length</strong>, or &#8220;how much history&#8221;. By default the tail is just the overlapping frames. We can also hand over more of the previous window, up to all of it, placed at its real position in time before the new window starts. That gives the model more evidence of what the restyled version looks like.</p></li><li><p><strong>Tail attention</strong>, or &#8220;how loudly the past speaks&#8221;. The model is also looking at the live render of the town, and in our architecture that render is a much bigger part of its input than the short tail. Left alone, the render wins: the output drifts back towards a fresh reimagining of the simulation, and good restyling achieved in one window fades in the next. Tail attention turns up how much weight the model gives the tail compared with everything else it&#8217;s looking at.</p></li><li><p><strong>Overlap pin</strong>, or &#8220;holding the past in place&#8221;. We write the previous window&#8217;s final frames directly into the start of the new window and hold them fixed while the rest is generated, with a configurable strength.</p></li></ul><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;5ff6fd60-844a-4658-ae85-f4190182c799&quot;,&quot;duration&quot;:null}"></div><p><em><sup>The same case with these techniques: a better image held over longer horizons, even under pathological feedback.</sup></em></p><h3>TL;DR</h3><p>We&#8217;ve shown how to produce near-realtime interactive streaming content while keeping enough control over the reimagined output to build coherent experiences.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech/&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech/"><span>Visit ANORAK</span></a></p>]]></content:encoded></item><item><title><![CDATA[Experiment: Alien Shopping Channel]]></title><description><![CDATA[By Bore]]></description><link>https://blog.anorak.tech/p/alien-shopping-channel</link><guid isPermaLink="false">https://blog.anorak.tech/p/alien-shopping-channel</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Tue, 13 Oct 2026 08:03:31 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/c35e7802-44de-4df0-940c-83ad778f51eb_1920x1080.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;0fbfbe11-f8af-45af-9398-8ec7e33d681b&quot;,&quot;duration&quot;:null}"></div><p>Too eager to get started to read any further? <a href="https://alien-shopping-network-2d2amdukka-uc.a.run.app/">Here you go</a></p><p>The items that surround you might feel mundane, but what would <strong>the host of an alien shopping channel </strong>make of them? It&#8217;s a question you&#8217;ve probably never asked yourself, but we&#8217;re here to answer it anyway (you&#8217;re welcome).</p><p>Just take a photo of an item (or save the weirdest item you can find on Google Images),<strong> </strong>submit it to the channel, and watch it get evaluated by our expert alien (as opposed to alien expert)<strong>.</strong> Think: Antiques Roadshow meets extraterrestrial QVC.</p><h3>Okay. But WHY?</h3><p>Well, from your perspective, it&#8217;s a fun way to spend a few minutes and get an interactive glimpse of what we&#8217;re working on.</p><p>From our perspective, these playable experiments (we&#8217;ll be releasing one every week) act as a kind of pressure release valve for the sheer abundance of ideas coming out of our studio in Chengdu and London.</p><p>The results of these experiments are fed back into a platform to improve it and broaden the range of what&#8217;s possible, so that we (and you) can build on top of these ideas in the future. This is one project where &#8216;scope creep&#8217; is an actual objective.</p><h3>Getting ahead (of ourselves)</h3><p>One issue we&#8217;ve discovered with this technology is that, when you can build things so quickly, you can end up with what <em>looks</em> like a finished article before you can say, &#8220;software development lifecycle&#8221;.</p><p>The timeline for developing mobile games that we were previously familiar with was sufficiently slow-paced that it exposed flaws and problems along the way, so any finished article was the result of countless micro-improvements.</p><p>So the speediness of a hybrid generative model can be both a blessing and a curse. But we&#8217;re working on that. Cursebusters.</p><h3>Boxing clever</h3><p>To keep things spicy (and to keep things moving), each experiment is time-boxed to 2 weeks (developing and releasing a simple 2D mobile game like a basic puzzle, or an endless runner game typically takes 2 to 4 months).</p><p>So, each one will be released to you, our loyal and enthused following, warts and all. This one was influenced by Bargain Hunt and its perma-tanned host David Dickinson (UK), Antiques Roadshow (global phenomenon) and a 24 hour live AI-hosted TV talkshow (China). It&#8217;s stripped back to its essence. The fun bit. The valuations (though I&#8217;ve learned that on the Chinese version of Antique&#8217;s Roadshow, any items that are identified as fake are <em>destroyed </em>there and then on the show! Incredible).</p><p>The platform is helping us speed up as well as add more creativity to the experiments, so stay tuned; it&#8217;s going to be a fun and increasingly more fruitful time!</p><p></p><p>ANYWAY. Back to our alien shopping enthusiast&#8230;</p><p>Please submit your objects to our thrifty three-eyed friend for valuation <a href="https://alien-shopping-network-2d2amdukka-uc.a.run.app/">here!</a></p><p></p><p><em>NOTE: Star Credits are, unfortunately, not redeemable at Anorak, or any popular high street retailers (that we&#8217;re aware of).</em></p><p></p><p></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://anorak.tech"><span>Visit ANORAK</span></a></p>]]></content:encoded></item><item><title><![CDATA[When Anyone Can Make Anything, Taste Is King]]></title><description><![CDATA[By Shaun Rutland, CEO]]></description><link>https://blog.anorak.tech/p/when-anyone-can-make-anything-taste</link><guid isPermaLink="false">https://blog.anorak.tech/p/when-anyone-can-make-anything-taste</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Tue, 06 Oct 2026 14:42:56 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/970e4610-10fc-47f1-973e-9a4f5ce6800f_3076x1708.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h2><strong>Someone else&#8217;s thinking</strong></h2><p>Part of the pleasure of watching a film is being surprised by someone else&#8217;s thinking. You&#8217;re deferring to their taste, their skill, their expertise, their storytelling.  If you wrote and directed the film yourself, defined the story arc, you already know where it goes - no twist, no tension, no discovery. A lot of actors claim to never watch the films they&#8217;re in. Perhaps that&#8217;s why, or perhaps they just don&#8217;t like the sound of their own voice (I don&#8217;t mind mine). A joke you came up with doesn&#8217;t necessarily make you laugh, but there&#8217;s delight in stumbling across it, then crafting and sharing it. Sometimes repeatedly (just ask my friends who&#8217;ve all heard the same one at least 20 times).</p><p>What am I babbling about?!</p><p>People like to make original stuff to entertain others. And people like to be entertained by other people&#8217;s original stuff. Well hold the front page!</p><h2><strong>Twelve months in</strong></h2><p>This year I&#8217;ve had the pleasure of building a team in London, UK and Chengdu, China, east meets west creativity, different cultures with a shared vision. Working on what generative AI means for play. It has been without doubt the most creative, mentally stimulating and challenging year of my career.</p><p>We&#8217;re not interested in prompting our way to new versions of existing games. Anyone can do that. We&#8217;re interested in new ways to play. What is a generative play pattern? We&#8217;re diving deep into it. Unsurprisingly, stepping out of pure mobile play patterns excites me (despite a decade perfecting the art at Hutch, culminating in the $375m acquisition by MTG). At Hutch, we anticipated changes in play patterns from PC and Console to Mobile. We even helped create and steer some of these changes. That&#8217;s our aim with interactive generative video (IGV). We&#8217;re also interested in disrupting the status quo of the distribution rat race, but I&#8217;ll get into that another time&#8230;<br><br>Now that so much content is being made, what we&#8217;re doing is an even bigger challenge, and we&#8217;re having to rethink pretty much everything we&#8217;ve learned from the mobile gaming era. So much so that we don&#8217;t see ourselves as a games company, but a technology entertainment company.</p><p>We&#8217;re not forgetting where we came from, but bringing curiosity and impulsive, intuitive energy to something we still find quite hard to describe. Gamified video? Watchified gaming? Format discovery is the goal. The fact there&#8217;s no unified name for it yet shows we&#8217;re at the bleeding edge, right? You should see some of the stuff we&#8217;ve been creating. All in good time. Anyway, perhaps the best we&#8217;ve come up with thus far: <strong>Generative video, made playable.</strong></p><p>Being in an extensive (and intensive) R&amp;D play phase of the project, at the intersection of our curiosity, the ever-evolving tech coming out of our China AI lab, and shifting play patterns, has been both exciting and frankly overwhelming at times. But the seemingly endless incredible ideas that are emerging on a daily basis (some almost fully formed and playable before we&#8217;ve even blinked) continually validate my decision in choosing this path.</p><h2><strong>Layer cake: Music, film and games have all been here before</strong></h2><p>These three industries share a lot. Each has been through numerous stages of evolution, where a new layer emerges. As the layers come in and out of dominance, power and creativity are yanked back and forth between the people creating things and the people selling and distributing them.</p><p>Music went from live performance, to sheet music, to recording and radio, to the label era, to illegal downloading and iTunes, then streaming. Film went from silent film, to the studio system, to television, to blockbusters and VHS, DVD, Blu Ray, to downloads and streaming (legal and illegal). Games went from board games, to arcades, consoles and home computers, to Steam, and app stores, to Minecraft, Roblox and Fortnite, where the players became the makers.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!KXOv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!KXOv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic 424w, https://substackcdn.com/image/fetch/$s_!KXOv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic 848w, https://substackcdn.com/image/fetch/$s_!KXOv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic 1272w, https://substackcdn.com/image/fetch/$s_!KXOv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!KXOv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:179531,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/heic&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://anorak3.substack.com/i/218169421?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!KXOv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic 424w, https://substackcdn.com/image/fetch/$s_!KXOv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic 848w, https://substackcdn.com/image/fetch/$s_!KXOv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic 1272w, https://substackcdn.com/image/fetch/$s_!KXOv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb923380f-76ce-4cae-a9b1-0492aa72eb06_3840x2160.heic 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The pattern is the same every time. Making got cheaper and easier to distribute (though <em>discoverability</em> for distributors and creators got harder the more content was out there, be it games, music, film/TV), and value moved to whoever could filter the flood of content: the radio station, the A&amp;R, the studio heads, the platform holders, the playlist curators. The taste makers. Scarcity went from the performer, to the recording, to attention, to taste making.</p><p>Generative is the next layer in all three industries, and it&#8217;s arguably bigger than the others, as virtually anyone has the power and the tools to create. Every previous layer changed how things were made or distributed, and the audience stayed the same: lots of people watching or playing the same thing. Generative breaks that. Content can be made by and for one person, on demand, and it can respond to them while they&#8217;re engaging.</p><p>I don&#8217;t for a second think everything will be exclusively generative (who wants to make a song that only they will ever hear? It would be like telling jokes you&#8217;ve written into a mirror. Which I&#8217;ve <em>definitely </em>never done..), but I believe it will certainly be a massive part of digital entertainment.<br><br>No one knows what the future holds, and I think we can all understand anxiety about job security in the creative industries. Jobs will undoubtedly change. There will be new jobs with names that have yet to be coined. And the previous layers will still be there, and have their audiences and proponents.  But the more I&#8217;ve thought about it, and through what I&#8217;ve learned since undertaking this project, the clearer it is to me that tastemakers will continue to rule in entertainment. Whose taste? That&#8217;s the question. That&#8217;s where we could see a seismic shift. That&#8217;s the great unknown. Does it matter? My jokes may not make you laugh, but my friends find me funny, I think.</p><h2><strong>Back to artisanal foundations</strong></h2><p>Abundance sends us back to the artisanal. Mass-produced beer gave us craft brewing. Streaming brought back vinyl. When people stopped buying physical music formats, live gigs became where musicians actually earned. Every time industrialisation made something cheap, a premium reappeared for the hand-crafted, the small batch, the artisanal - and with it, connection through its community.</p><p>So we will probably always want to be entertained by tastemakers - whether that&#8217;s a big publisher or a single person who has built a name for themselves. What they have in common is your trust. You go to a Pixar film, Supercell or Rockstar game for the same reason you go to your favourite local bakery: you believe someone with taste has made a choice on your behalf. The size of the maker matters not when it aligns to your taste.</p><h2><strong>Stories versus playgrounds</strong></h2><p>So why won&#8217;t we just make everything for ourselves, now that we can? Because of the problem I started with. If you define the path, there&#8217;s no surprise. We&#8217;ll always want someone else to tell us a story.</p><p>I believe the one place self-made does work is play. In a game you set the premise and the rules, but you don&#8217;t control the outcome. The system pushes back, and that&#8217;s where the delight comes from. Nobody gets bored of a game they designed the rules for, because if designed right it&#8217;s dynamic and surprising.</p><p>So the line, I think, is this: we won&#8217;t make stories for ourselves, but we can make playgrounds. We&#8217;ll keep paying tastemakers to tell us stories, and we&#8217;ll happily build and share our own worlds to play in. That&#8217;s why play is the format where &#8220;made for yourself&#8221; still has magic and why generative video is far more interesting as something playable than as just something to watch.</p><h2><strong>If you are the business, and your community the audience</strong></h2><p>Community means a lot to me, I&#8217;ve made WhatsApp groups called Padel Social, Sauna Social, What We Doing For Tea?, Quiet Drinks, Offensive Waste Channel (cannot recall what that one&#8217;s for to be honest) - I could go on. Purpose and a sense of belonging seems ever more needed in a fractured world. What if super-niche communities and subcultures could create playable generative video just for them? And it is monetisable. Original themes with authentic content, created by active communities not boardroom greenlight meetings.</p><p>Which raises the question our industries have never really had to answer. For a century businesses have been aligning what a business needs (to be viable) with what a market wants, at scale, with ballooning costs and risk. But what if you personally are the business, and your community however big or small is the audience? Can you make a living from that? Can you just make stuff for the pleasure of it?</p><p>It&#8217;s like going back to the cave and drawing noughts and crosses on the wall with chalk. Not because anyone will pay for it, but because the people around you will play.</p><h2><strong>What we&#8217;re building</strong></h2><p>At Anorak we&#8217;re working on play patterns and a platform to <strong>make any pursuit playable</strong>. It&#8217;s interactive generative video entertainment, not traditional mobile or video games. And it&#8217;s about anyone being able to create, according to their own taste.</p><p>Making stuff is easy now. Crafting something good still takes taste, and taste can take a lot of love and time to cultivate. But who are we to decide what good taste looks like?</p><p>Who will be the tastemakers of the future? We&#8217;re excited to find out. Will we be tastemakers at Anorak? The beauty of the platform we&#8217;re creating is that we can both create ourselves as well as enable others.</p><p>We will put our tech in their hands, giving them the tools to create unique nuanced play specifically for their subcultures. But who knows what will take off and become wildly popular outside of their primary audience? Think DOTA &#8211; a map made for Warcraft III that created an entirely new audience and play pattern.<br><br>I&#8217;ll share some weird and wonderful experiments in the coming weeks. We would love your feedback. In the meantime, here are our thoughts on AI slop.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;9315bdda-fb6d-43d5-9930-12b448b7b220&quot;,&quot;duration&quot;:null}"></div><p></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech"><span>Visit ANORAK</span></a></p>]]></content:encoded></item><item><title><![CDATA[LookStar: Create your look. Challenge your friends.]]></title><description><![CDATA[By Pete and Bruck]]></description><link>https://blog.anorak.tech/p/lookstar</link><guid isPermaLink="false">https://blog.anorak.tech/p/lookstar</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Mon, 05 Oct 2026 14:39:01 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!UHr6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!UHr6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!UHr6!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg 424w, https://substackcdn.com/image/fetch/$s_!UHr6!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg 848w, https://substackcdn.com/image/fetch/$s_!UHr6!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!UHr6!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!UHr6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1685485,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://blog.anorak.tech/i/218528523?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!UHr6!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg 424w, https://substackcdn.com/image/fetch/$s_!UHr6!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg 848w, https://substackcdn.com/image/fetch/$s_!UHr6!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!UHr6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F639cde37-de08-4296-b532-0f90bc4ad980_1920x1080.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We wondered: could we build a game where you get a style brief, pick an outfit from a rack of fashion items, snap a selfie, and then star in your own custom runway video? That&#8217;s LookStar. Inspired by the Roblox hit <em>Dress to Impress</em>, you&#8217;re the diva on the catwalk, and other players vote on who wore it best.</p><p>For live ops, we made the daily events build themselves. The game scans the news for what&#8217;s happening in the world, creates a daily event, then pulls together a matching set of clothing items for players to choose from.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;ec5de3fd-f0d8-458f-9983-fd6732813222&quot;,&quot;duration&quot;:null}"></div><p>Our in-house video model (generative video large language not fashion) makes the catwalk videos, and they&#8217;re hilarious, downloadable and very shareable.</p><p></p><p>Try it for yourself <a href="https://lookstar.ai/">here</a>.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech/&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech/"><span>Visit ANORAK</span></a></p>]]></content:encoded></item><item><title><![CDATA[Building the future of Interactive Video : Inference Optimisation at Anorak.]]></title><description><![CDATA[Scaling Real-Time Generative Video via anorak-inference and LookStar]]></description><link>https://blog.anorak.tech/p/building-the-future-of-interactive</link><guid isPermaLink="false">https://blog.anorak.tech/p/building-the-future-of-interactive</guid><dc:creator><![CDATA[Anorak]]></dc:creator><pubDate>Wed, 26 Aug 2026 07:05:16 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/66ced9e9-c410-4e4f-8d5d-b37bfc78d417_2912x2162.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h3><span>Introduction</span></h3><p><span>Watch is eating play. MIDiAS research shows gamers watch 8.5 hours over 7.4 hours per week playing.  At Anorak we think that&#8217;s not a content problem but a format one. Video got frictionless; it never got interactive. We&#8217;re building the medium that closes the gap: gamified generative video - content as easy to consume as the feed it lives in, and as engaging as the games it borrows from.</span></p><p><span>In this post, we want to share some of the architectural choices and technical breakthroughs behind optimizing our generative pipelines. By bringing high-quality generative models down to sub-second and low-latency thresholds, we are turning heavy offline generation into real-time, interactive game-time experiences.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p><span>Over the last few years, generative models built around Diffusion Transformers (DiT) have made breakthroughs in image and video generation. Yet, that power comes with a price - a heavy inference cost. The combination of multi-step iterative denoising and massive Transformer calculations means a single generation often takes dozens of seconds, or more. Solving how to drastically cut inference latency and VRAM usage without sacrificing quality is the key to shipping these models in real-world products.</span></p><p><span>This article is divided into three parts: First, we break down the basics of DiT structures and mainstream acceleration methods. Next, we introduce anorak-inference, our proprietary inference framework. Finally, we&#8217;ll use our app called LookStar (currently in closed testing) to show how we used this framework to accelerate a complete &#8220;multi-image reference-to-image + image-to-video&#8221; workflow and deploy it on a single GPU.</span></p><h1><span>I. DiT Models and Acceleration Methods</span></h1><h2><span>1.1 The Basic Structure of DiT</span></h2><p><span>A typical DiT generation workflow consists of three components:</span></p><ul><li><p><strong><span>Encoder:</span></strong><span> Encodes input (text prompts, reference images) into conditional representations. Text usually goes through a large encoder (like T5 or Gemma), while images are encoded into the latent space via VAE.</span></p></li><li><p><strong><span>Transformer (Backbone):</span></strong><span> DiT replaces the U-Net of earlier diffusion models with a Transformer to predict denoising in the latent space. Compared to U-Net, Transformers scale significantly better, allowing for model sizes with billions of parameters.</span></p></li><li><p><strong><span>Diffusion (Denoising Process):</span></strong><span> Starting from pure noise, the model iteratively denoises over multiple steps, eventually decoding back into an image or video.</span></p></li></ul><h2><span>1.2 Where are the Bottlenecks?</span></h2><p><span>DiT inference overhead generally concentrates in two areas:</span></p><ol><li><p><strong><span>Multi-step Denoising:</span></strong><span> Every sample generated requires many denoising steps, and every step requires a full forward pass of the Transformer. The more steps, the longer the wait.</span></p></li><li><p><strong><span>Transformer Computation:</span></strong><span> As sequence lengths grow (especially in video) and model sizes increase, the computational and memory overhead for attention and feed-forward (FFN) layers skyrockets.</span></p></li></ol><p><span>Therefore, the core strategy for accelerating DiT is two-fold: reduce the number of denoising steps and lower the computation/memory cost of each individual Transformer step.</span></p><h2><span>1.3 Mainstream Acceleration Methods</span></h2><p><span>Based on those two pillars, the industry has developed several primary acceleration techniques:</span></p><ul><li><p><strong><span>Distillation:</span></strong><span> Methods like DMD or Consistency models compress a denoising process that originally took dozens of steps down to just a few&#8212;or even one. This is the most direct and effective way to reduce step counts.</span></p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!UVpq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!UVpq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png 424w, https://substackcdn.com/image/fetch/$s_!UVpq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png 848w, https://substackcdn.com/image/fetch/$s_!UVpq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png 1272w, https://substackcdn.com/image/fetch/$s_!UVpq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!UVpq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png" width="606" height="306" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:306,&quot;width&quot;:606,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!UVpq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png 424w, https://substackcdn.com/image/fetch/$s_!UVpq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png 848w, https://substackcdn.com/image/fetch/$s_!UVpq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png 1272w, https://substackcdn.com/image/fetch/$s_!UVpq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04f50079-cfdd-4401-a222-a4af839d3cc7_606x306.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong><span>Caching:</span></strong><span> By leveraging the similarity of features between adjacent denoising steps (e.g., temporal redundancy in attention/features), we can cache and reuse intermediate results, skipping repetitive calculations.</span></p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!L6Li!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!L6Li!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png 424w, https://substackcdn.com/image/fetch/$s_!L6Li!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png 848w, https://substackcdn.com/image/fetch/$s_!L6Li!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png 1272w, https://substackcdn.com/image/fetch/$s_!L6Li!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!L6Li!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png" width="576" height="358" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:358,&quot;width&quot;:576,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!L6Li!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png 424w, https://substackcdn.com/image/fetch/$s_!L6Li!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png 848w, https://substackcdn.com/image/fetch/$s_!L6Li!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png 1272w, https://substackcdn.com/image/fetch/$s_!L6Li!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a4c9397-5d8d-4270-a0e3-3c19280a8085_576x358.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong><span>Quantization:</span></strong><span> Reducing weights and activations from FP16/BF16 to FP8, INT8, or even NVFP4. This slashes VRAM usage and leverages the low-precision compute power of new hardware (like the FP8/NVFP4 on Blackwell).</span></p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NjcI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NjcI!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png 424w, https://substackcdn.com/image/fetch/$s_!NjcI!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png 848w, https://substackcdn.com/image/fetch/$s_!NjcI!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png 1272w, https://substackcdn.com/image/fetch/$s_!NjcI!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!NjcI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png" width="606" height="342" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:342,&quot;width&quot;:606,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!NjcI!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png 424w, https://substackcdn.com/image/fetch/$s_!NjcI!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png 848w, https://substackcdn.com/image/fetch/$s_!NjcI!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png 1272w, https://substackcdn.com/image/fetch/$s_!NjcI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a55f98c-5348-44a4-b971-8d18837469a6_606x342.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong><span>Multi-resolution / Cascaded Inference:</span></strong><span> Perform the bulk of the denoising at low resolution, then upscale and refine at high resolution. This puts the heaviest math where the resolution is smallest.</span></p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ksId!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ksId!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png 424w, https://substackcdn.com/image/fetch/$s_!ksId!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png 848w, https://substackcdn.com/image/fetch/$s_!ksId!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png 1272w, https://substackcdn.com/image/fetch/$s_!ksId!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!ksId!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png" width="490" height="482" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:482,&quot;width&quot;:490,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ksId!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png 424w, https://substackcdn.com/image/fetch/$s_!ksId!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png 848w, https://substackcdn.com/image/fetch/$s_!ksId!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png 1272w, https://substackcdn.com/image/fetch/$s_!ksId!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1a8bc9c-1f6d-4fdb-bc9b-d4c47e1d6df5_490x482.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong><span>Efficient Attention (Sparse / Linear Attention):</span></strong><span> Standard attention computation grows quadratically with sequence length, which is painfully expensive for long video sequences. Sparse Attention skips redundant calculations by only computing a subset of token pairs, while Linear Attention reduces complexity from quadratic to linear.</span></p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CSzs!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CSzs!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png 424w, https://substackcdn.com/image/fetch/$s_!CSzs!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png 848w, https://substackcdn.com/image/fetch/$s_!CSzs!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png 1272w, https://substackcdn.com/image/fetch/$s_!CSzs!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!CSzs!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png" width="664" height="352" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:352,&quot;width&quot;:664,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CSzs!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png 424w, https://substackcdn.com/image/fetch/$s_!CSzs!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png 848w, https://substackcdn.com/image/fetch/$s_!CSzs!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png 1272w, https://substackcdn.com/image/fetch/$s_!CSzs!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3136ad08-7bdb-4f41-baea-e388b89beea4_664x352.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>These methods aren&#8217;t mutually exclusive. In practice, you often need to combine them, making trade-offs based on the model and hardware&#8212;which is precisely the problem anorak-inference is built to solve.</span></p><h1><span>II. anorak-inference: Anorak&#8217;s Proprietary DiT Inference and Orchestration Framework</span></h1><p><span>anorak-inference isn&#8217;t just about serving one model efficiently&#8212;that&#8217;s a solved problem with tools like LightX2V or sglang. Instead, we&#8217;re tackling the gaps those tools haven&#8217;t covered:</span></p><ol><li><p><strong><span>Workflow Orchestration:</span></strong><span> How do you chain multiple disparate models (image-to-image, video generation, super-resolution, frame interpolation, face-swapping) into a single, production-ready workflow?</span></p></li><li><p><strong><span>Single-GPU Multi-Model Deployment:</span></strong><span> How do you run that entire complex workflow on a single card?</span></p></li></ol><p><span>We designed this as a model-agnostic, workflow-agnostic foundation where acceleration techniques can be plugged in. Its core design features:</span></p><ul><li><p><strong><span>Unified Service Abstraction:</span></strong><span> Single-model pipelines and multi-model workflows use the same interface. To the service layer, they are identical&#8212;serving a &#8220;naked&#8221; model is just a one-step workflow. Adding new models or workflows follows the same path.</span></p></li><li><p><strong><span>Model-Agnostic and Extensible:</span></strong><span> Need a new model? Just implement a pipeline. Building a new workflow? Write a declarative spec that chains pipelines and transformation operators together. The framework isn&#8217;t tied to any specific model. Whether it&#8217;s open-source or trained/distilled via our anorak-dflow (which supports RL, SFT, and distillation), everything integrates seamlessly.</span></p></li><li><p><strong><span>Single-GPU Multi-Model VRAM Management:</span></strong><span> This is the key to running multi-model workflows. Take LookStar: Flux.2-klein and LTX-2 cannot fit on a single 80GB card simultaneously. The framework follows the declared step sequence, swaps unused models to pinned host memory, and fetches them back when needed&#8212;maintaining near-&#8221;GPU resident&#8221; latency. This mechanism allows the workflow to run on an H100 or squeeze into a 32GB RTX 5090.</span></p></li><li><p><strong><span>Plug-and-Play Acceleration:</span></strong><span> Distillation, quantization (built-in FP8 toolchain), multi-resolution inference, and various pre/post-processing ops are all composable components. The framework doesn&#8217;t force one acceleration method; it provides a unified base to host all of them.</span></p></li></ul><p><strong><span>In short:</span></strong><span> anorak-inference focuses on bridging the gap in &#8220;multi-model orchestration + single-card VRAM scheduling + pluggable acceleration,&#8221; while anorak-dflow handles the training and distillation. Together, they cover the entire chain from training to deployment.</span></p><h1><span>III. Case Study: Accelerating LookStar</span></h1><p><span>LookStar is the perfect example of using anorak-inference to accelerate a full-stack DiT workflow. Lookstar is an app where you can use the power of Generative Image and Video to dress yourself in a number of virtual clothing and see yourself swoon around in different environments looking fab. You take a selfie and choose your items and wait for your resulting video to bve generated. The generation process is split into two parts: Multi-image Reference-to-Image (i2i) and Image-to-Video (i2v).</span></p><h2><span>3.1 Multi-image Reference-to-Image (i2i)</span></h2><p><span>The goal: Synthesize an image of a person wearing a full set of items, given an Identity photo and multiple reference photos.</span></p><ul><li><p><strong><span>4-step Flux-Klein Model:</span></strong><span> Compresses the denoising process significantly.</span></p></li><li><p><strong><span>Multi-image Support:</span></strong><span> Through two rounds of inference, we support up to 9 reference images by combining the Selfie Photo with item references.</span></p></li><li><p><strong><span>Resolution Downscaling:</span></strong><span> Since reference items don&#8217;t need the same resolution as the final image, we scale them down, drastically reducing compute without affecting visual quality.</span></p></li></ul><p><strong><span>Item Reference Image Resolution Time (2-Step Flow) seconds</span></strong></p><p><span>Full resolution 15.35</span></p><p><span>Short side 512px (Production) 7.19</span></p><ul><li><p><strong><span>FaceFusion for Consistency:</span></strong><span> Since reference-based generation sometimes drifts on facial consistency, we added FaceFusion post-generation to align the output with the Identify photo.</span></p></li></ul><div><hr></div><p><strong><span>Face Change Method: ArcFace Distance (smaller the better)</span></strong></p><p><span>No face change: </span><em><span>0.800</span></em></p><p><span>hyperswap, weight 0.5: </span><em><span>0.264</span></em></p><p><span>inswapper, weight 1.0: </span><em><span>0.195</span></em></p><p><span>inswapper, weight 0.5&#65288;Production): </span><em><span>0.162</span></em></p><div><hr></div><p><span>Here are two of our developers using this method and as you can see with the above improvements both speed, item consistency and face likeness is beating out NanoBanana2:</span></p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!TITL!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png 424w, https://substackcdn.com/image/fetch/$s_!TITL!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png 848w, https://substackcdn.com/image/fetch/$s_!TITL!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png 1272w, https://substackcdn.com/image/fetch/$s_!TITL!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!TITL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png" width="1456" height="363" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:363,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!TITL!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png 424w, https://substackcdn.com/image/fetch/$s_!TITL!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png 848w, https://substackcdn.com/image/fetch/$s_!TITL!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png 1272w, https://substackcdn.com/image/fetch/$s_!TITL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7acda760-bdbd-4f99-a401-057a57f5495c_1470x366.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yeTX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yeTX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png 424w, https://substackcdn.com/image/fetch/$s_!yeTX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png 848w, https://substackcdn.com/image/fetch/$s_!yeTX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png 1272w, https://substackcdn.com/image/fetch/$s_!yeTX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!yeTX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png" width="728" height="682.5" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;normal&quot;,&quot;height&quot;:1365,&quot;width&quot;:1456,&quot;resizeWidth&quot;:728,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!yeTX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png 424w, https://substackcdn.com/image/fetch/$s_!yeTX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png 848w, https://substackcdn.com/image/fetch/$s_!yeTX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png 1272w, https://substackcdn.com/image/fetch/$s_!yeTX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ab58942-b8f1-469e-b874-9cc79a7953ee_1728x1620.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"></figcaption></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!90A4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!90A4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png 424w, https://substackcdn.com/image/fetch/$s_!90A4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png 848w, https://substackcdn.com/image/fetch/$s_!90A4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png 1272w, https://substackcdn.com/image/fetch/$s_!90A4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!90A4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png" width="1094" height="362" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:362,&quot;width&quot;:1094,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!90A4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png 424w, https://substackcdn.com/image/fetch/$s_!90A4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png 848w, https://substackcdn.com/image/fetch/$s_!90A4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png 1272w, https://substackcdn.com/image/fetch/$s_!90A4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F992a95c9-2e91-4266-92fb-9d55d54d1aee_1094x362.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!9KoM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!9KoM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png 424w, https://substackcdn.com/image/fetch/$s_!9KoM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png 848w, https://substackcdn.com/image/fetch/$s_!9KoM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png 1272w, https://substackcdn.com/image/fetch/$s_!9KoM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!9KoM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png" width="1456" height="1364" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1364,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!9KoM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png 424w, https://substackcdn.com/image/fetch/$s_!9KoM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png 848w, https://substackcdn.com/image/fetch/$s_!9KoM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png 1272w, https://substackcdn.com/image/fetch/$s_!9KoM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2dbaaea-ffe2-42c8-ac69-80e0a9738914_1734x1624.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2><span>3.2 Image-to-Video (i2v)</span></h2><p><span>We currently use Lightricks LTX2.5 Video model to generate our videos.</span></p><ul><li><p><strong><span>8-step LTX-Video:</span></strong><span> Uses variable resolution (low-res denoising first, then upsample) to keep heavy lifting in the low-res stage.</span></p></li><li><p><strong><span>1-Step High-Res Denoising:</span></strong><span> In the high-res stage, we cut denoising from 3 steps to 1. Testing shows no perceptible difference in output, but significant compute savings.</span></p></li><li><p><strong><span>Optimization:</span></strong><span> Using torch.compile() and FP8 scaled-matmul to accelerate the denoising graph.</span></p></li></ul><h2><span>3.3 System Level: Getting the Workflow on One Card</span></h2><p><span>The biggest constraint is VRAM. We did two critical things:</span></p><ol><li><p><strong><span>FP8 Quantization for Gemma3:</span></strong><span> The text encoder consumes significant VRAM, so we quantized it to FP8.</span></p></li><li><p><strong><span>Pinned Memory Management:</span></strong><span> Using anorak-inference ops, we offload inactive models to pinned memory and swap them in only when needed.</span></p></li></ol><p><span>Thanks to these optimizations, the entire LookStar workflow runs not just on an H100, but on a 32GB RTX 5090 too! Although this is a great start - we&#8217;ve found LTX2.5 is still a relatively weak model compared to the newer Minimax-H3, and we are currently hard at work making optimisations for that to be production ready.</span></p><h1><span>We Are Just Getting Started</span></h1><p><span>LookStar is just the first application of anorak-inference. By combining distillation to reduce steps, quantization and multi-resolution to reduce per-step costs, and clever VRAM scheduling to fit on one card, we turned a heavy generation workflow into one that is deployable on a single GPU with controlled latency. More importantly, these capabilities are framework-level and reusable. As our optimisation framework evolves, we can replicate these acceleration wins across more models and business scenarios. This is just the beginning.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://blog.anorak.tech/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading, subscribe for free to receive new posts from ANORAK Unpacked.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://anorak.tech/&quot;,&quot;text&quot;:&quot;Visit ANORAK&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://anorak.tech/"><span>Visit ANORAK</span></a></p>]]></content:encoded></item></channel></rss>