FramePack

Overview

FramePack makes videos one frame at a time in a “progressive” way which means it can keep going basically forever... or until you get bored.

Developed by Lvmin Zhang (@lllyasviel), a prolific AI researcher. He's the creator of ControlNet, IC-Light, and Fooocus.

It only needs 6GB of VRAM to generate up to 2 minutes of video at 30fps. You don’t need some $10K setup either—laptop GPUs are fine. People’ve run it on a 3060 laptops and while it’s slower it still worked.

FramePack shrinks the context of the input frames down to a fixed size. That means the effort to keep going doesn’t grow as the video gets longer. It just keeps churning frame after frame. Think of it like video diffusion that feels like regular image diffusion. Easy to run. Less stress on your setup.

Real-Time Generation

Since it works one frame at a time you see stuff happening while it’s still working. Wanna make a 120-second clip? Cool. Don’t like how it’s shaping up? Kill it at 30 seconds and try again. You’re not locked in.

And the Gradio app makes the whole thing super simple. One click and you’re in, when using http://pinokio.computer.

System Stuff

You’ll need a Windows or Linux PC and a Nvidia card—RTX 30XX or up. It’s not tested on older cards like 10XX or 20XX. Also you might need to play with the “Preserved Memory” setting if you run out of juice during gen.

The base model it uses is HunyuanVideo in Diffusers format. Disk space needed? Quite a bit: just under 50GB.

👉 Note that the GitHub repository is currently the only official FramePack website. All other websites are spam and fake. There is no web platform. Do not pay money or download files from any of those websites.

Prompt Tips

Want better results? Keep your prompts short and clean. Stuff like:

The girl dances gracefully with clear movements full of charm.

Or

The man dances powerfully striking sharp poses on a glossy floor.

Short strong lines work better than bloated ones.

Oh and yes, FramePack can do NSFW videos, just in case you were wondering which, of course you were not...