[ARCHIVED THREAD] - FramePack - Generate AI videos from images using your computer's GPU (Now ComfyUI Megathread!) (Page 1 of 17)
Posted: 4/20/2025 10:56:11 PM EDT
|
I came across a neat little AI video generator that works entirely on your GPU, as long as its NVIDIA and has at least 6 GB VRAM. Github repository: https://github.com/lllyasviel/FramePack Here are some examples of videos generated from static images by contributors to this thread:         Gramps was both coach and player |
|
Quoted: @GySgt_D Made some short clips and posted them in the Bing AI thread. It was a different local AI tool though. AI has come a long way real quick. https://i.imgur.com/bi89uGG.gif https://i.imgur.com/phiU40H.gif https://i.imgur.com/QmB5HzG.gif https://i.imgur.com/GI3yW0x.gif https://i.imgur.com/XIPJ4x7.gif Interesting. Does it generate entirely from a prompt, or from both a prompt and source image like FramePack? What’s the VRAM requirement and generation speed? |
|
Quoted: https://www.ar15.com/media/mediaFiles/480443/OIG1__1__jpeg-3522764.JPG Somebody hook a brother up 
|
 
|
downloaded it. Now extracting the file and Windows says I have 1 day left to extract.  Attached File |
|
Quoted: downloaded it. Now extracting the file and Windows says I have 1 day left to extract. https://www.ar15.com/media/mediaFiles/308466/Screenshot_2025-04-21_195104_png-3522831.JPG
|
|
Quoted: downloaded it. Now extracting the file and Windows says I have 1 day left to extract. https://www.ar15.com/media/mediaFiles/308466/Screenshot_2025-04-21_195104_png-3522831.JPGETA: I see you discovered this as well 
|
|
Finally got it going on a 2070 Super. To say it's slow is an understatement... Trying to do a 5 second video from a picture of my mother from the 70s. EDIT: Well, After about 18 minutes the laptop, I believe, went to thermal shutdown. I'll have to see about another way to do this tomorrow. Nope... was a power supply issue. |
|
Quoted: Finally got it going on a 2070 Super. To say it's slow is an understatement... Trying to do a 5 second video from a picture of my mother from the 70s. EDIT: Well, After about 18 minutes the laptop, I believe, went to thermal shutdown. I'll have to see about another way to do this tomorrow. Nope... was a power supply issue. That sucks. You can put the laptop in the refrigerator while it runs to help with thermals. |
|
Quoted: The generated images look much better before I convert to .gif https://www.ar15.com/media/mediaFiles/563643/250421_202931_489_8886_37__1_-3522879.gif https://www.ar15.com/media/mediaFiles/563643/250421_201323_708_8928_37-3522881.gif https://www.ar15.com/media/mediaFiles/563643/250421_200238_886_169_37__1_-3522882.gif Unbelievable. This shit is getting crazy! |
|
Incredible function for a local model. Every time someone says ai generation has plateaued or won't be viable for anything other than commercial use due to cost they're proven wrong within a month or two. Works well on my 3080ti. Maybe 12-14 minutes for a 5 second clip with around 110-120 frames. Quoted: Fuck AI With a rusty pitchfork The rest of you would too, if you knew whats coming! I asked AI what was coming and it told me nothing nefarious at all and to go back to uploading manuals and literature on the principles of nuclear weapons, the history of ICBMs, and 1960s-80s programming language. A weird request to be sure, but it offered to generate some really rad anime titties. |
I thought these were actors at first Historical Icons Brought Back to Life using AI |
|
Quoted: Interesting. Does it generate entirely from a prompt, or from both a prompt and source image like FramePack? What’s the VRAM requirement and generation speed? All of the ones quoted were image2video using Wan2.1, but it also does text2video equally well. Speed of generation depends greatly on how many steps you use. Most people probably do 30, but I find 145 steps does a significantly better job. A 5 second video at 160 fps ( I forget the final upscaled dimensions. 1440x1440?) is currently taking about 1300 seconds. So almost three clips per hour. My machine runs 24/7/365. It sucks that I can only post gifs here on arf, as the quality sucks compared to mp4. I'm using a 4090 with 24gb of vram. I can't comment on how sucky it might be with less, as I don't know. |
|
Quoted: downloaded it. Now extracting the file and Windows says I have 1 day left to extract. https://www.ar15.com/media/mediaFiles/308466/Screenshot_2025-04-21_195104_png-3522831.JPGThat's because Windows is blocking it. Right click the file, go to file properties, then click the "unblock" button. Or use 7zip. |
|
Wow, that's amazing. My disappointment that there was no George Washington is immeasurable. |
|
Quoted: Fuck AI With a rusty pitchfork The rest of you would too, if you knew whats coming! This will lead to VR simulations with realistic figures. Imagine a rock drill in VR where you can load the HVTs pic in and get a realistic bad guy that looks real. Or a hostage rescue where you can load the hostages faces so you know what they look like in a real sense. This tech is amazing. |
|
Quoted: https://distortion.io/i/7m3BB0.gif *This is an organic free trade gif stolen from the internet the old fashioned way Quoted: Quoted: Anyone try this with naked pictures of their ex GF? https://distortion.io/i/7m3BB0.gif *This is an organic free trade gif stolen from the internet the old fashioned way What if yuge... tracts of land are a possibility? |
|
Quoted: downloaded it. Now extracting the file and Windows says I have 1 day left to extract. https://www.ar15.com/media/mediaFiles/308466/Screenshot_2025-04-21_195104_png-3522831.JPGUse 7 Zip to extract the archive. It's free and will only take a minute or two to extract everything. (Windows Explorer BLOWS on most flavors of .zip archives) |
|
There was a program that did a similar type of thing with low frame rate videos. It could take the stills of each frame and used AI to fill in the gaps on missing frames. You could turn a 15 FPS clip into a perfectly smooth 120 FPS clip. I think it was called DAIN. |
|
Quoted: Come on, OP, post some more of them fancy movin' pictures.  Quoted: Come on, OP, post some more of them fancy movin' pictures. I’ll post some after work. I’m not creative so if you can provide the source image that would help. It took 3 prompts before generating something that didn’t violate the coc  Quoted: There was a program that did a similar type of thing with low frame rate pictures. It could take the stills of each frame and used AI to fill in the gaps on missing frames. You could turn a 15 FPS clip into a perfectly smooth 120 FPS clip. I think it was called DAIN. nVidia has 2x, 3x and 4x Frame Generation which does this real time in a game. |
| I don't even care that she's got flipper-hands. |
|
Quoted: @eurotrash Would you take this pic of my late wife, and see if you can make her hair blow in the wind? https://i.postimg.cc/mkqQGdwv/Linda-Pedro_AR15_001.jpg DM your email address and I’ll send you the .mp4 file. If I post here, it will be a .gif and will lose color and shading. |
|
Quoted: @eurotrash Would you take this pic of my late wife, and see if you can make her hair blow in the wind? https://i.postimg.cc/mkqQGdwv/Linda-Pedro_AR15_001.jpg Condolences for your wife, and hoping something good can come out of this tech to contribute to your memory of her. I find AI to be mostly annoying (although sometimes entertaining), but this is a pretty cool use of it. |