A few months back we took a look at Dain app, and how it was able to use AI and machine learning to create in between frames from almost any source footage and create something that looked and felt like real footage taken with higher fps cameras. The algorithm was so revolutionary that it took the world by storm, making older software that used re-timing from Adobe and others look antiquated and underpowered. The Dain-App was great and it was a pay what you want App but had an Achilles heel. The software required a powerful Nvidia GPU with as much VRAM as you could muster to be able to convert footage and re-time it.
The new Rife-App which is the direct successor of Dain App by the creator GRisk is up to 25x faster than the original, improves the algorithm, and by many examples betters it by creating more seamless transitions. The flow of frames is frankly jaw-droppingly beautiful, especially on low frame rate animation. We estimate that Animation studios in 2D will eat this app up immediately, and even 3D animation studios could reduce their render times by calculating fewer frames and using Rife-App to increase them to 24p, 30p or 60p from a lower source like 20fps or 12fps.
Rife App, more fps on any footage is now a reality:
- Model can run at 30+FPS for 2X 720p interpolation on a 2080Ti GPU
- The method supports 2X,4X,8X… interpolation, and multi-frame interpolation between a pair of images.
- input mp4/gif/webm/etc and interpolate the frames to make it 2X/4X/8X slower
- Can run on CPU (Slower) or faster on Nvidia GPUs.
The software changes are massive in speed and results, it can now run on the CPU in a slower mode which means the software should be able to use regular RAM instead of only VRAM on the GPU which is limited. It is still recommended to use an Nvidia RTX GPU is you can find one. We considered the RTX 3060 12GB starting at $399 to be an ideal card for this App as the Video Memory is 12GB instead of the usual 6 or 8GB found on even higher priced GPUs. If money is no object however you can opt for an RTX 3080 12GB or a 3090 24GB for a massive speed and memory depth boost.
Comparing Dain-App and Rife-App foi AI interpolation on Animations by GRisk A.I. Sandbox:
Comparing Dain-App and Rife-App AI interpolation on Chika Dance by GRisk A.I. Sandbox:
So as you can see above, the quality difference from Dain to Rife is hard to perceive but it is there. We do still have some morphing artifacts where not enough data can be extracted from the source like objects disappearing in weird ways when they are occluded behind the subject or other elements of the footage. The AI still does miracles that look as fluid as real life in some instances even when we are talking about 12fps or 14fps animation.
What about Slow Motion Video?
After all, what HSC is all about, is high-speed cameras so naturally, we are interested in the ability of Rife App to turn a camera output into super slow motion without the huge investment in camera gear. We explored interpolation in a post before and we are no fans of it as a substitute for the real thing but we have changed our tune since Dain and Rife Apps as they change the paradigm to express lower frame rates into higher ones that can be slowed done to create impressive high-speed footage that really can look in some instances like the source footage was captured at that speed. We were able to turn a 2000fps real captured footage into a 6000fps final video that looks so amazing that it could fool most of the public into thinking this is a true 6000fps slow motion hardware camera.
Is an ai “fps booster” really worth your time?(DAIN tech demo) by thebrax2000:
We believe that you can purchase a 1000fps slow motion camera and do interpolation up to 8x slower for an 8000fps result. For non-scientific applications, this could yield impressive results that could be used in video production and film visual effects. While there is no replacement for real captured frames, if your source is already quite good but want an even slower result, we feel Rife-App could deliver the holy grail of getting something for free that is excellent.
Pricing and availability:
Rife-App is available now at the official site here – v1.75 now!
The software license is $24.90 USD as a starting price but you can pay more to support the developer and help their quest to continue improvements.
The app is constantly updated and should get more stable and accurate as things are improved.
The code algorithm can be found here if you are a programmer and want to build a custom implementation.
As a side-note you can also support the Developer GRisk at Patreon here for new projects. It is always good to reward advancement and brilliance, this is a great example of a worthy cause.
This looks very interesting. So I could take a relatively clean 250 fps and transform it into 1000 fps for 20x slow motion at 50 fps. I am a bit fed up waiting for the affordable hardware option.
With the cheapest Nvidia card in mind do you have any idea if it could be feasible to process a 4 second 250 fps full HD file?
Yes, we processed a 2000fps clip to 4k and 6kfps the results were very good. This new version works on the CPU too. You will need to use the subframe buckets option which is like smaller tiles for higher resolution. We processed a 4k clip with that an no problem on a GTX 970 4GB card. A 250fps clip should be able to go to 1000f0s no problem if the shutter speed is high enough at capture time. Having no motion blur is best.
Thank you for discussing this app. I decided to buy it and I am very excited about how well it intrapolates the frames!
Keeping the same rate at 10x slow motion but increasing the frame rate from 25 to 50 already results in much nicer footage, especially when objects move perpendicular to the lens axis (25 fps is too slow in that case). I also tested 4 times intrapolation and the results are extremely nice.
As I run on CPU it takes some time but it is doable. I am wondering if a very cheap graphical card (200-300$) will still help shortening the processing time.
You mentioned the subframe buckets option, is that the Scale (which is standard on 1.0) or the Mp4 CRF setting?
Glad you found it useful, I think a GPU liks the rtx 3060 1GB would do good with this app. Starting at $399 if you can find it.
The buckets reduce the rendering area to tiles and lets you process huge video sizes like 4k on smaller memory configurations.