[Request] Faster Skip Detection/Better Blank Frame Detection
Posted: 16 Jul 2020, 17:59
Would it be possible to improve the speed at which VTM detects and skips existing videos/thumbnails? Depending on the engine, it can range from slow to DAMN slow. Im dealing with 20,000+ videos (Over 20 TB), so even a little boost in speed would be appreciated.
I use VTM to detect the existence of duplicate videos. That might sound silly, but I promise you it is a fantastic way for me to save space when I download a duplicate video, but it's a different size/resolution. I just generate thumbs for all my existing videos and run it through something like "Duplicate Cleaner Pro" which can detect "similar" images (partial matches to compensate for the slight differences due to compression and time dilation). Then I go through and choose which version I want to keep. I wrote a program that cleans/removes the thumbs once the matching video is deleted/moved.
All this works great! But the slowest part is VTM chugging through the files with existing thumbs.
Also, would it be possible to expand on the blank frame detection feature? Even with this feature enabled, I still end up with a lot of blank frames. Maybe add a threshold that determines what is considered a blank/solid color frame?
Anyway, I love the program and I appreciate all the hard work you have put into it.
I use VTM to detect the existence of duplicate videos. That might sound silly, but I promise you it is a fantastic way for me to save space when I download a duplicate video, but it's a different size/resolution. I just generate thumbs for all my existing videos and run it through something like "Duplicate Cleaner Pro" which can detect "similar" images (partial matches to compensate for the slight differences due to compression and time dilation). Then I go through and choose which version I want to keep. I wrote a program that cleans/removes the thumbs once the matching video is deleted/moved.
All this works great! But the slowest part is VTM chugging through the files with existing thumbs.
Also, would it be possible to expand on the blank frame detection feature? Even with this feature enabled, I still end up with a lot of blank frames. Maybe add a threshold that determines what is considered a blank/solid color frame?
Anyway, I love the program and I appreciate all the hard work you have put into it.