What is the crowd's opinion of Video Duplicate Finder?

From 3.5 billion comments

I'm just sitting here wondering which actress starred in so many scenes...

In any case, a quick Google search gave me this, I haven't tried it so you tell me if it works; https://github.com/0x90d/videoduplicatefinder

Thanks, but strange for me: I downloaded the LINUX.tar.gz and have FFmpeg running, incl. FFprobe. The Requirements say "Open terminal in VDF folder and execute ./VDF.GUI" but in the .tar.gz there is no VDF.GUI.

Now what?

https://github.com/0x90d/videoduplicatefinder/releases

​

i myself am using this one and i find it the best one ive tried, but i havent tired many to be honest. check it up if it meets your expectations

Well, for now similar video finder may be quite limited for some people.

I checked that https://github.com/0x90d/videoduplicatefinder worked fine for me(1 months ago), but for now latest version(3.0.x) crashes due bug in GUI library.

Thank you, but I'm stupid enough and did not make it.

I tried https://github.com/0x90d/videoduplicatefinder/archive/refs/heads/master.zip and again no VDF.GUI Would you please provide me the URL for the download and perhaps more info, how to find VDF.GUI ?

Thanks!

https://github.com/0x90d/videoduplicatefinder

​

it uses ffmpeg to generate thumbnails and compares those thumbnails IIRC. works pretty well, but I have found other solutions that find different videos that this misses (the paid app video comparer for example)

I love this tool but I'm not sure I'd recommend this for this task. Surprised no one has mentioned it, but there's a fairly big danger in using a tool that looks for duplicates based on similar filenames in identifying false positives (i.e. remakes, multiple edits, sequels, or just similar names. Subtitles too if you've not set the size limit.).

I include more information in the filename at the end so the experience I would receive is probably amongst the worse, but I imagine a lot of other do similar and I still think there'd be some either way so I think it's worth pointing out the example anyway: I ran this on my movie library (which has a few dupes atm, but is mostly unique) using the settings suggested and achieved a false positive rate of roughly 40% (355 movie folders, via Radarr, in 211 groups). That's not something I would trust software to identify fully automatically.

If you use this tool, I would recommend ensuring the setting match your layout and double-checking everything it suggests.

But instead, I would recommend the likes of:

• Sonarr / Radarr to keep it in track
• A dedupe tool that actually scans the video files and finds similar video content, such as https://github.com/0x90d/videoduplicatefinder
• Assuming Plex has correctly matched it all, it will have identified duplicates already for you, you can then do it manually or use a tool like https://github.com/l3uddz/plex_dupefinder

I've been looking for exactly what you describe, because most mac apps that offer to find duplicates can only find exact duplicates of the file (by hash) or in some cases similar images. Everything that promised the functionality of finding similar videos turned out to be doing the exact same as duplicate file finders, so the same video in different resolutions wouldn't be recognized.

There's two workarounds and I hope it's okay I share them here, even though it has nothing directly to do with Hermit Crab…

A) get an app that creates video thumbnails and set the individual images to a decent resolution (like 480p). It'll create a jpg with 4x8 (or whatever you set it to) thumbnails with the same filename as your video. Run those thumbnails through an app like Gemini (since you're not deleting any files directly, this even works in the free/trial version). It will identify them as similar images, you can check if they're the same video, search for that filename and delete the lower or higher resolution one. There's still some work involved, but it works pretty reliably.

B) There's an open source Windows application that does exactly what you're describing. Video Duplicate Finder (github). It searches through your videos, tells you the resolution, filesize, bitrate and percentage of it being the same file. You can even adjust the threshold, so videos with a match lower than X% don't even show. Unfortunately, it's windows (or Linux) only, since I have Boot Camp anyways it's not a huge problem for me, because it's not a process that I'm doing daily or even weekly. It's pretty fast and fairly reliable in its results.

I use this: https://github.com/0x90d/videoduplicatefinder

GUI only runs on the 2 more popular OSes tho, so either you'll need to use the console version, or install Linux if you want to run the GUI version.

Extremely unresponsive after running on the system drive (~25 000 items detected). The scan has frozen judging by the UI.

i7-4770K, build https://github.com/0x90d/videoduplicatefinder/releases/tag/2.0.7