de-duplication and merging of data
Posted: Wed May 05, 2010 9:13 am
Is it possible to use SuperFlexible for de-duplication and merging of data in the following scenario?
It seems SuperFlexible was made for just this, but I can't seem to get it right.
Given:
- Several older backups disks, containing various older backups of my data
- They were made from various (previous) computers that I once used.
- Typically a lot of the data will be identical, but likely lives in different folders
- Data includes music, photos and all kind of documents gathered over time
What I would like to achieve:
- Combine this data to a new large backup archive
- Make absolutely sure that I am not missing any data from the old backup disks
- Copy only one instance of each identical file, allowing to adjust in the preview which one to copy
- Reorganize the data on the new backup archive
- Discard and re-use the old backup disks, now that I am sure there is nothing valuable on it anymore
As a simple test I created a profile copying left to right including all subfolders. When I use that with paths that have the same root it works fine as expected, and finds nicely all missing files on the right side. But when I used it with a left path that is one level up as compared to the right folder superflexible seems confused, and proposes to copy tons of data, while that data actually already exists on the right side, just one folder down. I tested with pre-5.00 build 27.
Any help and suggestions appreciated
It seems SuperFlexible was made for just this, but I can't seem to get it right.
Given:
- Several older backups disks, containing various older backups of my data
- They were made from various (previous) computers that I once used.
- Typically a lot of the data will be identical, but likely lives in different folders
- Data includes music, photos and all kind of documents gathered over time
What I would like to achieve:
- Combine this data to a new large backup archive
- Make absolutely sure that I am not missing any data from the old backup disks
- Copy only one instance of each identical file, allowing to adjust in the preview which one to copy
- Reorganize the data on the new backup archive
- Discard and re-use the old backup disks, now that I am sure there is nothing valuable on it anymore
As a simple test I created a profile copying left to right including all subfolders. When I use that with paths that have the same root it works fine as expected, and finds nicely all missing files on the right side. But when I used it with a left path that is one level up as compared to the right folder superflexible seems confused, and proposes to copy tons of data, while that data actually already exists on the right side, just one folder down. I tested with pre-5.00 build 27.
Any help and suggestions appreciated