WUGNET, the Windows User Group Network
Your Complete Resource Center for "The Best" in Shareware, Computing Tips and Support, Windows Industry News... and much more!
Home Forums Shareware Windows Tips Hot Offers FREE Newsletters Arcade Contact Us About Partners
Search WUGNET: RSS Feeds RSS Feeds Advertise with WUGNET    |    Shareware eBooks
HomeHome FAQFAQ      ProfileProfile    Private MessagesPrivate Messages   Log inLog in

Avoiding duplicate files using ln

 
   Home -> Windows Other -> File System RSS
Next:  basic to dynamic  
Author Message
brigman

External


Since: Mar 26, 2008
Posts: 1



(Msg. 1) Posted: Wed Mar 26, 2008 11:25 pm
Post subject: Avoiding duplicate files using ln
Archived from groups: microsoft>public>win2000>file_system (more info?)

A bit of a wish list, I know, but does anyone know of a tool, that can
anlyse an NTFS filesystem and create an instance of any duplicate file
in a sperate folder to link the other instances to using ln.

For example, consider the directory listings:

D:\notebook01\c_drive_backup\file01.doc
D:\notebook01\c_drive_backup\file02.doc
D:\notebook01\c_drive_backup\file13.doc
D:\notebook01\c_drive_backup\file16.doc

and:

D:\notebook02\c_drive_backup\file03.doc
D:\notebook02\c_drive_backup\file04.doc
D:\notebook02\c_drive_backup\file13.doc
D:\notebook02\c_drive_backup\file19.doc

If it were found that the file common to both lists (file13.doc) had
the same size and md5 hash we could create a folder with that hash
name, copy the file into it and link the originals to it with ln for
single instance storage. The other issue is to mop up 'orphans' that
are no longer referenced elsewhere in the filesystem.

Obviously there exists filesystems like Sun Microsystems ZFS which can
take care of this stuff for you on the block level, and indeed, you
can run NTFS over the top of ZFS, but the point here is to do it
cheap.

Any advice appreciated.

Denys Williams
Back to top
Login to vote
Display posts from previous:   
       Home -> Windows Other -> File System All times are: Eastern Time (US & Canada) (change)
Page 1 of 1

 
You can post new topics in this forum
You can reply to topics in this forum
You can edit your posts in this forum
You can delete your posts in this forum
You can vote in polls in this forum
Categories:
 Windows XP
 Windows Vista
  Windows Other
 Office
 Office Other
 Security
  • Home |
  • Shareware |
  • Windows Tips |
  • Hot Offers |
  • FREE Newsletters |
  • Arcade |
  • Forums |
  • eBooks |
  • About WUGNET |
  • Partners |
  • Contact

  • WUGNET Privacy Policy |
  • Link to WUGNET |
  • IT Support