repository for LARGE files?

[Jamie Webb]

On 2008-02-13 15:16:04 Abraham D. Smith wrote:
>     I need to synchronize and track the integrity of data across
> several machines.  The files are 10-100 MB large, and they total
> about 1TB. I was thinking a decentralized version control system
> might do this well, and I have a lot of experience with mercurial
> from other projects. However, my experience with hg has shown dismal
> performance with large files (at least before 0.9.5, which I haven't
> tried yet). Is it reasonable to have hg manage this much data, or is
> there a better solution out there?   I really do not want to resort
> to a pile of of hand-written rsync/md5sum scripts.  

Unless you actually want a permanent history record, a VCS is the wrong
tool. Have you considered Unison or csync?

/J