[PATCH] largefiles: RFC - customizable largefiles locations

[Mads Kiilerich]

# HG changeset patch
# User Mads Kiilerich <madski at unity3d.com>
# Date 1458403499 25200
#      Sat Mar 19 09:04:59 2016 -0700
# Node ID d0d9eab4d5fb107e00c6b3beba53bb5817ab84d3
# Parent  b3d3dd7eeeb7077d756eeab794457458251929e1
largefiles: RFC - customizable largefiles locations

My users request more flexibility for largefile storage.

Some use cases:

They might want to use different disks for repos and cache, and hardlinking
will thus not work. They might thus not want the .hg/largefiles cache but only
store everything in the user cache.

They might have a store on another file system that they want to use - for
example when dualbooting and having different file systems but wanting to reuse
largefiles that already have been downloaded. It could also be a shared network
drive or something.

Will the functionality outlined in the documentation work for you? Would it be
a good idea?


Additional comments:

Observation: default-push - not relevant, only indirectly relevant when chosen
as push destination.

q: can we always assume all largefiles will be present in a "local" store? or
can it be streamed on demand when on fast reliable network? or how should
"fetch before merge" work? or should we just have better handling of missing
largefiles?

Observation: there are like 3 levels of largefile "presence":
* stat - to check if a remote server has the largefile ... but then why not just
try to fetch it and let it fail?
* pull - make sure everything is present locally so we don't find it missing
later at an akward moment ... but why not just get rid of having it awkeard to
be missing?
* use - copy it to the working directory or serve it

diff --git a/hgext/largefiles/__init__.py b/hgext/largefiles/__init__.py
--- a/hgext/largefiles/__init__.py
+++ b/hgext/largefiles/__init__.py
@@ -103,6 +103,37 @@ will be ignored for any repositories not
 largefile. To add the first largefile to a repository, you must
 explicitly do so with the --large flag passed to the :hg:`add`
 command.
+
+
+PROPOSED FEATURE:
+
+When a new largefile is found or committed, ``largefiles.writepaths`` will be
+used to get a list of locations where the largefile should be stored, indexed
+by content. This serves to make sure the largefile not are stored and
+transferred more times than necessary while also making the largefiles
+available when pushing or when sharing just the repository at the file system
+level.
+
+Default: ``.hg/largefiles`` ``usercache``
+
+``.hg/largefiles`` designates the repo speicifc folder inside ``.hg``
+``usercache`` designates the OS and user specific "global" cache
+
+When a largefile is needed, ``largefiles.readpaths`` will be used to get an
+additional list of locations. The write locations and these read locations will
+be searched in order when looking for a largefile.
+
+Default: ``lfpullsource`` ``default``
+
+``lfpullsource`` is only set and used when doing ``pull -u``
+``default`` is a reference to the configured ``paths`` path.
+
+In both lists, it is also possible to specify other file system paths, path
+aliases or remote URLs.
+
+
+When pushing, all largefiles referenced in the pushed revisions will be pushed
+from one of the readpaths to the push location (unless they already are there).
 '''
 
 from mercurial import hg, localrepo