Parallel dirstate.walk?

Martin Geisler mg at aragost.com
Wed Aug 18 11:09:56 CDT 2010


Benoit Boissinot <bboissin at gmail.com> writes:

> On Wed, Aug 18, 2010 at 5:05 PM, Martin Geisler <mg at aragost.com> wrote:
>> So this is the idea: stat the directories in parallel. I guess this
>> would be done best by replacing dirstate.walk with a osutils.walk that
>> uses C threads internally before it returns a list to its caller. That
>> way the threads will be hidden from sight.
>>
>> Does this sound crazy? Is anybody crazy enough to attempt it? :)
>
> Not sure it's a win for the non-RAID case (or non-SSD case).
> I'd except it too be highly sequential in the "regular" case (and
> threading could actually hurt).

I'm sure it would hurt in those cases since with only one disk, there is
only read head after all... maybe I should have clarified this :)

The idea is to enable this on those repositories where you know it makes
a positive difference and then otherwise run things like today.

-- 
Martin Geisler

aragost Trifork
Professional Mercurial support
http://aragost.com/mercurial/


More information about the Mercurial-devel mailing list