Native support for lz4?

[Augie Fackler]

On Fri, Aug 05, 2016 at 10:48:03AM -0700, Gregory Szorc wrote:
> Facebook introduced an lz4revlog extension a while ago. I think lz4 has
> some compelling performance advantages over zlib for revlog storage and
> wire protocol compression.
>
> I'd like to start a discussion about bundling the lz4 C implementation as
> part of the Mercurial distribution and supporting lz4 for revlogs and wire
> protocol compression out of the box.
>
> I'm not proposing requiring lz4 or making lz4 the default. I mostly care
> about making lz4 accessible to more users. (The 3rd party lz4revlog
> extension is difficult to use because you need a separate Python package
> providing lz4 support. Plus, lz4revlog isn't using the proper lz4 framing
> encoding and I'm hesitant to recommend its use because of this.)

Yes, we should definitely not use the existing python-lz4 in hg itself
- the one-off framing format makes me sad.

>
> I'd also entertain scope bloating the conversation to including other
> compression formats. Once you support 2, you need to support N, right? I've
> been taking an interest in zstd and I'd be curious if Facebook, others have
> any plans to add support to Mercurial.

I've been meaning to at least squint at this, but lack the round
tuits. I'm definitely open to this line of inquiry in general,
including the idea of bundling lz4 or adding better hooks for it in
core.


> _______________________________________________
> Mercurial-devel mailing list
> Mercurial-devel at mercurial-scm.org
> https://www.mercurial-scm.org/mailman/listinfo/mercurial-devel