Mercurial problem with large binary changesets

Francois-Denis Gonthier fdgonthier at kryptiva.com
Wed May 30 10:05:20 CDT 2007


----- KRYPTIVA PACKAGED MESSAGE -----
PACKAGING TYPE: SIGNED
 > This will dump a copy of troublesome compressed chunk to disk. Then
 > we can try to decompress it manually:
 >
 >>>> import zlib b = file("/tmp/busted-bin").read() a =
 >>>> zlib.decompress(b) len(a)
 > 688890
 >>>> a[:50]
 > '[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14,'
 >

 >>> import zlib b = file("/tmp/busted-bin").read() a =
 >>> zlib.decompress(b) len(a)
22130994
 >>> len(b)
1305692
 >>> a[:50]
'\x00\x00\x00\x00\x00\x00\x00\xdc\x00\x00\x00\xdc\x1a\x00\x00\x04\x00\x00+\x00\x00\x00\xa1ll\x00or%\x85\x00\x00P\x97\x00\x00^\x18\x00\x00\x1e\x00\x00\x00\x00\x00I\x1cw\x00'
 >>>

at this point, the Python process consumes that much memory:

fdgonthier at nemo:~$ ps -o pid,vsz -p $(pgrep python)
   PID    VSZ
26836  27772

I guess this could lead to problems if there are many copies of that in
memory...
----- KRYPTIVA SIGNED MESSAGE -----
This email claims to have been packaged by Kryptiva.
To process this email and authenticate its origin, get
the free plugin from:
http://www.kryptiva.com/downloads

----- KRYPTIVA SIGNATURE START -----
AvWVqAAAAAIAAAABAAAAAAAATiACAQAAAAC3AQAIAAAAAwAAAAECABS3FuvxegTt63v7UWCF
iSdtKgVqvAMAFNtYnPf/czq1EyEfvnKRBT4kXaMpBAAUPeBFYOVSOO06L2Fx5nv/SqsjQBQF
ABTaOaPuXmtLDTJVv++VYBiQr9gHCQYAFNcZh+doKHiXksUamShm9lxTMLNaBwAUjWmscEnl
gK4ul+0M9ZrgV8D102QRABgAAAAAAABOIEZdkrAAAI1AAAAAAAAAEJ4TAAQAAAAAAAAAggP/
SbTL9kOmMvHhrstmP/6xijc6gvJiNgADEnI9FVy6nzaFdebeJiHmQkxv0NHs5uMdYe/T2ax8
SKBE8fuVk0/3TXt6MUbfNkSAGe3xEZ80AcYTgwjRr3sDePawYJftgZjjQAFcN4jzqCQcM9TP
CnZ2sGKXgiy4245Y/DU1/9jsgUw=
----- KRYPTIVA SIGNATURE END -----


More information about the Mercurial mailing list