Ultimate Command Line Compressors

Ultimate Command Line Compressors - uclc.info

This site reports the results of a wide variety of benchmarks to compare the latest state-of-the-art command line compressors with only one focus: ultimate size reduction.

21-02-2009: Started a new benchmark with undisclosed files summing to about 1GB, you can find it here: Pareto Frontier. It lists the compressed size and (de)compression speeds and shows which file compressors are pareto optimal.

19-02-2009: Tested NanoZip 0.06 alpha, impressive results considering the speed.

17-02-2009: Tested PAQ 8p, a large improvement on the Audio test due to a specialised model for audio data.

08-01-2008: Tested PAQ9 a, gets a separate entry because it's design is very different from the old PAQ 8. Tested CCM 1.30, small gains on big files, small losses on small files.

14-12-2007: Tested LPAQ 8, small gains on most tests.

11-11-2007: Tested TAK 1.0.2. Tested LZPM 0.11.

10-11-2007: Tested SR 3. Tested CMM 2007-09-18.

09-11-2007: Tested LPAQ 7, small gains on most tests. Tested CCM 1.26b, a large gain on the Scourge test.

08-11-2007: Tested LPAQ 6, a very good performance on the GIMP Source test.

28-10-2007: Tested PAQ 8o8, mostly small improvements, a large improvement on the Scourge test, audio remains the relative bottleneck. Added win32 build of PAQ 8o8.

29-04-2007: Tested M99 1.0 and 2.1.

25-04-2007: Tested Quark 0.95r, no changes. Tested CCM 1.20d, 1.20f, 1.20g and 1.21, small improvements largely due to new memory switch.

21-03-2007: Tested DGCA 1.10, negligible changes. Tested QC 050. Tested Hook 0.8d, negligible changes. Tested CCM 1.20a, some good improvements for example on the Large Text test at a loss of 25% in speed.

20-03-2007: Tested BMA 1.33 beta, small improvements on most tests, big improvement on Scourge test.

19-03-2007: Tested RAR 3.70 beta 5, very small fluctuations in compression, seems to be a bit more tuned for larger data. Tested Hook 0.8c, very small fluctuations. Tested Quad 1.10, small gains on all tests and 38% decompression speed increase.

18-03-2007: Tested Hook 0.8b, negligible losses on the text based tests.

17-03-2007: Tested Hook 0.8, performs noticeably worse on the GIMP Source and Half-Life datasets. Tested 7-Zip 4.45 alpha 1, no changes. Tested WavPack 4.40, a very small gain. Tested FLAC 1.1.4, a nice improvement. Tested TAK 1.0, a new lossless audio compressor which is both very fast and delivers very high compression.

16-03-2007: Tested CCM 1.17e, small improvements on almost all tests. Tested Hook 0.7c, no changes. Tested Quad 1.09, no changes. Tested QuickLZ 1.20.

14-03-2007: Tested Hook 0.7, small loss on the Lossless Audio test. Tested Hook 0.7b, most notable improvement on the Half-Life Mod test. Tested LZPXJ 1.2h, small improvements on all tests. Added win32 build of LZPXJ 1.2h. Tested Quad 1.08, no changes.

11-03-2007: Tested Quad 1.07BETA2, very small improvements. Tested TC 5.2dev2. Tested CCM 1.17b, slightly worse than previous version. Tested PPMCV 1.2. Tested Bee 0.7.9 build 0316, a very good gain on the Large Text test.

10-03-2007: Tested PAQ 8k, takes top position in the UT2004 Map test, but small losses in most test and a great loss in speed compared to PAQ 8jd. Tested PAQ 8l, takes the best non-dictionary entry in the Multilingual Text test and is back on the normal speed of PAQ 8jd. Added win32 build of PAQ 8l. Tested Ocamyd 1.66.final, small fluctuations. Added win32 build of Ocamyd 1.66.final. Tested Hook 0.6c, a new fast compressor using Dynamic Markov Modelling. Tested CCM 1.16c, a new fast compressor using Context Mixing, produces some very nice results on the more multimedia oriented benchmarks. Tested Quad 1.07BETA, small improvements on most tests, big improvement on the Lossless Audio test. Added win32 build of Chile 0.5 and tested it, small improvements on most tests. Tested the PNG recompressor PNGOUT 2007-03-08, no changes. Tested UDA 0.301, improvements on all tests. Tested CCM 1.16f, very small fluctuations. Tested CCM 1.17a, very small fluctuations.

02-01-2007: Tested KZIP 25-05-2006 and 11-10-2006, small improvements on all tests. Tested the PNG recompressor PNGOUT 29-10-2006, a very small improvement. Tested Quad 1.01a and 1.02a. Tested LZPXJ 1.2g, improvements on all tests.

01-01-2007: Tested PAQ 8jd, small improvements on most tests.

31-12-2006: Tested PAQ 8jb, small improvements on most tests, retakes first place on the Othello Database test. Tested PAQ 8jc, a massive improvement on the Half-Life Mod test that takes it to the top position! The improvements to the record model really shine on the well structured data. Tested Ocamyd 1.65.final, a large gain on the GIMP Source and Scourge tests. Tested Ocamyd 1.66.rc3, steady improvements on all tests. Tested the audio compressor OptimFROG 4.600ex, strengthening the top position due to a new experimental compression mode. Tested the BWT based compressors BBB 1 and OpenDark A. Added win32 build of PAQ 8jd, Ocamyd 1.66.rc3, BBB 1 and OpenDark A. Removed results of PAQAR because it is superseded by PAQ on all tests.

30-12-2006: Tested PAQ 8j, little losses on the text based tests, due to no inclusion of the PGM model the compression is back to version 8h on the Kodak test, but a clear improvement on the GIMP Source and Half-Life Mod tests. Tested PAQ 8ja, improvements on all tests, again a clear improvement on the Half-Life Mod test. Added win32 build of PAQ 8jc.

29-12-2006: Tested PAQ 8i, improvements on most tests, a massive improvement on the Kodak test due to a very efficient PGM model. Tested 7-Zip 4.44 alpha 1, small fluctuations.

19-05-2006: Added win32 build of Ocamyd 1.65.dev32.

15-05-2006: Tested 7-Zip 4.41 beta, no changes. Tested Fast PPMII variant J rev 1, no changes.

13-05-2006: Added win32 build of Ocamyd 1.65.dev25. Tested Ocamyd 1.65.dev23 and 1.65.dev25, relatively large gain on the GIMP Source test. Tested the audio compressor MP4ALS RM17, a very small loss.

26-04-2006: Tested the audio compressor OptimFROG 4.520b1, a very small improvement.

25-04-2006: Tested Pimple 1.43 beta, mostly negligible differences, a large improvement on the Lossless Audio test. Tested LZPXJ 1.1b, gains on all tests due to new compression switches. Added win32 build of Ocamyd 1.65.dev21.

18-04-2006: Tested LZPXJ 1.1a, very small fluctuations.

17-04-2006: Tested LZPXJ 1.0s, large improvements on the text oriented tests.

15-04-2006: Tested Ocamyd 1.65.dev20, small losses on the text oriented tests, small gains on the other tests and a big gain on the Scourge test that compensates the large loss of the previous version. The memory usage is now more customizable. Tested 7-Zip 4.39 beta, no changes.

14-04-2006: Added win32 build of Ocamyd 1.65.dev20.

06-04-2006: Tested Ocamyd 1.65.dev16, small losses on most tests, a big loss on the Scourge test. Added win32 build of Ocamyd 1.65.dev16.

05-04-2006: Tested DURILCA and DURILCA'light 0.5, small improvements on most tests.

04-04-2006: Tested Pimple 1.42 beta, good improvements on all tests, a massive improvement on the Lossless Audio test due to a specific filter for audio.

01-04-2006: Tested RAR 3.60 beta 1, very small fluctuations in compression, the speed of the algorithm is improved in some cases, the most important change is a multithreaded version of the compression algorithm.

29-03-2006: Tested Ocamyd 1.65.dev9, a big improvement on the Scourge test.

26-03-2006: Tested THOR 0.9a, has a new ultra fast compression mode. Tested 7-Zip 4.37 beta, no changes. Added win32 build of Ocamyd 1.65. Added a new compression test: Large Text Compression Test, the best non-dictionary entry is suprisingly not from the PAQ based family.

24-03-2006: Added win32 build of PAQ 8h.

23-03-2006: Tested PAQ 8h, improvements on all tests, relatively big improvement on the Lossless Audio test, retakes the best non-dictionary position on the Canterbury test.

15-03-2006: Tested THOR 0.81a, no changes compressionwise, but a nice increase in decompression speed. Tested 7-Zip 4.36 beta, no changes.

10-03-2006: Tested BMA 1.32 beta, small improvements on most tests. Added win32 build of Lzop 1.02rc1 and tested it, no changes in compression, but a slight increase in compression speed. Tested THOR 0.71a, very small fluctuations in compression.

09-03-2006: Tested WinRK 3.0 build 3 beta, most improvements were already known from LibMComp, but for example on the Scourge test, where it can use all it's specialized filters, it clearly outperforms LibMComp.

08-03-2006: Tested Quark 0.95, nice improvements on all multimedia based tests.

06-03-2006: Tested WavPack 4.31, no changes.

04-03-2006: Started a table with exemplary compression and decompression speeds. Tested 7-Zip 4.35 beta, no changes. Tested the audio compressor OptimFROG 4.520b, a very small improvement due to a special benchmark switch. Tested PAQ 8g, retakes the best non-dictionary position on the Calgary test, takes the top position on the Multilingual Text test.

03-03-2006: Tested LibMComp 2.3, this demo compressor showcases the M Software Compression Library, the raw algorithms of the future WinRK versions. The PWCM codec takes the top position in the UT2004 Map and Half-Life Mod test, it also is the best non-dictionary entry in the Calgary and Canterbury test. The assymetric ROLZ codec is improved again with version 3, it compresses better than 7-Zip LZMA in most tests but the compression and decompression is noticeably slower.

02-03-2006: Tested THOR 0.7a, improved results on all tests due to a new compression mode.

01-03-2006: Tested PAQ 8f, improvements on all tests, biggest improvements on the GIMP Source and the Half-Life Mod test. It now has a recursion ability.

23-02-2006: Tested PAQ 8e, very small changes. Tested 7-Zip 4.34 alpha 1, very small improvements. Tested Bee 0.7.9 build 0298, no changes. Tested Small PPMII 1024KB variant J, very small changes.

20-02-2006: Tested ATRAC Advanced Lossless, Sony's lossless audio format.

18-02-2006: Added a new compression test: Half-Life Mod Compression Test, a multimedia oriented dataset.

17-02-2006: Added win32 build of CALIC and tested it on the Kodak test.

16-02-2006: Tested Fast PPMII and Monstrous PPMII variant J, massive improvements on most datasets for Monstrous PPMII. Tested PAQAR 4.5, probably the final version based on the PAQ 6 core, takes the top spot on the Multilingual Text test! Tested PAQ 8d, the top position on the GIMP Source test is restored, the text preprocessor is disabled for .tar files.

15-02-2006: Tested THOR 0.6a, a new ultra fast compressor.

14-02-2006: Tested PAQ 8c, file type detection completely corrected on the Kodak test, but an extra loss on the GIMP Source test.

09-02-2006: Tested PAQ 8b, very small improvement on the Kodak test, but still wrong file type detection.

07-02-2006: Tested PAQ 8a2, improvements on the tests with text files due to the addition of WRT, losses on the GIMP Source and Kodak test due to wrong file type detection.

05-02-2006: Tested 7-Zip 4.33 beta, no changes. Tested LZPXJ 1.0f, a massive improvement on the Lossless Audio test. Tested QazaR 0.0pre5, large improvement on the GIMP Source test. Tested Pimple 1.0b10c, some nice improvements due to SSE.

28-01-2006: Tested PAQ 8a, takes number 1 spot on the GIMP Source test, massive improvements in the Lossless Audio and Scourge test.

27-01-2006: Tested 7-Zip 4.33 alpha 2, small improvements for Deflate and Deflate64, 20% speed improvement for LZMA.

23-01-2006: Tested PAsQDa 4.4, nice improvement on the Multilingual Text test. Removed all the results of PAQAR, because PAsQDa has now very close or better results on every test. Tested Monkey's Audio 4.01, no changes.

22-01-2006: Added a new compression test: Othello Games Database Compression Test. Tested PAQ 7star, 7plus 1.10, 7plus 1.11, 7plus 1.19, small improvements on all tests.

21-01-2006: Tested the PNG-cruncher OptiPNG 0.5, a very small improvement. Tested BMA 1.31 beta, improvements almost all tests. Tested MP4ALS RM16, the reference implementation of the new MPEG-4 Audio Lossless Coding standard, takes the second place in the Lossless Audio test. Tested LZPXJ 1.0b, 1.0c, 1.0d, 1.0e, improvements on almost all tests.

27-12-2005: Tested PNGOUT 26-12-2005, no changes in compression. Tested PAQAR 4.1, no changes. Tested KZIP 23-11-2005, no changes.

26-12-2005: Tested QazaR 0.0pre4b, a new compressor based on LZP and arithmetic coding.

25-12-2005: Tested PAQ 7, the next generation of PAQ which uses neural networks to combine models and is approximately 3 times faster than PAQAR. The general compression is also improved compared to PAQ 6, on some specific tests (Lossless Audio) there is a large loss in compression due to (for now) no model for those kind of files. Added win32 build of PAQ 7 and PAQAR 4.1.

24-12-2005: Tested WinRK 3.0 build 2 beta, better compression and faster than previous version, especially the new ROLZ2 algorithm. Tested LZPX(J) 1.0a, improvements on almost all tests.

16-12-2005: Added win32 build of Chile 0.3d and tested it, it is a new BTW based compressor. Tested 7-Zip 4.32, very small improvements due to the extension of the allowed range of some parameters. Tested PAsQDa 4.3b, very small improvements. Tested Pimple 1.0testbed, no changes.

26-11-2005: Tested Pimple 1.0test1, a new PAQ-like compressor, relatively performs best on the Multilingual Text test. Tested LZPX 1.5b, improvements on almost all tests. Tested 7-Zip 4.30 beta, no changes.

14-11-2005: Tested 7-Zip 4.30 alpha 9, very small compression improvements for the LZMA mode (except on the Lossless Audio test), but more importantly the compression speed in max and ultra LZMA mode is a lot higher. Tested UHARC 0.6b, no changes.

10-11-2005: Tested LZPX 1.4z, improvements on all tests, except on the Lossless Audio test and the Kodak test. Tested WinZip 10.0, no changes.

07-11-2005: Tested PNGOUT 07-08-2005, no changes. Tested KZIP 05-11-2005, no changes. Tested LZPX 1.4m, a large improvement on the Lossless Audio test.

06-11-2005: Tested WavPack 4.3, no changes.

05-11-2005: Tested Emilcont 0.3Alpha, a bit of a mixed bag, small gains and small losses.

04-11-2005: Registered a suitable domain name uclc.info.

28-10-2005: Tested RAR 3.51, no changes. Tested 7-Zip 4.29 beta, no changes. Tested ARJ32 3.14, no changes. Tested PAsQDa 4.1b, no changes. Tested Bee 0.7.8 build 0154, very small changes. Tested LZPX 1.4g, massive improvements on all tests. Tested WavPack 4.3b, a tiny improvement.

09-09-2005: Tested BMA 1.30 beta, improvements on most tests. Tested TC 4.2, no changes. Tested LZPX 1.1.

04-09-2005: Tested WinZip 10.0 Beta, adds two compression algorithms: the well-known bzip2 and PPMd. The extension is still zip, so it will probably produce a lot of confusion. Tested WavPack 4.22, a very small improvement. Tested BMA 1.29 beta, small fluctuations.

09-08-2005: Added a new compression test: Multilingual Text Compression Test. Tested RAR 3.50, no changes.

07-08-2005: Tested PNGOUT 07-08-2005, no changes.

06-08-2005: Added win32 build of Lz2a 02-04-2005 and tested it.

05-08-2005: Tested 7-Zip 4.26 beta, no changes.

04-08-2005: Tested PNGOUT 03-08-2005, no changes. Tested KZIP 03-08-2005, very small improvements. Tested 7-Zip 4.25 beta, no changes. Tested WinRK 2.1 build 6, little fluctuations. Tested OpenJPEG JPEG-2000 0.97.

02-08-2005: Tested PNGOUT 02-08-2005, a negligible size difference. Tested KZIP 02-08-2005, no changes. Tested Quark 0.93, a new LZ based compressor that produces some very nice results, while maintaining a fast decompression speed. Don't mix it up with QuArk, a compressor from 1993.

31-07-2005: Tested DGCA 1.08, no changes. Tested QLFC 6.6W.

30-07-2005: Tested ALZip 6.03 beta.

29-07-2005: Added a new compression test: Scourge Compression Test. Tested Bzip2 1.0.3, very small losses on some benchmarks.

28-07-2005: Added win32 build and source of Ocamyd 1.64. Tested StuffIt 9.0.

27-07-2005: Tested Squeez 5.0, seems to have a very nice audio compression routine. Tested KZIP 25-05-2005, produces the best ZIP results albeit very slow.

26-07-2005: Tested the PNG-cruncher OptiPNG 0.4.8. Tested the PNG-cruncher PNGOUT 25-05-2005, no changes. Tested RealAudio Lossless 11.0.0.1897.

25-07-2005: Changed menu layout and added Compressor Info list. Tested TC 4.1. Tested Kakadu JPEG-2000 4.5.2, no changes.

24-07-2005: Tested BMA 1.27 beta, a BWT based compressor. Tested RAR 3.50 beta 7, no changes. Tested SBC 0.970 rev 2, no changes.

21-07-2005: Tested the audio compressor OptimFROG 4.510, a negligible size difference, probably due to header changes.

13-07-2005: Tested bugfixed WinRK 2.1 build 4 beta, I will test all WinRK modes with 800MB model size from now on.

11-07-2005: Tested WinRK 2.1 build 3 beta, big improvements in the GIMP Source test and some small improvements in the other tests, it takes the 1st place in the GIMP Source test and breaks the 6MB barrier. It also has a brand new experimental hybrid LZP/PWCM codec named FPW (Fast Paq Weighting). It comes in 4 flavors, but I will only test the one that produces the smallest results (FPW1).

06-07-2005: Tested PAsQDa 4.1, very small improvements for the text compressor. Tested RAR 3.50 beta 6, no changes. Tested 7-Zip 4.24 beta, no changes in compression, but now with Drag and Drop support!

10-04-2005: Tested WavPack 4.2, no changes, but a brand new website!

07-04-2005: Tested PAsQDa 3.9. It is identical to PAsQDa 4.0 when files are compressed individually, but uses less memory and can be used with the -8 switch.

04-04-2005: Tested PAsQDa 4.0, small improvements for the top ranked text compressor.

01-04-2005: Tested RAR 3.50 beta 1, no changes.

30-03-2005: Tested 7-Zip 4.16 beta, no changes.

27-03-2005: Tested Emilcont 0.2xx, very small improvements in most tests and a large gain in the Lossless Audio test! Tested the audio compressor WavPack 4.2b4, a very small improvement.

25-03-2005: Tested BWTZIP, a BWT based compressor.

20-03-2005: Added a new compression test: Lossless Audio Compression Test. Tested UHARC 0.6a, no changes.

12-03-2005: Tested BSSC 0.95 alpha, small improvements on all tests.

03-03-2005: Tested BSSC 0.93 alpha, no changes.

02-03-2005: Tested BSSC 0.92 alpha, this is a new BWT based compressor. The results are comparable to YBS.

08-02-2005: Tested PAsQDa 3.0, small improvements.

05-02-2005: Added win32 build of MRP 0.5 and tested it on the Kodak set, a small improvement of the top position. Tested PAsQDa 2.1, very small improvements. Tested it with -7 switch due to disk trashing, also retested the previous versions with the -7 switch.

29-01-2005: Tested WinRK 2.0 build 5, big improvements in the GIMP Source test and in the Kodak test. Tested 7-Zip 4.15 beta, no changes. Tested RAR 3.42, no changes.

27-01-2005: Tested PAsQDa 1.0 and 2.0, basically it is PAQ(AR) combined with WRT, a word replacing transform preprocessor. Being a text specific enhancement, it is only tested on the Calgary and Canterbury tests. It takes the top position in both tests!

21-12-2004: Tested UHARC 0.6, mostly small gains for the PPM and ALZ algorithms, no changes for the LZP algorithm. Tested 7-Zip 4.13 beta, no changes.

15-12-2004: Tested WinRK 2.0 build 1, no changes for the PPMZ, PPMD and ROLZ algorithms, but the new experimental PWCM compression plugin (PAQ Weighted Context Model) takes the top position in three tests!

14-12-2004: Tested Ocamyd 1.64, small improvements on all tests. Tested bugfixed Slim! 0.23d, no changes. Tested RAR 3.41, no changes. Tested 7-Zip 4.12 beta, no changes.

04-10-2004: Tested Ocamyd 1.63, a small gain in the Kodak Grey-scale test. Tested 7-Zip 4.07 beta, no changes.

25-09-2004: Tested DURILCA and DURILCA'light 0.4b, DURILCA improved on all tests and makes the gap with PAQAR on the Calgary test very small, DURILCA'light only improved on the GIMP Source test.

24-09-2004: Tested Ocamyd 1.61 and 1.62, small gains in the Kodak Grey-scale test, no changes on the other tests.

23-09-2004: Tested Ocamyd 1.60, and again a nice gain in the Kodak Grey-scale test thanks to finetuning the new image compression algorithm.

21-09-2004: Tested Ocamyd 1.59, again a nice gain in the Kodak Grey-scale test thanks to the new image compression algorithm, in the other tests very small fluctuations.

20-09-2004: Tested DGCA 1.05.

19-09-2004: Tested RAR 3.40, no changes. Tested bugfixed Slim! 0.23c, no changes. Tested Ocamyd 1.57 and 1.58, a noticeable gain for the Kodak Grey-scale test thanks to the new increment method parameter. Tested Emilcont 0.2, improvements in all tests and a massive gain in the GIMP Source test! Added win32 build of Emilcont 0.2, it should be about 30% faster.

30-08-2004: Tested Slim! 0.23, very small improvements on all tests! Check out its new homepage.

26-08-2004: Tested WinRK 1.1 build 3, very small improvements and some very small losses.

21-08-2004: Tested RAR 3.40 beta 5, no changes.

20-08-2004: Tested WinRK 1.1 build 2, very small improvements and some very small losses.

17-08-2004: Tested Ocamyd 1.56, small improvements on all tests!

16-08-2004: Tested UDA 0.284, very small improvements on all tests, except for the UT2004 Map test.

10-08-2004: Tested UDA 0.283 (command line version of WinUDA), another compressor based on PAQ. Tested the three new versions of Ocamyd: 1.55 Base Edition, 1.55 Markov Edition 912 Variant I and 1.55 Markov Edition 912 Variant II. Improvements on all tests, except for the GIMP Source test.

05-08-2004: Tested Emilcont 0.1, an brand new compressor inspired on PAQ by Emilcont. Tested RAR 3.40 beta 4, no changes.

01-08-2004: Tested the image compressor CHP 0.01.

30-07-2004: Added win32 build of SLP 2a and tested it on the Kodak set. SLP, or Lossless Image Compression with Switched Linear Prediction is a very good image compression technique developed by Shinji Wakasugi. Tested CALICh, again an old but very good image compressor.

29-07-2004: Tested Lossless JPEG 1.0, another old image compressor than was part of the JPEG standard. It never had the same popularity as lossy JPEG and was replaced by JPEG-LS.

28-07-2004: Added win32 build of FELICS 1.1.1.1, a very old (1994) grey-scale image compressor, tested it on the Kodak test. Tested RAR 3.40 beta 3, no changes.

27-07-2004: Tested Kakadu JPEG-2000 4.2.1 and JJ2000 JPEG-2000 4.1 on the Kodak test. Added win32 build of JasPer JPEG-2000 1.701.0 and tested it on the Kodak test.

26-07-2004: Added win32 builds of APT 1.0 and BTPC 5. Tested APT 1.0, BTPC 5, JPEG-LS 1.00 and SPIHT. These are all compressors specifically designed for image compression. Added win32 build of PAQAR 4.0 (with progress indicator). Tested PAQAR 4.0, small improvements on all tests, except for the GIMP Source test.

24-07-2004: Added a new compression test: Kodak Grey-scale Image Compression Test.