Public 30-file benchmark

PIZD 4.3.0 · 11,815,190 input bytes · 540 verified configuration rows · 5 measured rounds + 3 warmups.

16 system logs + 2 historical HTTP windows + 4 public JSON event windows + 8 parser fixtures. Bounded excerpts, not 30 complete production captures. Methodology and limits · CSV · Source provenance · Pairwise wins · Results by source category

Aggregate measurements

Times sum the per-file medians. Full external dictionary bytes are charged per file. 🏆 indicates best metric across all 18 configurations.

ConfigurationArchive bytesBytes incl. dictionarySource %Encode msVerified decode msEncode MB/sVerified decode MB/sBytes with shared dictionaryWins vs Zstd baseline (/30)
Brotli_Q11,099,6941,099,6949.31%42.87440.237275.6293.61,099,694— (Baseline)
Brotli_Q6834,540834,5407.06%345.03526.02134.2454.1834,540— (Baseline)
Brotli_Q9815,753815,7536.90%990.98325.84711.9457.1815,753— (Baseline)
Gzip_L11,562,3991,562,39913.22%38.85725.251304.1467.91,562,399— (Baseline)
Gzip_L61,058,9181,058,9188.96%164.00819.35672.0610.41,058,918— (Baseline)
Gzip_L91,053,2551,053,2558.91%254.56619.51646.4605.41,053,255— (Baseline)
PIZD_hybrid_default844,286844,2867.15%144.26424.52281.9481.8844,286Taille 18/30 · Vitesse 0/30 · Décode 6/30
PIZD_hybrid_fast953,240953,2408.07%125.34617.57894.3672.2953,240Taille 9/30 · Vitesse 0/30 · Décode 15/30
PIZD_hybrid_thin_L9🏆 750,015🏆 750,015🏆 6.35%536.60428.24422.0418.3🏆 750,015Taille 14/30 · Vitesse 5/30 · Décode 6/30
PIZD_native_default864,079864,0797.31%184.68533.87964.0348.8864,079Taille 17/30 · Vitesse 0/30 · Décode 0/30
PIZD_native_fast1,306,1111,306,11111.05%129.17428.95391.5408.11,306,111Taille 2/30 · Vitesse 0/30 · Décode 0/30
PIZD_native_thin_L0820,774820,7746.95%366.84734.93132.2338.2820,774Taille 10/30 · Vitesse 23/30 · Décode 7/30
Zstd_L1985,110985,1108.34%28.23012.987418.5909.8985,110— (Baseline)
Zstd_L1_disjoint_window_dict1,014,1811,505,70112.74%🏆 27.60613.658🏆 428.0865.11,030,565— (Baseline)
Zstd_L3980,830980,8308.30%30.772🏆 12.854384.0🏆 919.2980,830— (Baseline)
Zstd_L3_disjoint_window_dict981,8961,473,41612.47%36.25913.384325.9882.8998,280— (Baseline)
Zstd_L9835,071835,0717.07%294.65113.39240.1882.2835,071— (Baseline)
Zstd_L9_disjoint_window_dict849,5031,341,02311.35%156.77713.84975.4853.2865,887— (Baseline)

Pairwise Head-to-Head Win Rates (out of 30 files)

Number of files where PIZD achieves strictly smaller compressed bytes or lower execution latency than the reference codec.

PIZD ConfigurationReference BaselineSize Wins / 30Compression Speed Wins / 30Verified Decompression Wins / 30
Native DefaultZstd_L3✅ 17/30 (56.7%)0/30 (0.0%)0/30 (0.0%)
Native DefaultZstd_L3_disjoint_window_dict✅ 30/30 (100.0%)1/30 (3.3%)1/30 (3.3%)
Native DefaultGzip_L6✅ 20/30 (66.7%)9/30 (30.0%)1/30 (3.3%)
Native DefaultBrotli_Q610/30 (33.3%)✅ 26/30 (86.7%)8/30 (26.7%)
Hybrid DefaultZstd_L3✅ 18/30 (60.0%)0/30 (0.0%)6/30 (20.0%)
Hybrid DefaultZstd_L3_disjoint_window_dict✅ 30/30 (100.0%)2/30 (6.7%)11/30 (36.7%)
Hybrid DefaultGzip_L6✅ 21/30 (70.0%)✅ 15/30 (50.0%)14/30 (46.7%)
Hybrid DefaultBrotli_Q611/30 (36.7%)✅ 26/30 (86.7%)✅ 17/30 (56.7%)
Native FastZstd_L12/30 (6.7%)0/30 (0.0%)0/30 (0.0%)
Native FastZstd_L1_disjoint_window_dict✅ 23/30 (76.7%)0/30 (0.0%)3/30 (10.0%)
Native FastGzip_L114/30 (46.7%)0/30 (0.0%)14/30 (46.7%)
Native FastBrotli_Q17/30 (23.3%)0/30 (0.0%)✅ 26/30 (86.7%)
Hybrid FastZstd_L19/30 (30.0%)0/30 (0.0%)✅ 15/30 (50.0%)
Hybrid FastZstd_L1_disjoint_window_dict✅ 30/30 (100.0%)2/30 (6.7%)✅ 21/30 (70.0%)
Hybrid FastGzip_L1✅ 28/30 (93.3%)1/30 (3.3%)✅ 26/30 (86.7%)
Hybrid FastBrotli_Q1✅ 27/30 (90.0%)1/30 (3.3%)✅ 27/30 (90.0%)
Native ThinZstd_L910/30 (33.3%)✅ 23/30 (76.7%)7/30 (23.3%)
Native ThinZstd_L9_disjoint_window_dict✅ 30/30 (100.0%)0/30 (0.0%)7/30 (23.3%)
Native ThinGzip_L9✅ 22/30 (73.3%)8/30 (26.7%)1/30 (3.3%)
Native ThinBrotli_Q910/30 (33.3%)✅ 29/30 (96.7%)8/30 (26.7%)
Hybrid ThinZstd_L914/30 (46.7%)5/30 (16.7%)6/30 (20.0%)
Hybrid ThinZstd_L9_disjoint_window_dict✅ 30/30 (100.0%)0/30 (0.0%)10/30 (33.3%)
Hybrid ThinGzip_L9✅ 23/30 (76.7%)3/30 (10.0%)5/30 (16.7%)
Hybrid ThinBrotli_Q9✅ 15/30 (50.0%)✅ 24/30 (80.0%)7/30 (23.3%)

Three preset comparisons, each with Native and Hybrid

✅ means PIZD is better for that individual measure. Advantage = 100 × (reference − PIZD) / reference. Negative values retain PIZD losses. All decode times include BLAKE3 source verification; every restoration also passes exact-byte and SHA-256 checks outside the timer.

Native / default

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_default47,8837.834
66.9 MB/s		1.575
332.8 MB/s		9.13%———
Zstd_L350,1551.336
392.2 MB/s		0.598
876.7 MB/s		9.57%✅ +4.5%-486.2%-163.4%
Zstd_L3_disjoint_window_dict66,8671.535
341.5 MB/s		0.710
738.2 MB/s		12.76%✅ +28.4%-410.4%-121.8%
Gzip_L650,1748.410
62.3 MB/s		0.970
540.3 MB/s		9.57%✅ +4.6%✅ +6.9%-62.4%
Brotli_Q643,32115.928
32.9 MB/s		1.228
426.8 MB/s		8.26%-10.5%✅ +50.8%-28.3%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_default17,5873.241
74.0 MB/s		0.617
388.7 MB/s		7.34%———
Zstd_L318,6500.523
458.0 MB/s		0.240
1000.1 MB/s		7.78%✅ +5.7%-519.1%-157.3%
Zstd_L3_disjoint_window_dict34,9320.645
371.8 MB/s		0.268
893.4 MB/s		14.57%✅ +49.7%-402.6%-129.9%
Gzip_L618,4622.702
88.7 MB/s		0.358
670.7 MB/s		7.70%✅ +4.7%-19.9%-72.6%
Brotli_Q615,2704.961
48.3 MB/s		0.480
499.8 MB/s		6.37%-15.2%✅ +34.7%-28.6%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_default25,7646.110
85.8 MB/s		1.555
337.2 MB/s		4.92%———
Zstd_L323,4370.749
699.4 MB/s		0.468
1119.9 MB/s		4.47%-9.9%-715.2%-232.1%
Zstd_L3_disjoint_window_dict39,7450.888
590.2 MB/s		0.452
1160.8 MB/s		7.58%✅ +35.2%-587.9%-244.2%
Gzip_L625,7064.067
128.9 MB/s		0.590
888.0 MB/s		4.90%-0.2%-50.2%-163.3%
Brotli_Q618,88811.589
45.2 MB/s		0.734
713.7 MB/s		3.60%-36.4%✅ +47.3%-111.7%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_default9,5824.375
119.8 MB/s		0.898
583.8 MB/s		1.83%———
Zstd_L321,8080.879
596.7 MB/s		0.422
1240.9 MB/s		4.16%✅ +56.1%-397.9%-112.6%
Zstd_L3_disjoint_window_dict38,0140.843
622.2 MB/s		0.421
1246.0 MB/s		7.25%✅ +74.8%-419.2%-113.5%
Gzip_L619,5023.764
139.3 MB/s		0.475
1104.5 MB/s		3.72%✅ +50.9%-16.2%-89.2%
Brotli_Q615,75711.639
45.0 MB/s		0.655
800.1 MB/s		3.01%✅ +39.2%✅ +62.4%-37.1%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_default44,0195.542
94.6 MB/s		1.011
518.5 MB/s		8.40%———
Zstd_L345,5571.195
438.8 MB/s		0.442
1184.8 MB/s		8.69%✅ +3.4%-363.9%-128.5%
Zstd_L3_disjoint_window_dict61,8701.642
319.2 MB/s		0.517
1015.0 MB/s		11.80%✅ +28.9%-237.4%-95.8%
Gzip_L648,1955.776
90.8 MB/s		0.814
644.4 MB/s		9.19%✅ +8.7%✅ +4.1%-24.3%
Brotli_Q640,69513.286
39.5 MB/s		1.329
394.5 MB/s		7.76%-8.2%✅ +58.3%✅ +23.9%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_default18,4234.264
122.9 MB/s		0.991
529.1 MB/s		3.51%———
Zstd_L325,2790.826
634.7 MB/s		0.391
1342.3 MB/s		4.82%✅ +27.1%-416.3%-153.7%
Zstd_L3_disjoint_window_dict41,5960.997
525.9 MB/s		0.410
1279.1 MB/s		7.93%✅ +55.7%-327.8%-141.7%
Gzip_L625,6724.331
121.0 MB/s		0.551
951.0 MB/s		4.90%✅ +28.2%✅ +1.5%-79.7%
Brotli_Q623,19911.913
44.0 MB/s		0.724
723.9 MB/s		4.43%✅ +20.6%✅ +64.2%-36.8%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_default22,3105.600
93.6 MB/s		1.529
342.8 MB/s		4.26%———
Zstd_L336,7511.142
459.0 MB/s		0.480
1091.6 MB/s		7.01%✅ +39.3%-390.3%-218.5%
Zstd_L3_disjoint_window_dict53,5571.242
422.2 MB/s		0.519
1010.5 MB/s		10.22%✅ +58.3%-351.0%-194.8%
Gzip_L635,5226.029
87.0 MB/s		0.635
825.0 MB/s		6.78%✅ +37.2%✅ +7.1%-140.7%
Brotli_Q630,68614.005
37.4 MB/s		0.951
551.5 MB/s		5.85%✅ +27.3%✅ +60.0%-60.9%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_default43,4966.854
76.5 MB/s		1.506
348.1 MB/s		8.30%———
Zstd_L347,7101.200
436.7 MB/s		0.531
986.4 MB/s		9.10%✅ +8.8%-471.0%-183.4%
Zstd_L3_disjoint_window_dict64,1811.627
322.2 MB/s		0.604
868.0 MB/s		12.24%✅ +32.2%-321.2%-149.4%
Gzip_L650,6287.324
71.6 MB/s		0.825
635.7 MB/s		9.66%✅ +14.1%✅ +6.4%-82.6%
Brotli_Q640,47214.567
36.0 MB/s		1.128
464.9 MB/s		7.72%-7.5%✅ +53.0%-33.6%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_default17,7875.105
102.7 MB/s		1.047
500.6 MB/s		3.39%———
Zstd_L320,3400.672
780.4 MB/s		0.383
1369.5 MB/s		3.88%✅ +12.6%-659.9%-173.6%
Zstd_L3_disjoint_window_dict36,8540.881
595.2 MB/s		0.403
1299.4 MB/s		7.03%✅ +51.7%-479.6%-159.6%
Gzip_L622,8163.900
134.4 MB/s		0.526
996.5 MB/s		4.35%✅ +22.0%-30.9%-99.1%
Brotli_Q615,23110.396
50.4 MB/s		0.791
662.9 MB/s		2.91%-16.8%✅ +50.9%-32.4%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_default32,7605.750
91.2 MB/s		1.487
352.4 MB/s		6.25%———
Zstd_L337,1131.180
444.0 MB/s		0.524
999.6 MB/s		7.08%✅ +11.7%-387.1%-183.6%
Zstd_L3_disjoint_window_dict53,6681.306
401.2 MB/s		0.596
880.0 MB/s		10.24%✅ +39.0%-340.1%-149.7%
Gzip_L642,1147.570
69.2 MB/s		0.851
615.7 MB/s		8.03%✅ +22.2%✅ +24.0%-74.7%
Brotli_Q631,18214.526
36.1 MB/s		1.008
519.7 MB/s		5.95%-5.1%✅ +60.4%-47.5%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_default23,3565.521
95.0 MB/s		0.994
527.4 MB/s		4.46%———
Zstd_L333,1020.954
549.6 MB/s		0.508
1031.5 MB/s		6.31%✅ +29.4%-478.8%-95.6%
Zstd_L3_disjoint_window_dict49,2731.119
468.3 MB/s		0.511
1026.0 MB/s		9.40%✅ +52.6%-393.2%-94.6%
Gzip_L637,0154.926
106.4 MB/s		0.696
753.7 MB/s		7.06%✅ +36.9%-12.1%-42.9%
Brotli_Q626,06211.631
45.1 MB/s		0.857
612.0 MB/s		4.97%✅ +10.4%✅ +52.5%-16.1%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_default42,3086.649
78.8 MB/s		1.820
288.0 MB/s		8.07%———
Zstd_L354,8241.718
305.1 MB/s		0.681
770.0 MB/s		10.46%✅ +22.8%-287.0%-167.3%
Zstd_L3_disjoint_window_dict71,0401.838
285.2 MB/s		0.648
809.2 MB/s		13.55%✅ +40.4%-261.8%-180.9%
Gzip_L699,45712.688
41.3 MB/s		1.509
347.5 MB/s		18.97%✅ +57.5%✅ +47.6%-20.6%
Brotli_Q645,18914.937
35.1 MB/s		1.198
437.7 MB/s		8.62%✅ +6.4%✅ +55.5%-52.0%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_default51,8855.892
89.0 MB/s		1.107
473.8 MB/s		9.90%———
Zstd_L347,0751.228
426.9 MB/s		0.601
872.6 MB/s		8.98%-10.2%-379.7%-84.2%
Zstd_L3_disjoint_window_dict63,5301.569
334.1 MB/s		0.622
842.5 MB/s		12.12%✅ +18.3%-275.5%-77.8%
Gzip_L642,9957.050
74.4 MB/s		0.800
655.6 MB/s		8.20%-20.7%✅ +16.4%-38.4%
Brotli_Q636,90815.147
34.6 MB/s		1.091
480.4 MB/s		7.04%-40.6%✅ +61.1%-1.4%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_default26,2947.304
71.8 MB/s		2.020
259.6 MB/s		5.02%———
Zstd_L335,0451.002
523.0 MB/s		0.482
1088.6 MB/s		6.69%✅ +25.0%-628.6%-319.4%
Zstd_L3_disjoint_window_dict51,4511.205
435.0 MB/s		0.501
1045.9 MB/s		9.81%✅ +48.9%-506.1%-303.0%
Gzip_L634,3095.343
98.1 MB/s		0.736
712.1 MB/s		6.54%✅ +23.4%-36.7%-174.4%
Brotli_Q628,93312.914
40.6 MB/s		1.097
478.0 MB/s		5.52%✅ +9.1%✅ +43.4%-84.2%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_default17,61810.921
48.0 MB/s		2.364
221.7 MB/s		3.36%———
Zstd_L335,5413.002
174.6 MB/s		1.270
412.8 MB/s		6.78%✅ +50.4%-263.8%-86.2%
Zstd_L3_disjoint_window_dict52,1232.630
199.3 MB/s		1.265
414.4 MB/s		9.94%✅ +66.2%-315.2%-86.9%
Gzip_L633,45015.706
33.4 MB/s		1.157
452.9 MB/s		6.38%✅ +47.3%✅ +30.5%-104.3%
Brotli_Q627,10438.278
13.7 MB/s		1.968
266.3 MB/s		5.17%✅ +35.0%✅ +71.5%-20.1%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_default27,97811.239
46.6 MB/s		2.593
202.2 MB/s		5.34%———
Zstd_L332,2911.999
262.2 MB/s		0.847
618.9 MB/s		6.16%✅ +13.4%-462.2%-206.1%
Zstd_L3_disjoint_window_dict48,8361.957
267.9 MB/s		0.837
626.0 MB/s		9.32%✅ +42.7%-474.3%-209.6%
Gzip_L627,5828.609
60.9 MB/s		0.995
526.7 MB/s		5.26%-1.4%-30.5%-160.5%
Brotli_Q625,46416.265
32.2 MB/s		1.645
318.8 MB/s		4.86%-9.9%✅ +30.9%-57.6%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_default8690.369
8.6 MB/s		0.035
90.2 MB/s		27.35%———
Zstd_L36680.072
43.8 MB/s		0.014
222.9 MB/s		21.03%-30.1%-409.8%-147.1%
Zstd_L3_disjoint_window_dict17,0070.126
25.2 MB/s		0.023
140.6 MB/s		535.32%✅ +94.9%-192.7%-55.8%
Gzip_L66340.067
47.1 MB/s		0.021
151.3 MB/s		19.96%-37.1%-448.3%-67.7%
Brotli_Q65920.268
11.9 MB/s		0.038
83.1 MB/s		18.63%-46.8%-38.0%✅ +7.9%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_default7120.115
14.0 MB/s		0.016
102.0 MB/s		44.17%———
Zstd_L35450.062
25.9 MB/s		0.009
186.2 MB/s		33.81%-30.6%-84.6%-82.5%
Zstd_L3_disjoint_window_dict16,9080.120
13.4 MB/s		0.020
81.7 MB/s		1048.88%✅ +95.8%✅ +4.6%✅ +19.9%
Gzip_L65410.055
29.1 MB/s		0.017
96.8 MB/s		33.56%-31.6%-106.9%✅ +5.1%
Brotli_Q64740.238
6.8 MB/s		0.030
54.6 MB/s		29.40%-50.2%✅ +51.7%✅ +46.5%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_default3,1001.725
13.5 MB/s		0.134
173.3 MB/s		13.30%———
Zstd_L32,7540.117
199.7 MB/s		0.038
618.0 MB/s		11.81%-12.6%-1378.0%-256.5%
Zstd_L3_disjoint_window_dict19,1390.181
128.8 MB/s		0.053
442.9 MB/s		82.10%✅ +83.8%-853.1%-155.5%
Gzip_L62,6600.327
71.3 MB/s		0.060
386.0 MB/s		11.41%-16.5%-427.7%-122.7%
Brotli_Q62,3950.776
30.0 MB/s		0.099
235.9 MB/s		10.27%-29.4%-122.3%-36.1%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_default3,7050.385
21.3 MB/s		0.050
165.3 MB/s		45.13%———
Zstd_L32,4550.090
90.9 MB/s		0.019
434.3 MB/s		29.90%-50.9%-325.9%-162.8%
Zstd_L3_disjoint_window_dict18,8520.149
55.0 MB/s		0.031
268.8 MB/s		229.62%✅ +80.3%-157.5%-62.7%
Gzip_L62,3400.163
50.4 MB/s		0.042
195.2 MB/s		28.50%-58.3%-136.0%-18.1%
Brotli_Q62,1580.470
17.5 MB/s		0.078
105.7 MB/s		26.29%-71.7%✅ +18.2%✅ +36.0%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_default1,9600.550
8.2 MB/s		0.054
83.2 MB/s		43.54%———
Zstd_L31,5650.071
63.6 MB/s		0.014
333.4 MB/s		34.76%-25.2%-676.9%-300.8%
Zstd_L3_disjoint_window_dict17,8960.126
35.9 MB/s		0.024
186.9 MB/s		397.51%✅ +89.0%-338.2%-124.8%
Gzip_L61,4800.095
47.4 MB/s		0.026
171.1 MB/s		32.87%-32.4%-478.8%-105.7%
Brotli_Q61,3780.317
14.2 MB/s		0.048
94.0 MB/s		30.61%-42.2%-73.3%-13.0%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_default1,7574.590
114.2 MB/s		1.499
349.8 MB/s		0.34%———
Zstd_L38,1481.018
514.9 MB/s		0.395
1328.9 MB/s		1.55%✅ +78.4%-350.8%-279.9%
Zstd_L3_disjoint_window_dict24,5650.761
688.8 MB/s		0.399
1314.3 MB/s		4.69%✅ +92.8%-503.0%-275.8%
Gzip_L615,4592.606
201.2 MB/s		0.427
1228.5 MB/s		2.95%✅ +88.6%-76.1%-251.2%
Brotli_Q68,12511.742
44.7 MB/s		0.615
852.8 MB/s		1.55%✅ +78.4%✅ +60.9%-143.8%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_default1,8250.527
9.4 MB/s		0.046
107.9 MB/s		36.91%———
Zstd_L31,3850.069
71.6 MB/s		0.014
363.1 MB/s		28.01%-31.8%-663.0%-236.5%
Zstd_L3_disjoint_window_dict17,7430.121
40.7 MB/s		0.024
207.3 MB/s		358.81%✅ +89.7%-333.8%-92.1%
Gzip_L61,3050.097
50.9 MB/s		0.026
190.4 MB/s		26.39%-39.8%-442.5%-76.5%
Brotli_Q61,2080.304
16.3 MB/s		0.046
107.6 MB/s		24.43%-51.1%-73.2%✅ +0.3%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_default1,0640.152
11.0 MB/s		0.017
99.2 MB/s		63.90%———
Zstd_L39010.054
31.0 MB/s		0.008
207.1 MB/s		54.11%-18.1%-182.7%-108.7%
Zstd_L3_disjoint_window_dict17,2820.098
16.9 MB/s		0.017
99.7 MB/s		1037.96%✅ +93.8%-54.3%-0.5%
Gzip_L69050.052
32.1 MB/s		0.016
104.6 MB/s		54.35%-17.6%-192.3%-5.4%
Brotli_Q68510.226
7.4 MB/s		0.031
53.9 MB/s		51.11%-25.0%✅ +32.8%✅ +45.7%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_default37,0569.794
53.5 MB/s		1.668
314.3 MB/s		7.07%———
Zstd_L356,1011.346
389.6 MB/s		0.618
848.5 MB/s		10.70%✅ +33.9%-627.9%-170.0%
Zstd_L3_disjoint_window_dict72,7151.783
293.9 MB/s		0.625
838.3 MB/s		13.87%✅ +49.0%-449.2%-166.8%
Gzip_L651,2117.514
69.8 MB/s		0.859
610.5 MB/s		9.77%✅ +27.6%-30.3%-94.3%
Brotli_Q645,27615.107
34.7 MB/s		1.043
502.7 MB/s		8.64%✅ +18.2%✅ +35.2%-60.0%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_default38,1038.479
61.8 MB/s		1.458
359.6 MB/s		7.27%———
Zstd_L356,5001.632
321.3 MB/s		0.539
973.3 MB/s		10.78%✅ +32.6%-419.6%-170.7%
Zstd_L3_disjoint_window_dict73,0851.493
351.2 MB/s		0.573
914.2 MB/s		13.94%✅ +47.9%-468.1%-154.3%
Gzip_L651,7606.790
77.2 MB/s		0.755
694.1 MB/s		9.87%✅ +26.4%-24.9%-93.1%
Brotli_Q645,75413.690
38.3 MB/s		0.982
533.6 MB/s		8.73%✅ +16.7%✅ +38.1%-48.4%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_default81,59815.871
33.0 MB/s		1.289
406.4 MB/s		15.58%———
Zstd_L374,9781.586
330.2 MB/s		0.657
797.3 MB/s		14.32%-8.8%-900.5%-96.2%
Zstd_L3_disjoint_window_dict91,4942.379
220.2 MB/s		0.600
873.4 MB/s		17.47%✅ +10.8%-567.1%-114.9%
Gzip_L682,9279.850
53.2 MB/s		1.214
431.4 MB/s		15.83%✅ +1.6%-61.1%-6.2%
Brotli_Q668,87317.947
29.2 MB/s		1.563
335.1 MB/s		13.15%-18.5%✅ +11.6%✅ +17.5%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_default75,23813.326
39.3 MB/s		1.543
339.5 MB/s		14.37%———
Zstd_L370,8421.621
323.1 MB/s		0.568
922.1 MB/s		13.53%-6.2%-722.2%-171.6%
Zstd_L3_disjoint_window_dict86,9872.276
230.1 MB/s		0.580
902.5 MB/s		16.61%✅ +13.5%-485.6%-165.8%
Gzip_L677,7419.451
55.4 MB/s		1.139
459.9 MB/s		14.84%✅ +3.2%-41.0%-35.5%
Brotli_Q665,43117.294
30.3 MB/s		1.669
313.8 MB/s		12.49%-15.0%✅ +22.9%✅ +7.6%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_default71,61112.460
41.8 MB/s		1.433
363.2 MB/s		13.76%———
Zstd_L368,0861.479
352.0 MB/s		0.547
951.7 MB/s		13.08%-5.2%-742.5%-162.0%
Zstd_L3_disjoint_window_dict84,5222.132
244.1 MB/s		0.566
920.4 MB/s		16.24%✅ +15.3%-484.4%-153.4%
Gzip_L675,8739.246
56.3 MB/s		1.108
470.0 MB/s		14.58%✅ +5.6%-34.8%-29.4%
Brotli_Q662,02817.020
30.6 MB/s		1.393
373.8 MB/s		11.92%-15.4%✅ +26.8%-2.9%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_default76,43114.142
37.0 MB/s		1.523
344.0 MB/s		14.59%———
Zstd_L371,2241.948
269.0 MB/s		0.549
954.9 MB/s		13.60%-7.3%-626.1%-177.6%
Zstd_L3_disjoint_window_dict87,6842.588
202.4 MB/s		0.567
924.2 MB/s		16.74%✅ +12.8%-446.4%-168.6%
Gzip_L680,4839.498
55.2 MB/s		1.159
451.9 MB/s		15.36%✅ +5.0%-48.9%-31.4%
Brotli_Q665,63617.655
29.7 MB/s		1.504
348.2 MB/s		12.53%-16.4%✅ +19.9%-1.2%

Hybrid / default

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_default42,9375.673
92.4 MB/s		1.088
481.6 MB/s		8.19%———
Zstd_L350,1551.336
392.2 MB/s		0.598
876.7 MB/s		9.57%✅ +14.4%-324.5%-82.0%
Zstd_L3_disjoint_window_dict66,8671.535
341.5 MB/s		0.710
738.2 MB/s		12.76%✅ +35.8%-269.6%-53.3%
Gzip_L650,1748.410
62.3 MB/s		0.970
540.3 MB/s		9.57%✅ +14.4%✅ +32.5%-12.2%
Brotli_Q643,32115.928
32.9 MB/s		1.228
426.8 MB/s		8.26%✅ +0.9%✅ +64.4%✅ +11.4%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_default17,9582.432
98.6 MB/s		0.518
462.6 MB/s		7.49%———
Zstd_L318,6500.523
458.0 MB/s		0.240
1000.1 MB/s		7.78%✅ +3.7%-364.6%-116.2%
Zstd_L3_disjoint_window_dict34,9320.645
371.8 MB/s		0.268
893.4 MB/s		14.57%✅ +48.6%-277.1%-93.1%
Gzip_L618,4622.702
88.7 MB/s		0.358
670.7 MB/s		7.70%✅ +2.7%✅ +10.0%-45.0%
Brotli_Q615,2704.961
48.3 MB/s		0.480
499.8 MB/s		6.37%-17.6%✅ +51.0%-8.1%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_default24,2324.862
107.8 MB/s		1.321
396.9 MB/s		4.62%———
Zstd_L323,4370.749
699.4 MB/s		0.468
1119.9 MB/s		4.47%-3.4%-548.7%-182.2%
Zstd_L3_disjoint_window_dict39,7450.888
590.2 MB/s		0.452
1160.8 MB/s		7.58%✅ +39.0%-447.4%-192.4%
Gzip_L625,7064.067
128.9 MB/s		0.590
888.0 MB/s		4.90%✅ +5.7%-19.5%-123.7%
Brotli_Q618,88811.589
45.2 MB/s		0.734
713.7 MB/s		3.60%-28.3%✅ +58.1%-79.8%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_default9,2573.860
135.8 MB/s		0.833
629.7 MB/s		1.77%———
Zstd_L321,8080.879
596.7 MB/s		0.422
1240.9 MB/s		4.16%✅ +57.6%-339.3%-97.1%
Zstd_L3_disjoint_window_dict38,0140.843
622.2 MB/s		0.421
1246.0 MB/s		7.25%✅ +75.6%-358.0%-97.9%
Gzip_L619,5023.764
139.3 MB/s		0.475
1104.5 MB/s		3.72%✅ +52.5%-2.5%-75.4%
Brotli_Q615,75711.639
45.0 MB/s		0.655
800.1 MB/s		3.01%✅ +41.3%✅ +66.8%-27.1%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_default42,6813.726
140.7 MB/s		0.738
710.2 MB/s		8.14%———
Zstd_L345,5571.195
438.8 MB/s		0.442
1184.8 MB/s		8.69%✅ +6.3%-211.9%-66.8%
Zstd_L3_disjoint_window_dict61,8701.642
319.2 MB/s		0.517
1015.0 MB/s		11.80%✅ +31.0%-126.9%-42.9%
Gzip_L648,1955.776
90.8 MB/s		0.814
644.4 MB/s		9.19%✅ +11.4%✅ +35.5%✅ +9.3%
Brotli_Q640,69513.286
39.5 MB/s		1.329
394.5 MB/s		7.76%-4.9%✅ +72.0%✅ +44.5%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_default19,4682.987
175.5 MB/s		0.872
601.0 MB/s		3.71%———
Zstd_L325,2790.826
634.7 MB/s		0.391
1342.3 MB/s		4.82%✅ +23.0%-261.7%-123.3%
Zstd_L3_disjoint_window_dict41,5960.997
525.9 MB/s		0.410
1279.1 MB/s		7.93%✅ +53.2%-199.7%-112.8%
Gzip_L625,6724.331
121.0 MB/s		0.551
951.0 MB/s		4.90%✅ +24.2%✅ +31.0%-58.2%
Brotli_Q623,19911.913
44.0 MB/s		0.724
723.9 MB/s		4.43%✅ +16.1%✅ +74.9%-20.4%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_default22,8384.659
112.5 MB/s		1.279
410.0 MB/s		4.36%———
Zstd_L336,7511.142
459.0 MB/s		0.480
1091.6 MB/s		7.01%✅ +37.9%-307.9%-166.2%
Zstd_L3_disjoint_window_dict53,5571.242
422.2 MB/s		0.519
1010.5 MB/s		10.22%✅ +57.4%-275.3%-146.4%
Gzip_L635,5226.029
87.0 MB/s		0.635
825.0 MB/s		6.78%✅ +35.7%✅ +22.7%-101.2%
Brotli_Q630,68614.005
37.4 MB/s		0.951
551.5 MB/s		5.85%✅ +25.6%✅ +66.7%-34.5%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_default41,4864.800
109.2 MB/s		1.250
419.4 MB/s		7.91%———
Zstd_L347,7101.200
436.7 MB/s		0.531
986.4 MB/s		9.10%✅ +13.0%-299.9%-135.2%
Zstd_L3_disjoint_window_dict64,1811.627
322.2 MB/s		0.604
868.0 MB/s		12.24%✅ +35.4%-195.0%-107.0%
Gzip_L650,6287.324
71.6 MB/s		0.825
635.7 MB/s		9.66%✅ +18.1%✅ +34.5%-51.6%
Brotli_Q640,47214.567
36.0 MB/s		1.128
464.9 MB/s		7.72%-2.5%✅ +67.0%-10.8%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_default17,5723.631
144.4 MB/s		0.951
551.5 MB/s		3.35%———
Zstd_L320,3400.672
780.4 MB/s		0.383
1369.5 MB/s		3.88%✅ +13.6%-440.5%-148.3%
Zstd_L3_disjoint_window_dict36,8540.881
595.2 MB/s		0.403
1299.4 MB/s		7.03%✅ +52.3%-312.3%-135.6%
Gzip_L622,8163.900
134.4 MB/s		0.526
996.5 MB/s		4.35%✅ +23.0%✅ +6.9%-80.7%
Brotli_Q615,23110.396
50.4 MB/s		0.791
662.9 MB/s		2.91%-15.4%✅ +65.1%-20.2%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_default33,6394.329
121.1 MB/s		1.170
448.0 MB/s		6.42%———
Zstd_L337,1131.180
444.0 MB/s		0.524
999.6 MB/s		7.08%✅ +9.4%-266.7%-123.1%
Zstd_L3_disjoint_window_dict53,6681.306
401.2 MB/s		0.596
880.0 MB/s		10.24%✅ +37.3%-231.4%-96.4%
Gzip_L642,1147.570
69.2 MB/s		0.851
615.7 MB/s		8.03%✅ +20.1%✅ +42.8%-37.4%
Brotli_Q631,18214.526
36.1 MB/s		1.008
519.7 MB/s		5.95%-7.9%✅ +70.2%-16.0%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_default22,9994.154
126.2 MB/s		0.784
668.4 MB/s		4.39%———
Zstd_L333,1020.954
549.6 MB/s		0.508
1031.5 MB/s		6.31%✅ +30.5%-335.5%-54.3%
Zstd_L3_disjoint_window_dict49,2731.119
468.3 MB/s		0.511
1026.0 MB/s		9.40%✅ +53.3%-271.1%-53.5%
Gzip_L637,0154.926
106.4 MB/s		0.696
753.7 MB/s		7.06%✅ +37.9%✅ +15.7%-12.8%
Brotli_Q626,06211.631
45.1 MB/s		0.857
612.0 MB/s		4.97%✅ +11.8%✅ +64.3%✅ +8.4%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_default44,2074.643
112.9 MB/s		1.474
355.7 MB/s		8.43%———
Zstd_L354,8241.718
305.1 MB/s		0.681
770.0 MB/s		10.46%✅ +19.4%-170.2%-116.5%
Zstd_L3_disjoint_window_dict71,0401.838
285.2 MB/s		0.648
809.2 MB/s		13.55%✅ +37.8%-152.6%-127.5%
Gzip_L699,45712.688
41.3 MB/s		1.509
347.5 MB/s		18.97%✅ +55.6%✅ +63.4%✅ +2.3%
Brotli_Q645,18914.937
35.1 MB/s		1.198
437.7 MB/s		8.62%✅ +2.2%✅ +68.9%-23.0%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_default45,4308.225
63.7 MB/s		0.538
973.7 MB/s		8.67%———
Zstd_L347,0751.228
426.9 MB/s		0.601
872.6 MB/s		8.98%✅ +3.5%-569.7%✅ +10.4%
Zstd_L3_disjoint_window_dict63,5301.569
334.1 MB/s		0.622
842.5 MB/s		12.12%✅ +28.5%-424.2%✅ +13.5%
Gzip_L642,9957.050
74.4 MB/s		0.800
655.6 MB/s		8.20%-5.7%-16.7%✅ +32.7%
Brotli_Q636,90815.147
34.6 MB/s		1.091
480.4 MB/s		7.04%-23.1%✅ +45.7%✅ +50.7%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_default27,6196.312
83.1 MB/s		1.761
297.7 MB/s		5.27%———
Zstd_L335,0451.002
523.0 MB/s		0.482
1088.6 MB/s		6.69%✅ +21.2%-529.7%-265.7%
Zstd_L3_disjoint_window_dict51,4511.205
435.0 MB/s		0.501
1045.9 MB/s		9.81%✅ +46.3%-423.8%-251.4%
Gzip_L634,3095.343
98.1 MB/s		0.736
712.1 MB/s		6.54%✅ +19.5%-18.1%-139.2%
Brotli_Q628,93312.914
40.6 MB/s		1.097
478.0 MB/s		5.52%✅ +4.5%✅ +51.1%-60.6%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_default18,2509.695
54.1 MB/s		1.878
279.2 MB/s		3.48%———
Zstd_L335,5413.002
174.6 MB/s		1.270
412.8 MB/s		6.78%✅ +48.7%-222.9%-47.9%
Zstd_L3_disjoint_window_dict52,1232.630
199.3 MB/s		1.265
414.4 MB/s		9.94%✅ +65.0%-268.6%-48.4%
Gzip_L633,45015.706
33.4 MB/s		1.157
452.9 MB/s		6.38%✅ +45.4%✅ +38.3%-62.2%
Brotli_Q627,10438.278
13.7 MB/s		1.968
266.3 MB/s		5.17%✅ +32.7%✅ +74.7%✅ +4.6%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_default27,8057.232
72.5 MB/s		1.642
319.3 MB/s		5.30%———
Zstd_L332,2911.999
262.2 MB/s		0.847
618.9 MB/s		6.16%✅ +13.9%-261.8%-93.8%
Zstd_L3_disjoint_window_dict48,8361.957
267.9 MB/s		0.837
626.0 MB/s		9.32%✅ +43.1%-269.5%-96.1%
Gzip_L627,5828.609
60.9 MB/s		0.995
526.7 MB/s		5.26%-0.8%✅ +16.0%-64.9%
Brotli_Q625,46416.265
32.2 MB/s		1.645
318.8 MB/s		4.86%-9.2%✅ +55.5%✅ +0.2%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_default6840.296
10.7 MB/s		0.013
238.7 MB/s		21.53%———
Zstd_L36680.072
43.8 MB/s		0.014
222.9 MB/s		21.03%-2.4%-307.9%✅ +6.6%
Zstd_L3_disjoint_window_dict17,0070.126
25.2 MB/s		0.023
140.6 MB/s		535.32%✅ +96.0%-134.1%✅ +41.1%
Gzip_L66340.067
47.1 MB/s		0.021
151.3 MB/s		19.96%-7.9%-338.6%✅ +36.6%
Brotli_Q65920.268
11.9 MB/s		0.038
83.1 MB/s		18.63%-15.5%-10.4%✅ +65.2%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_default5720.080
20.1 MB/s		0.009
177.8 MB/s		35.48%———
Zstd_L35450.062
25.9 MB/s		0.009
186.2 MB/s		33.81%-5.0%-29.2%-4.7%
Zstd_L3_disjoint_window_dict16,9080.120
13.4 MB/s		0.020
81.7 MB/s		1048.88%✅ +96.6%✅ +33.2%✅ +54.0%
Gzip_L65410.055
29.1 MB/s		0.017
96.8 MB/s		33.56%-5.7%-44.9%✅ +45.6%
Brotli_Q64740.238
6.8 MB/s		0.030
54.6 MB/s		29.40%-20.7%✅ +66.2%✅ +69.3%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_default2,8291.584
14.7 MB/s		0.038
608.7 MB/s		12.14%———
Zstd_L32,7540.117
199.7 MB/s		0.038
618.0 MB/s		11.81%-2.7%-1257.0%-1.5%
Zstd_L3_disjoint_window_dict19,1390.181
128.8 MB/s		0.053
442.9 MB/s		82.10%✅ +85.2%-775.1%✅ +27.2%
Gzip_L62,6600.327
71.3 MB/s		0.060
386.0 MB/s		11.41%-6.4%-384.5%✅ +36.6%
Brotli_Q62,3950.776
30.0 MB/s		0.099
235.9 MB/s		10.27%-18.1%-104.1%✅ +61.2%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_default2,6630.325
25.2 MB/s		0.018
445.9 MB/s		32.44%———
Zstd_L32,4550.090
90.9 MB/s		0.019
434.3 MB/s		29.90%-8.5%-259.9%✅ +2.6%
Zstd_L3_disjoint_window_dict18,8520.149
55.0 MB/s		0.031
268.8 MB/s		229.62%✅ +85.9%-117.7%✅ +39.7%
Gzip_L62,3400.163
50.4 MB/s		0.042
195.2 MB/s		28.50%-13.8%-99.5%✅ +56.2%
Brotli_Q62,1580.470
17.5 MB/s		0.078
105.7 MB/s		26.29%-23.4%✅ +30.9%✅ +76.3%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_default1,6450.393
11.5 MB/s		0.014
318.8 MB/s		36.54%———
Zstd_L31,5650.071
63.6 MB/s		0.014
333.4 MB/s		34.76%-5.1%-454.5%-4.6%
Zstd_L3_disjoint_window_dict17,8960.126
35.9 MB/s		0.024
186.9 MB/s		397.51%✅ +90.8%-212.7%✅ +41.4%
Gzip_L61,4800.095
47.4 MB/s		0.026
171.1 MB/s		32.87%-11.1%-313.1%✅ +46.3%
Brotli_Q61,3780.317
14.2 MB/s		0.048
94.0 MB/s		30.61%-19.4%-23.7%✅ +70.5%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_default1,4584.664
112.4 MB/s		1.414
370.8 MB/s		0.28%———
Zstd_L38,1481.018
514.9 MB/s		0.395
1328.9 MB/s		1.55%✅ +82.1%-358.0%-258.3%
Zstd_L3_disjoint_window_dict24,5650.761
688.8 MB/s		0.399
1314.3 MB/s		4.69%✅ +94.1%-512.7%-254.4%
Gzip_L615,4592.606
201.2 MB/s		0.427
1228.5 MB/s		2.95%✅ +90.6%-79.0%-231.3%
Brotli_Q68,12511.742
44.7 MB/s		0.615
852.8 MB/s		1.55%✅ +82.1%✅ +60.3%-130.0%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_default1,4670.374
13.2 MB/s		0.015
339.7 MB/s		29.67%———
Zstd_L31,3850.069
71.6 MB/s		0.014
363.1 MB/s		28.01%-5.9%-441.4%-6.9%
Zstd_L3_disjoint_window_dict17,7430.121
40.7 MB/s		0.024
207.3 MB/s		358.81%✅ +91.7%-207.8%✅ +39.0%
Gzip_L61,3050.097
50.9 MB/s		0.026
190.4 MB/s		26.39%-12.4%-284.9%✅ +43.9%
Brotli_Q61,2080.304
16.3 MB/s		0.046
107.6 MB/s		24.43%-21.4%-22.9%✅ +68.3%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_default9410.060
27.8 MB/s		0.009
178.3 MB/s		56.52%———
Zstd_L39010.054
31.0 MB/s		0.008
207.1 MB/s		54.11%-4.4%-11.6%-16.2%
Zstd_L3_disjoint_window_dict17,2820.098
16.9 MB/s		0.017
99.7 MB/s		1037.96%✅ +94.6%✅ +39.1%✅ +44.1%
Gzip_L69050.052
32.1 MB/s		0.016
104.6 MB/s		54.35%-4.0%-15.4%✅ +41.3%
Brotli_Q68510.226
7.4 MB/s		0.031
53.9 MB/s		51.11%-10.6%✅ +73.5%✅ +69.8%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_default37,7577.167
73.2 MB/s		1.471
356.5 MB/s		7.20%———
Zstd_L356,1011.346
389.6 MB/s		0.618
848.5 MB/s		10.70%✅ +32.7%-432.6%-138.0%
Zstd_L3_disjoint_window_dict72,7151.783
293.9 MB/s		0.625
838.3 MB/s		13.87%✅ +48.1%-301.8%-135.2%
Gzip_L651,2117.514
69.8 MB/s		0.859
610.5 MB/s		9.77%✅ +26.3%✅ +4.6%-71.3%
Brotli_Q645,27615.107
34.7 MB/s		1.043
502.7 MB/s		8.64%✅ +16.6%✅ +52.6%-41.0%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_default39,0806.632
79.0 MB/s		1.094
479.2 MB/s		7.45%———
Zstd_L356,5001.632
321.3 MB/s		0.539
973.3 MB/s		10.78%✅ +30.8%-306.4%-103.1%
Zstd_L3_disjoint_window_dict73,0851.493
351.2 MB/s		0.573
914.2 MB/s		13.94%✅ +46.5%-344.3%-90.8%
Gzip_L651,7606.790
77.2 MB/s		0.755
694.1 MB/s		9.87%✅ +24.5%✅ +2.3%-44.9%
Brotli_Q645,75413.690
38.3 MB/s		0.982
533.6 MB/s		8.73%✅ +14.6%✅ +51.6%-11.4%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_default78,89711.688
44.8 MB/s		0.525
997.2 MB/s		15.06%———
Zstd_L374,9781.586
330.2 MB/s		0.657
797.3 MB/s		14.32%-5.2%-636.8%✅ +20.0%
Zstd_L3_disjoint_window_dict91,4942.379
220.2 MB/s		0.600
873.4 MB/s		17.47%✅ +13.8%-391.3%✅ +12.4%
Gzip_L682,9279.850
53.2 MB/s		1.214
431.4 MB/s		15.83%✅ +4.9%-18.7%✅ +56.7%
Brotli_Q668,87317.947
29.2 MB/s		1.563
335.1 MB/s		13.15%-14.6%✅ +34.9%✅ +66.4%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_default72,6655.982
87.5 MB/s		0.823
636.7 MB/s		13.87%———
Zstd_L370,8421.621
323.1 MB/s		0.568
922.1 MB/s		13.53%-2.6%-269.1%-44.8%
Zstd_L3_disjoint_window_dict86,9872.276
230.1 MB/s		0.580
902.5 MB/s		16.61%✅ +16.5%-162.9%-41.8%
Gzip_L677,7419.451
55.4 MB/s		1.139
459.9 MB/s		14.84%✅ +6.5%✅ +36.7%✅ +27.8%
Brotli_Q665,43117.294
30.3 MB/s		1.669
313.8 MB/s		12.49%-11.1%✅ +65.4%✅ +50.7%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_default71,10711.213
46.4 MB/s		0.492
1058.2 MB/s		13.66%———
Zstd_L368,0861.479
352.0 MB/s		0.547
951.7 MB/s		13.08%-4.4%-658.2%✅ +10.1%
Zstd_L3_disjoint_window_dict84,5222.132
244.1 MB/s		0.566
920.4 MB/s		16.24%✅ +15.9%-425.9%✅ +13.0%
Gzip_L675,8739.246
56.3 MB/s		1.108
470.0 MB/s		14.58%✅ +6.3%-21.3%✅ +55.6%
Brotli_Q662,02817.020
30.6 MB/s		1.393
373.8 MB/s		11.92%-14.6%✅ +34.1%✅ +64.7%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_default74,14312.585
41.6 MB/s		0.490
1069.2 MB/s		14.15%———
Zstd_L371,2241.948
269.0 MB/s		0.549
954.9 MB/s		13.60%-4.1%-546.2%✅ +10.7%
Zstd_L3_disjoint_window_dict87,6842.588
202.4 MB/s		0.567
924.2 MB/s		16.74%✅ +15.4%-386.3%✅ +13.6%
Gzip_L680,4839.498
55.2 MB/s		1.159
451.9 MB/s		15.36%✅ +7.9%-32.5%✅ +57.7%
Brotli_Q665,63617.655
29.7 MB/s		1.504
348.2 MB/s		12.53%-13.0%✅ +28.7%✅ +67.4%

Native / fast

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_fast72,4225.329
98.4 MB/s		1.142
459.2 MB/s		13.82%———
Zstd_L149,6811.326
395.2 MB/s		0.557
940.7 MB/s		9.48%-45.8%-301.7%-104.9%
Zstd_L1_disjoint_window_dict66,8701.275
411.2 MB/s		0.809
648.2 MB/s		12.76%-8.3%-318.0%-41.2%
Gzip_L177,3061.845
284.1 MB/s		1.252
418.7 MB/s		14.75%✅ +6.3%-188.8%✅ +8.8%
Brotli_Q154,2512.164
242.3 MB/s		2.029
258.4 MB/s		10.35%-33.5%-146.3%✅ +43.7%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_fast27,6172.251
106.5 MB/s		0.412
581.8 MB/s		11.52%———
Zstd_L118,4570.423
566.4 MB/s		0.235
1020.1 MB/s		7.70%-49.6%-431.7%-75.3%
Zstd_L1_disjoint_window_dict35,0650.495
484.5 MB/s		0.253
945.9 MB/s		14.62%✅ +21.2%-354.8%-62.6%
Gzip_L125,7020.643
372.6 MB/s		0.428
560.0 MB/s		10.72%-7.5%-249.8%✅ +3.8%
Brotli_Q120,2861.027
233.4 MB/s		0.848
282.8 MB/s		8.46%-36.1%-119.1%✅ +51.4%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_fast35,9643.202
163.7 MB/s		0.648
809.3 MB/s		6.86%———
Zstd_L123,6461.021
513.5 MB/s		0.457
1145.8 MB/s		4.51%-52.1%-213.7%-41.6%
Zstd_L1_disjoint_window_dict40,2770.778
674.1 MB/s		0.447
1173.4 MB/s		7.68%✅ +10.7%-311.8%-45.0%
Gzip_L145,1911.340
391.2 MB/s		0.814
643.7 MB/s		8.62%✅ +20.4%-139.0%✅ +20.5%
Brotli_Q126,7491.261
415.8 MB/s		0.994
527.4 MB/s		5.10%-34.4%-154.0%✅ +34.8%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_fast34,7743.119
168.1 MB/s		0.650
806.0 MB/s		6.63%———
Zstd_L122,1480.761
688.5 MB/s		0.459
1142.1 MB/s		4.22%-57.0%-309.6%-41.7%
Zstd_L1_disjoint_window_dict37,8220.724
724.1 MB/s		0.484
1084.3 MB/s		7.21%✅ +8.1%-330.7%-34.5%
Gzip_L130,8100.765
685.5 MB/s		0.598
877.0 MB/s		5.88%-12.9%-307.8%-8.8%
Brotli_Q124,9431.263
415.1 MB/s		0.879
596.3 MB/s		4.76%-39.4%-146.9%✅ +26.0%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_fast59,8554.228
124.0 MB/s		0.839
625.0 MB/s		11.42%———
Zstd_L143,0811.096
478.3 MB/s		0.438
1195.9 MB/s		8.22%-38.9%-285.8%-91.3%
Zstd_L1_disjoint_window_dict61,0310.989
530.1 MB/s		0.477
1099.0 MB/s		11.64%✅ +1.9%-327.5%-75.8%
Gzip_L169,6071.583
331.1 MB/s		0.931
563.1 MB/s		13.28%✅ +14.0%-167.0%✅ +9.9%
Brotli_Q149,7291.808
290.0 MB/s		1.358
386.1 MB/s		9.49%-20.4%-133.8%✅ +38.2%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_fast35,0203.402
154.1 MB/s		0.608
862.9 MB/s		6.68%———
Zstd_L123,5730.927
565.6 MB/s		0.409
1280.3 MB/s		4.50%-48.6%-267.0%-48.4%
Zstd_L1_disjoint_window_dict41,0740.741
707.8 MB/s		0.403
1302.3 MB/s		7.84%✅ +14.7%-359.3%-50.9%
Gzip_L131,5050.867
604.7 MB/s		0.616
851.1 MB/s		6.01%-11.2%-292.4%✅ +1.4%
Brotli_Q125,8901.363
384.6 MB/s		0.967
542.2 MB/s		4.94%-35.3%-149.6%✅ +37.2%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_fast58,5563.930
133.4 MB/s		0.913
574.4 MB/s		11.17%———
Zstd_L132,8801.109
472.9 MB/s		0.586
895.4 MB/s		6.27%-78.1%-254.5%-55.9%
Zstd_L1_disjoint_window_dict52,2870.971
540.1 MB/s		0.571
918.0 MB/s		9.97%-12.0%-304.9%-59.8%
Gzip_L148,5381.162
451.3 MB/s		0.841
623.0 MB/s		9.26%-20.6%-238.3%-8.5%
Brotli_Q140,2101.672
313.5 MB/s		1.475
355.4 MB/s		7.67%-45.6%-135.0%✅ +38.1%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_fast71,6905.030
104.2 MB/s		1.100
476.6 MB/s		13.68%———
Zstd_L147,5671.220
429.7 MB/s		0.489
1072.9 MB/s		9.07%-50.7%-312.3%-125.1%
Zstd_L1_disjoint_window_dict65,0401.230
426.3 MB/s		0.615
852.7 MB/s		12.41%-10.2%-309.0%-78.9%
Gzip_L169,1661.673
313.3 MB/s		1.005
521.7 MB/s		13.19%-3.6%-200.6%-9.5%
Brotli_Q151,5962.008
261.1 MB/s		1.569
334.0 MB/s		9.84%-38.9%-150.5%✅ +29.9%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_fast33,9193.250
161.3 MB/s		0.576
910.4 MB/s		6.47%———
Zstd_L119,7290.915
573.2 MB/s		0.386
1359.4 MB/s		3.76%-71.9%-255.3%-49.3%
Zstd_L1_disjoint_window_dict37,1130.752
697.4 MB/s		0.407
1287.4 MB/s		7.08%✅ +8.6%-332.3%-41.4%
Gzip_L132,8170.942
556.6 MB/s		0.623
841.7 MB/s		6.26%-3.4%-245.0%✅ +7.6%
Brotli_Q121,5461.529
342.8 MB/s		0.944
555.4 MB/s		4.11%-57.4%-112.5%✅ +39.0%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_fast43,5033.752
139.7 MB/s		1.864
281.2 MB/s		8.30%———
Zstd_L134,7881.165
450.1 MB/s		0.548
956.4 MB/s		6.64%-25.1%-222.2%-240.0%
Zstd_L1_disjoint_window_dict53,2491.124
466.4 MB/s		0.543
966.0 MB/s		10.16%✅ +18.3%-233.9%-243.5%
Gzip_L161,0881.885
278.0 MB/s		1.014
517.0 MB/s		11.65%✅ +28.8%-99.0%-83.8%
Brotli_Q145,5341.813
289.1 MB/s		1.449
361.8 MB/s		8.69%✅ +4.5%-107.0%-28.7%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_fast51,4723.809
137.6 MB/s		0.805
651.4 MB/s		9.82%———
Zstd_L132,8670.780
672.0 MB/s		0.487
1077.4 MB/s		6.27%-56.6%-388.2%-65.4%
Zstd_L1_disjoint_window_dict49,5290.919
570.2 MB/s		0.517
1014.3 MB/s		9.45%-3.9%-314.3%-55.7%
Gzip_L173,3721.733
302.5 MB/s		1.067
491.5 MB/s		14.00%✅ +29.8%-119.8%✅ +24.6%
Brotli_Q139,4141.387
377.9 MB/s		1.098
477.6 MB/s		7.52%-30.6%-174.6%✅ +26.7%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_fast122,1726.849
76.5 MB/s		1.743
300.8 MB/s		23.30%———
Zstd_L158,0801.498
350.0 MB/s		0.680
771.5 MB/s		11.08%-110.4%-357.3%-156.5%
Zstd_L1_disjoint_window_dict80,3661.552
337.7 MB/s		0.632
829.4 MB/s		15.33%-52.0%-341.2%-175.7%
Gzip_L1142,8793.170
165.4 MB/s		1.929
271.7 MB/s		27.25%✅ +14.5%-116.1%✅ +9.7%
Brotli_Q171,6482.243
233.7 MB/s		1.772
295.9 MB/s		13.67%-70.5%-205.3%✅ +1.6%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_fast69,1774.954
105.8 MB/s		1.137
461.2 MB/s		13.20%———
Zstd_L145,4071.365
384.1 MB/s		0.574
914.1 MB/s		8.66%-52.3%-263.0%-98.2%
Zstd_L1_disjoint_window_dict62,7921.191
440.1 MB/s		0.613
855.4 MB/s		11.98%-10.2%-315.8%-85.5%
Gzip_L166,2831.580
331.8 MB/s		1.108
473.2 MB/s		12.64%-4.4%-213.6%-2.6%
Brotli_Q152,6741.878
279.1 MB/s		1.575
333.0 MB/s		10.05%-31.3%-163.7%✅ +27.8%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_fast48,6284.707
111.4 MB/s		0.826
634.3 MB/s		9.28%———
Zstd_L135,2611.155
454.0 MB/s		0.461
1138.0 MB/s		6.73%-37.9%-307.7%-79.4%
Zstd_L1_disjoint_window_dict50,9390.942
556.7 MB/s		0.490
1069.9 MB/s		9.72%✅ +4.5%-399.9%-68.7%
Gzip_L149,8211.349
388.7 MB/s		0.891
588.4 MB/s		9.50%✅ +2.4%-249.1%✅ +7.2%
Brotli_Q137,4851.671
313.8 MB/s		1.301
402.8 MB/s		7.15%-29.7%-181.8%✅ +36.5%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_fast25,5996.757
77.6 MB/s		2.903
180.6 MB/s		4.88%———
Zstd_L132,3262.269
231.0 MB/s		1.464
358.1 MB/s		6.17%✅ +20.8%-197.8%-98.3%
Zstd_L1_disjoint_window_dict50,6441.864
281.2 MB/s		1.520
344.9 MB/s		9.66%✅ +49.5%-262.5%-91.0%
Gzip_L145,2902.022
259.3 MB/s		1.460
359.1 MB/s		8.64%✅ +43.5%-234.2%-98.9%
Brotli_Q135,4512.625
199.7 MB/s		2.686
195.2 MB/s		6.76%✅ +27.8%-157.4%-8.1%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_fast45,0726.040
86.8 MB/s		1.195
438.6 MB/s		8.60%———
Zstd_L132,0851.726
303.8 MB/s		0.846
620.0 MB/s		6.12%-40.5%-250.0%-41.3%
Zstd_L1_disjoint_window_dict49,6601.823
287.6 MB/s		0.749
700.2 MB/s		9.47%✅ +9.2%-231.4%-59.6%
Gzip_L143,4141.758
298.3 MB/s		1.341
391.0 MB/s		8.28%-3.8%-243.6%✅ +10.9%
Brotli_Q134,8562.641
198.5 MB/s		3.146
166.6 MB/s		6.65%-29.3%-128.7%✅ +62.0%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_fast1,9090.185
17.1 MB/s		0.021
149.4 MB/s		60.09%———
Zstd_L16610.035
90.2 MB/s		0.013
247.4 MB/s		20.81%-188.8%-426.6%-65.6%
Zstd_L1_disjoint_window_dict17,0170.100
31.8 MB/s		0.024
130.9 MB/s		535.63%✅ +88.8%-85.7%✅ +12.4%
Gzip_L16860.048
66.3 MB/s		0.022
141.9 MB/s		21.59%-178.3%-286.6%✅ +5.0%
Brotli_Q16960.055
57.3 MB/s		0.846
3.8 MB/s		21.91%-174.3%-234.3%✅ +97.5%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_fast7120.112
14.5 MB/s		0.015
107.6 MB/s		44.17%———
Zstd_L15490.029
55.9 MB/s		0.009
176.1 MB/s		34.06%-29.7%-287.1%-63.6%
Zstd_L1_disjoint_window_dict16,9090.080
20.0 MB/s		0.019
86.2 MB/s		1048.95%✅ +95.8%-38.6%✅ +19.9%
Gzip_L15600.052
31.1 MB/s		0.017
92.4 MB/s		34.74%-27.1%-115.4%✅ +14.1%
Brotli_Q15670.040
40.4 MB/s		0.749
2.2 MB/s		35.17%-25.6%-179.3%✅ +98.0%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_fast5,3780.728
32.0 MB/s		0.085
272.7 MB/s		23.07%———
Zstd_L12,8060.078
297.5 MB/s		0.038
607.6 MB/s		12.04%-91.7%-829.7%-122.8%
Zstd_L1_disjoint_window_dict19,2330.140
166.3 MB/s		0.055
426.2 MB/s		82.50%✅ +72.0%-419.5%-56.3%
Gzip_L13,4590.116
201.3 MB/s		0.073
319.6 MB/s		14.84%-55.5%-529.0%-17.2%
Brotli_Q13,1370.156
149.6 MB/s		0.778
30.0 MB/s		13.46%-71.4%-367.5%✅ +89.0%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_fast3,7050.352
23.3 MB/s		0.050
164.5 MB/s		45.13%———
Zstd_L12,6400.046
180.4 MB/s		0.018
460.9 MB/s		32.16%-40.3%-673.5%-180.2%
Zstd_L1_disjoint_window_dict18,8810.115
71.2 MB/s		0.031
268.6 MB/s		229.98%✅ +80.4%-205.2%-63.3%
Gzip_L12,8190.085
96.3 MB/s		0.048
172.3 MB/s		34.34%-31.4%-313.1%-4.7%
Brotli_Q12,6430.105
78.2 MB/s		0.718
11.4 MB/s		32.19%-40.2%-235.5%✅ +93.0%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_fast2,1990.214
21.1 MB/s		0.033
137.3 MB/s		48.84%———
Zstd_L11,6220.038
118.1 MB/s		0.014
325.0 MB/s		36.03%-35.6%-460.4%-136.6%
Zstd_L1_disjoint_window_dict17,9410.089
50.4 MB/s		0.023
192.5 MB/s		398.51%✅ +87.7%-139.1%-40.2%
Gzip_L11,6600.057
78.9 MB/s		0.028
158.2 MB/s		36.87%-32.5%-274.5%-15.2%
Brotli_Q11,6360.074
60.5 MB/s		0.654
6.9 MB/s		36.34%-34.4%-186.9%✅ +95.0%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_fast26,3553.097
169.3 MB/s		0.548
957.2 MB/s		5.03%———
Zstd_L18,5130.533
983.6 MB/s		0.407
1287.5 MB/s		1.62%-209.6%-481.1%-34.5%
Zstd_L1_disjoint_window_dict24,0840.570
920.3 MB/s		0.393
1335.2 MB/s		4.59%-9.4%-443.7%-39.5%
Gzip_L119,9640.675
776.2 MB/s		0.499
1050.8 MB/s		3.81%-32.0%-358.6%-9.8%
Brotli_Q112,5141.187
441.7 MB/s		0.863
607.6 MB/s		2.39%-110.6%-161.0%✅ +36.5%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_fast2,4730.232
21.3 MB/s		0.030
163.8 MB/s		50.01%———
Zstd_L11,4440.036
137.1 MB/s		0.014
361.1 MB/s		29.20%-71.3%-543.8%-120.5%
Zstd_L1_disjoint_window_dict17,7770.092
53.5 MB/s		0.024
202.5 MB/s		359.49%✅ +86.1%-151.2%-23.7%
Gzip_L11,5490.060
82.3 MB/s		0.030
167.0 MB/s		31.32%-59.7%-286.5%-2.0%
Brotli_Q11,4970.062
80.1 MB/s		0.615
8.0 MB/s		30.27%-65.2%-276.2%✅ +95.1%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_fast1,0640.125
13.3 MB/s		0.017
100.9 MB/s		63.90%———
Zstd_L19150.024
68.5 MB/s		0.008
205.3 MB/s		54.95%-16.3%-415.6%-103.5%
Zstd_L1_disjoint_window_dict17,2940.068
24.4 MB/s		0.017
98.5 MB/s		1038.68%✅ +93.8%-83.4%✅ +2.4%
Gzip_L19390.037
45.5 MB/s		0.018
90.8 MB/s		56.40%-13.3%-242.4%✅ +10.0%
Brotli_Q19510.037
44.4 MB/s		0.591
2.8 MB/s		57.12%-11.9%-234.7%✅ +97.2%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_fast59,4217.118
73.7 MB/s		2.439
214.9 MB/s		11.33%———
Zstd_L158,7941.500
349.5 MB/s		0.711
737.6 MB/s		11.22%-1.1%-374.6%-243.2%
Zstd_L1_disjoint_window_dict76,7651.533
342.0 MB/s		0.647
809.9 MB/s		14.64%✅ +22.6%-364.4%-276.8%
Gzip_L185,1501.998
262.4 MB/s		1.278
410.2 MB/s		16.24%✅ +30.2%-256.2%-90.8%
Brotli_Q165,8822.022
259.3 MB/s		1.693
309.7 MB/s		12.57%✅ +9.8%-252.1%-44.1%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_fast58,8456.390
82.0 MB/s		2.087
251.2 MB/s		11.23%———
Zstd_L158,8601.537
341.0 MB/s		0.536
977.9 MB/s		11.23%✅ +0.0%-315.7%-289.3%
Zstd_L1_disjoint_window_dict77,4161.383
379.1 MB/s		0.572
917.2 MB/s		14.77%✅ +24.0%-362.1%-265.1%
Gzip_L182,3791.785
293.6 MB/s		1.098
477.3 MB/s		15.71%✅ +28.6%-258.0%-90.0%
Brotli_Q165,4071.858
282.1 MB/s		1.517
345.6 MB/s		12.48%✅ +10.0%-243.9%-37.6%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_fast80,98310.317
50.8 MB/s		1.688
310.2 MB/s		15.46%———
Zstd_L178,8741.266
413.9 MB/s		0.562
931.7 MB/s		15.06%-2.7%-715.2%-200.3%
Zstd_L1_disjoint_window_dict96,9901.551
337.7 MB/s		0.606
864.3 MB/s		18.52%✅ +16.5%-565.3%-178.6%
Gzip_L1117,7492.527
207.2 MB/s		1.629
321.6 MB/s		22.48%✅ +31.2%-308.2%-3.7%
Brotli_Q182,1712.319
225.8 MB/s		1.837
285.1 MB/s		15.69%✅ +1.4%-344.8%✅ +8.1%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_fast75,33810.203
51.3 MB/s		1.521
344.2 MB/s		14.38%———
Zstd_L172,6521.328
394.5 MB/s		0.521
1005.8 MB/s		13.87%-3.7%-668.5%-192.2%
Zstd_L1_disjoint_window_dict90,7551.559
336.0 MB/s		0.575
910.1 MB/s		17.33%✅ +17.0%-554.6%-164.4%
Gzip_L1106,7162.323
225.5 MB/s		1.502
348.8 MB/s		20.38%✅ +29.4%-339.3%-1.3%
Brotli_Q176,6562.214
236.5 MB/s		1.835
285.4 MB/s		14.64%✅ +1.7%-360.8%✅ +17.1%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_fast72,7119.565
54.4 MB/s		1.420
366.5 MB/s		13.97%———
Zstd_L171,0841.506
345.7 MB/s		0.546
954.0 MB/s		13.66%-2.3%-535.2%-160.3%
Zstd_L1_disjoint_window_dict88,4421.455
357.7 MB/s		0.566
920.1 MB/s		16.99%✅ +17.8%-557.3%-151.1%
Gzip_L1111,2802.358
220.7 MB/s		1.527
341.0 MB/s		21.38%✅ +34.7%-305.6%✅ +7.0%
Brotli_Q174,7352.172
239.7 MB/s		1.673
311.2 MB/s		14.36%✅ +2.7%-340.4%✅ +15.1%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_fast79,5789.927
52.8 MB/s		1.639
319.6 MB/s		15.19%———
Zstd_L174,1201.520
344.6 MB/s		0.516
1014.2 MB/s		14.15%-7.4%-553.0%-217.3%
Zstd_L1_disjoint_window_dict92,4391.502
348.8 MB/s		0.578
905.6 MB/s		17.65%✅ +13.9%-560.9%-183.3%
Gzip_L1114,7002.419
216.5 MB/s		1.564
334.9 MB/s		21.90%✅ +30.6%-310.3%-4.8%
Brotli_Q178,9402.220
236.0 MB/s		1.780
294.3 MB/s		15.07%-0.8%-347.2%✅ +7.9%

Hybrid / fast

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_fast49,1066.957
75.3 MB/s		0.669
783.5 MB/s		9.37%———
Zstd_L149,6811.326
395.2 MB/s		0.557
940.7 MB/s		9.48%✅ +1.2%-424.5%-20.1%
Zstd_L1_disjoint_window_dict66,8701.275
411.2 MB/s		0.809
648.2 MB/s		12.76%✅ +26.6%-445.7%✅ +17.3%
Gzip_L177,3061.845
284.1 MB/s		1.252
418.7 MB/s		14.75%✅ +36.5%-277.1%✅ +46.6%
Brotli_Q154,2512.164
242.3 MB/s		2.029
258.4 MB/s		10.35%✅ +9.5%-221.6%✅ +67.0%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_fast18,4803.107
77.2 MB/s		0.221
1084.4 MB/s		7.71%———
Zstd_L118,4570.423
566.4 MB/s		0.235
1020.1 MB/s		7.70%-0.1%-634.0%✅ +5.9%
Zstd_L1_disjoint_window_dict35,0650.495
484.5 MB/s		0.253
945.9 MB/s		14.62%✅ +47.3%-527.8%✅ +12.8%
Gzip_L125,7020.643
372.6 MB/s		0.428
560.0 MB/s		10.72%✅ +28.1%-382.9%✅ +48.4%
Brotli_Q120,2861.027
233.4 MB/s		0.848
282.8 MB/s		8.46%✅ +8.9%-202.5%✅ +73.9%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_fast23,6694.321
121.3 MB/s		0.400
1310.3 MB/s		4.52%———
Zstd_L123,6461.021
513.5 MB/s		0.457
1145.8 MB/s		4.51%-0.1%-323.3%✅ +12.6%
Zstd_L1_disjoint_window_dict40,2770.778
674.1 MB/s		0.447
1173.4 MB/s		7.68%✅ +41.2%-455.7%✅ +10.5%
Gzip_L145,1911.340
391.2 MB/s		0.814
643.7 MB/s		8.62%✅ +47.6%-222.5%✅ +50.9%
Brotli_Q126,7491.261
415.8 MB/s		0.994
527.4 MB/s		5.10%✅ +11.5%-242.7%✅ +59.7%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_fast22,1715.074
103.3 MB/s		0.369
1421.5 MB/s		4.23%———
Zstd_L122,1480.761
688.5 MB/s		0.459
1142.1 MB/s		4.22%-0.1%-566.4%✅ +19.7%
Zstd_L1_disjoint_window_dict37,8220.724
724.1 MB/s		0.484
1084.3 MB/s		7.21%✅ +41.4%-600.8%✅ +23.7%
Gzip_L130,8100.765
685.5 MB/s		0.598
877.0 MB/s		5.88%✅ +28.0%-563.5%✅ +38.3%
Brotli_Q124,9431.263
415.1 MB/s		0.879
596.3 MB/s		4.76%✅ +11.1%-301.7%✅ +58.0%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_fast43,1045.766
90.9 MB/s		0.388
1349.9 MB/s		8.22%———
Zstd_L143,0811.096
478.3 MB/s		0.438
1195.9 MB/s		8.22%-0.1%-426.1%✅ +11.4%
Zstd_L1_disjoint_window_dict61,0310.989
530.1 MB/s		0.477
1099.0 MB/s		11.64%✅ +29.4%-483.0%✅ +18.6%
Gzip_L169,6071.583
331.1 MB/s		0.931
563.1 MB/s		13.28%✅ +38.1%-264.2%✅ +58.3%
Brotli_Q149,7291.808
290.0 MB/s		1.358
386.1 MB/s		9.49%✅ +13.3%-218.9%✅ +71.4%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_fast23,5967.633
68.7 MB/s		0.326
1607.2 MB/s		4.50%———
Zstd_L123,5730.927
565.6 MB/s		0.409
1280.3 MB/s		4.50%-0.1%-723.6%✅ +20.3%
Zstd_L1_disjoint_window_dict41,0740.741
707.8 MB/s		0.403
1302.3 MB/s		7.84%✅ +42.6%-930.6%✅ +19.0%
Gzip_L131,5050.867
604.7 MB/s		0.616
851.1 MB/s		6.01%✅ +25.1%-780.5%✅ +47.0%
Brotli_Q125,8901.363
384.6 MB/s		0.967
542.2 MB/s		4.94%✅ +8.9%-460.0%✅ +66.3%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_fast32,9036.053
86.6 MB/s		0.432
1214.2 MB/s		6.28%———
Zstd_L132,8801.109
472.9 MB/s		0.586
895.4 MB/s		6.27%-0.1%-445.9%✅ +26.3%
Zstd_L1_disjoint_window_dict52,2870.971
540.1 MB/s		0.571
918.0 MB/s		9.97%✅ +37.1%-523.5%✅ +24.4%
Gzip_L148,5381.162
451.3 MB/s		0.841
623.0 MB/s		9.26%✅ +32.2%-421.1%✅ +48.7%
Brotli_Q140,2101.672
313.5 MB/s		1.475
355.4 MB/s		7.67%✅ +18.2%-262.0%✅ +70.7%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_fast47,5906.590
79.5 MB/s		0.483
1086.0 MB/s		9.08%———
Zstd_L147,5671.220
429.7 MB/s		0.489
1072.9 MB/s		9.07%-0.0%-440.2%✅ +1.2%
Zstd_L1_disjoint_window_dict65,0401.230
426.3 MB/s		0.615
852.7 MB/s		12.41%✅ +26.8%-436.0%✅ +21.5%
Gzip_L169,1661.673
313.3 MB/s		1.005
521.7 MB/s		13.19%✅ +31.2%-293.9%✅ +52.0%
Brotli_Q151,5962.008
261.1 MB/s		1.569
334.0 MB/s		9.84%✅ +7.8%-228.3%✅ +69.2%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_fast19,7525.361
97.8 MB/s		0.345
1519.7 MB/s		3.77%———
Zstd_L119,7290.915
573.2 MB/s		0.386
1359.4 MB/s		3.76%-0.1%-486.2%✅ +10.5%
Zstd_L1_disjoint_window_dict37,1130.752
697.4 MB/s		0.407
1287.4 MB/s		7.08%✅ +46.8%-613.2%✅ +15.3%
Gzip_L132,8170.942
556.6 MB/s		0.623
841.7 MB/s		6.26%✅ +39.8%-469.2%✅ +44.6%
Brotli_Q121,5461.529
342.8 MB/s		0.944
555.4 MB/s		4.11%✅ +8.3%-250.5%✅ +63.5%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_fast31,6011.640
319.5 MB/s		1.274
411.5 MB/s		6.03%———
Zstd_L134,7881.165
450.1 MB/s		0.548
956.4 MB/s		6.64%✅ +9.2%-40.9%-132.4%
Zstd_L1_disjoint_window_dict53,2491.124
466.4 MB/s		0.543
966.0 MB/s		10.16%✅ +40.7%-46.0%-134.7%
Gzip_L161,0881.885
278.0 MB/s		1.014
517.0 MB/s		11.65%✅ +48.3%✅ +13.0%-25.6%
Brotli_Q145,5341.813
289.1 MB/s		1.449
361.8 MB/s		8.69%✅ +30.6%✅ +9.5%✅ +12.1%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_fast32,8906.622
79.2 MB/s		0.446
1176.1 MB/s		6.27%———
Zstd_L132,8670.780
672.0 MB/s		0.487
1077.4 MB/s		6.27%-0.1%-748.9%✅ +8.4%
Zstd_L1_disjoint_window_dict49,5290.919
570.2 MB/s		0.517
1014.3 MB/s		9.45%✅ +33.6%-620.3%✅ +13.8%
Gzip_L173,3721.733
302.5 MB/s		1.067
491.5 MB/s		14.00%✅ +55.2%-282.1%✅ +58.2%
Brotli_Q139,4141.387
377.9 MB/s		1.098
477.6 MB/s		7.52%✅ +16.6%-377.3%✅ +59.4%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_fast58,1036.507
80.6 MB/s		0.535
979.4 MB/s		11.08%———
Zstd_L158,0801.498
350.0 MB/s		0.680
771.5 MB/s		11.08%-0.0%-334.4%✅ +21.2%
Zstd_L1_disjoint_window_dict80,3661.552
337.7 MB/s		0.632
829.4 MB/s		15.33%✅ +27.7%-319.1%✅ +15.3%
Gzip_L1142,8793.170
165.4 MB/s		1.929
271.7 MB/s		27.25%✅ +59.3%-105.3%✅ +72.3%
Brotli_Q171,6482.243
233.7 MB/s		1.772
295.9 MB/s		13.67%✅ +18.9%-190.1%✅ +69.8%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_fast45,4307.758
67.6 MB/s		0.530
989.0 MB/s		8.67%———
Zstd_L145,4071.365
384.1 MB/s		0.574
914.1 MB/s		8.66%-0.1%-468.4%✅ +7.6%
Zstd_L1_disjoint_window_dict62,7921.191
440.1 MB/s		0.613
855.4 MB/s		11.98%✅ +27.7%-551.2%✅ +13.5%
Gzip_L166,2831.580
331.8 MB/s		1.108
473.2 MB/s		12.64%✅ +31.5%-391.1%✅ +52.2%
Brotli_Q152,6741.878
279.1 MB/s		1.575
333.0 MB/s		10.05%✅ +13.8%-313.0%✅ +66.3%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_fast35,2846.886
76.1 MB/s		0.428
1225.8 MB/s		6.73%———
Zstd_L135,2611.155
454.0 MB/s		0.461
1138.0 MB/s		6.73%-0.1%-496.4%✅ +7.2%
Zstd_L1_disjoint_window_dict50,9390.942
556.7 MB/s		0.490
1069.9 MB/s		9.72%✅ +30.7%-631.2%✅ +12.7%
Gzip_L149,8211.349
388.7 MB/s		0.891
588.4 MB/s		9.50%✅ +29.2%-410.6%✅ +52.0%
Brotli_Q137,4851.671
313.8 MB/s		1.301
402.8 MB/s		7.15%✅ +5.9%-312.2%✅ +67.1%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_fast17,4243.254
161.1 MB/s		2.904
180.5 MB/s		3.32%———
Zstd_L132,3262.269
231.0 MB/s		1.464
358.1 MB/s		6.17%✅ +46.1%-43.4%-98.4%
Zstd_L1_disjoint_window_dict50,6441.864
281.2 MB/s		1.520
344.9 MB/s		9.66%✅ +65.6%-74.6%-91.1%
Gzip_L145,2902.022
259.3 MB/s		1.460
359.1 MB/s		8.64%✅ +61.5%-61.0%-98.9%
Brotli_Q135,4512.625
199.7 MB/s		2.686
195.2 MB/s		6.76%✅ +50.9%-24.0%-8.1%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_fast32,10810.343
50.7 MB/s		0.768
682.5 MB/s		6.12%———
Zstd_L132,0851.726
303.8 MB/s		0.846
620.0 MB/s		6.12%-0.1%-499.4%✅ +9.2%
Zstd_L1_disjoint_window_dict49,6601.823
287.6 MB/s		0.749
700.2 MB/s		9.47%✅ +35.3%-467.5%-2.6%
Gzip_L143,4141.758
298.3 MB/s		1.341
391.0 MB/s		8.28%✅ +26.0%-488.5%✅ +42.7%
Brotli_Q134,8562.641
198.5 MB/s		3.146
166.6 MB/s		6.65%✅ +7.9%-291.6%✅ +75.6%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_fast6840.145
21.9 MB/s		0.013
237.3 MB/s		21.53%———
Zstd_L16610.035
90.2 MB/s		0.013
247.4 MB/s		20.81%-3.5%-312.7%-4.3%
Zstd_L1_disjoint_window_dict17,0170.100
31.8 MB/s		0.024
130.9 MB/s		535.63%✅ +96.0%-45.5%✅ +44.9%
Gzip_L16860.048
66.3 MB/s		0.022
141.9 MB/s		21.59%✅ +0.3%-203.0%✅ +40.2%
Brotli_Q16960.055
57.3 MB/s		0.846
3.8 MB/s		21.91%✅ +1.7%-162.0%✅ +98.4%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_fast5720.072
22.3 MB/s		0.009
183.5 MB/s		35.48%———
Zstd_L15490.029
55.9 MB/s		0.009
176.1 MB/s		34.06%-4.2%-150.8%✅ +4.1%
Zstd_L1_disjoint_window_dict16,9090.080
20.0 MB/s		0.019
86.2 MB/s		1048.95%✅ +96.6%✅ +10.2%✅ +53.0%
Gzip_L15600.052
31.1 MB/s		0.017
92.4 MB/s		34.74%-2.1%-39.6%✅ +49.6%
Brotli_Q15670.040
40.4 MB/s		0.749
2.2 MB/s		35.17%-0.9%-81.0%✅ +98.8%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_fast2,8290.740
31.5 MB/s		0.039
604.6 MB/s		12.14%———
Zstd_L12,8060.078
297.5 MB/s		0.038
607.6 MB/s		12.04%-0.8%-844.3%-0.5%
Zstd_L1_disjoint_window_dict19,2330.140
166.3 MB/s		0.055
426.2 MB/s		82.50%✅ +85.3%-427.7%✅ +29.5%
Gzip_L13,4590.116
201.3 MB/s		0.073
319.6 MB/s		14.84%✅ +18.2%-538.8%✅ +47.1%
Brotli_Q13,1370.156
149.6 MB/s		0.778
30.0 MB/s		13.46%✅ +9.8%-374.8%✅ +95.0%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_fast2,6630.287
28.6 MB/s		0.019
437.0 MB/s		32.44%———
Zstd_L12,6400.046
180.4 MB/s		0.018
460.9 MB/s		32.16%-0.9%-530.9%-5.5%
Zstd_L1_disjoint_window_dict18,8810.115
71.2 MB/s		0.031
268.6 MB/s		229.98%✅ +85.9%-149.0%✅ +38.5%
Gzip_L12,8190.085
96.3 MB/s		0.048
172.3 MB/s		34.34%✅ +5.5%-237.0%✅ +60.6%
Brotli_Q12,6430.105
78.2 MB/s		0.718
11.4 MB/s		32.19%-0.8%-173.7%✅ +97.4%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_fast1,6450.165
27.3 MB/s		0.014
318.4 MB/s		36.54%———
Zstd_L11,6220.038
118.1 MB/s		0.014
325.0 MB/s		36.03%-1.4%-332.9%-2.1%
Zstd_L1_disjoint_window_dict17,9410.089
50.4 MB/s		0.023
192.5 MB/s		398.51%✅ +90.8%-84.7%✅ +39.5%
Gzip_L11,6600.057
78.9 MB/s		0.028
158.2 MB/s		36.87%✅ +0.9%-189.2%✅ +50.3%
Brotli_Q11,6360.074
60.5 MB/s		0.654
6.9 MB/s		36.34%-0.6%-121.6%✅ +97.8%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_fast8,5366.154
85.2 MB/s		0.354
1479.2 MB/s		1.63%———
Zstd_L18,5130.533
983.6 MB/s		0.407
1287.5 MB/s		1.62%-0.3%-1054.7%✅ +13.0%
Zstd_L1_disjoint_window_dict24,0840.570
920.3 MB/s		0.393
1335.2 MB/s		4.59%✅ +64.6%-980.4%✅ +9.7%
Gzip_L119,9640.675
776.2 MB/s		0.499
1050.8 MB/s		3.81%✅ +57.2%-811.2%✅ +29.0%
Brotli_Q112,5141.187
441.7 MB/s		0.863
607.6 MB/s		2.39%✅ +31.8%-418.6%✅ +58.9%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_fast1,4670.202
24.5 MB/s		0.014
343.4 MB/s		29.67%———
Zstd_L11,4440.036
137.1 MB/s		0.014
361.1 MB/s		29.20%-1.6%-460.9%-5.2%
Zstd_L1_disjoint_window_dict17,7770.092
53.5 MB/s		0.024
202.5 MB/s		359.49%✅ +91.7%-118.9%✅ +41.0%
Gzip_L11,5490.060
82.3 MB/s		0.030
167.0 MB/s		31.32%✅ +5.3%-236.8%✅ +51.4%
Brotli_Q11,4970.062
80.1 MB/s		0.615
8.0 MB/s		30.27%✅ +2.0%-227.8%✅ +97.7%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_fast9410.046
36.1 MB/s		0.009
186.1 MB/s		56.52%———
Zstd_L19150.024
68.5 MB/s		0.008
205.3 MB/s		54.95%-2.8%-89.5%-10.3%
Zstd_L1_disjoint_window_dict17,2940.068
24.4 MB/s		0.017
98.5 MB/s		1038.68%✅ +94.6%✅ +32.6%✅ +47.1%
Gzip_L19390.037
45.5 MB/s		0.018
90.8 MB/s		56.40%-0.2%-25.8%✅ +51.2%
Brotli_Q19510.037
44.4 MB/s		0.591
2.8 MB/s		57.12%✅ +1.1%-23.0%✅ +98.5%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_fast53,7753.991
131.4 MB/s		1.700
308.4 MB/s		10.26%———
Zstd_L158,7941.500
349.5 MB/s		0.711
737.6 MB/s		11.22%✅ +8.5%-166.1%-139.2%
Zstd_L1_disjoint_window_dict76,7651.533
342.0 MB/s		0.647
809.9 MB/s		14.64%✅ +29.9%-160.4%-162.6%
Gzip_L185,1501.998
262.4 MB/s		1.278
410.2 MB/s		16.24%✅ +36.8%-99.7%-33.0%
Brotli_Q165,8822.022
259.3 MB/s		1.693
309.7 MB/s		12.57%✅ +18.4%-97.4%-0.4%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_fast52,4953.857
135.9 MB/s		1.569
334.2 MB/s		10.01%———
Zstd_L158,8601.537
341.0 MB/s		0.536
977.9 MB/s		11.23%✅ +10.8%-151.0%-192.6%
Zstd_L1_disjoint_window_dict77,4161.383
379.1 MB/s		0.572
917.2 MB/s		14.77%✅ +32.2%-178.9%-174.4%
Gzip_L182,3791.785
293.6 MB/s		1.098
477.3 MB/s		15.71%✅ +36.3%-116.1%-42.8%
Brotli_Q165,4071.858
282.1 MB/s		1.517
345.6 MB/s		12.48%✅ +19.7%-107.6%-3.4%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_fast78,1213.877
135.1 MB/s		0.835
627.6 MB/s		14.92%———
Zstd_L178,8741.266
413.9 MB/s		0.562
931.7 MB/s		15.06%✅ +1.0%-206.3%-48.5%
Zstd_L1_disjoint_window_dict96,9901.551
337.7 MB/s		0.606
864.3 MB/s		18.52%✅ +19.5%-150.0%-37.7%
Gzip_L1117,7492.527
207.2 MB/s		1.629
321.6 MB/s		22.48%✅ +33.7%-53.4%✅ +48.8%
Brotli_Q182,1712.319
225.8 MB/s		1.837
285.1 MB/s		15.69%✅ +4.9%-67.1%✅ +54.6%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_fast72,0274.125
126.9 MB/s		0.795
658.9 MB/s		13.75%———
Zstd_L172,6521.328
394.5 MB/s		0.521
1005.8 MB/s		13.87%✅ +0.9%-210.7%-52.7%
Zstd_L1_disjoint_window_dict90,7551.559
336.0 MB/s		0.575
910.1 MB/s		17.33%✅ +20.6%-164.7%-38.1%
Gzip_L1106,7162.323
225.5 MB/s		1.502
348.8 MB/s		20.38%✅ +32.5%-77.6%✅ +47.1%
Brotli_Q176,6562.214
236.5 MB/s		1.835
285.4 MB/s		14.64%✅ +6.0%-86.3%✅ +56.7%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_fast70,5853.882
134.1 MB/s		0.892
583.7 MB/s		13.56%———
Zstd_L171,0841.506
345.7 MB/s		0.546
954.0 MB/s		13.66%✅ +0.7%-157.8%-63.4%
Zstd_L1_disjoint_window_dict88,4421.455
357.7 MB/s		0.566
920.1 MB/s		16.99%✅ +20.2%-166.8%-57.6%
Gzip_L1111,2802.358
220.7 MB/s		1.527
341.0 MB/s		21.38%✅ +36.6%-64.6%✅ +41.6%
Brotli_Q174,7352.172
239.7 MB/s		1.673
311.2 MB/s		14.36%✅ +5.6%-78.7%✅ +46.7%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_fast73,6893.929
133.3 MB/s		0.799
655.2 MB/s		14.07%———
Zstd_L174,1201.520
344.6 MB/s		0.516
1014.2 MB/s		14.15%✅ +0.6%-158.5%-54.8%
Zstd_L1_disjoint_window_dict92,4391.502
348.8 MB/s		0.578
905.6 MB/s		17.65%✅ +20.3%-161.6%-38.2%
Gzip_L1114,7002.419
216.5 MB/s		1.564
334.9 MB/s		21.90%✅ +35.8%-62.4%✅ +48.9%
Brotli_Q178,9402.220
236.0 MB/s		1.780
294.3 MB/s		15.07%✅ +6.7%-77.0%✅ +55.1%

Native / thin

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_thin_L045,87312.357
42.4 MB/s		1.673
313.4 MB/s		8.75%———
Zstd_L942,49112.537
41.8 MB/s		0.676
775.1 MB/s		8.11%-8.0%✅ +1.4%-147.4%
Zstd_L9_disjoint_window_dict60,3057.447
70.4 MB/s		0.550
953.8 MB/s		11.50%✅ +23.9%-65.9%-204.4%
Gzip_L949,60013.295
39.4 MB/s		0.890
588.9 MB/s		9.46%✅ +7.5%✅ +7.1%-87.9%
Brotli_Q942,01443.337
12.1 MB/s		1.187
441.5 MB/s		8.01%-9.2%✅ +71.5%-40.9%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_thin_L017,0134.428
54.2 MB/s		0.643
373.0 MB/s		7.10%———
Zstd_L915,6777.611
31.5 MB/s		0.216
1109.1 MB/s		6.54%-8.5%✅ +41.8%-197.4%
Zstd_L9_disjoint_window_dict31,9602.881
83.2 MB/s		0.237
1012.9 MB/s		13.33%✅ +46.8%-53.7%-171.6%
Gzip_L918,3883.502
68.5 MB/s		0.382
627.3 MB/s		7.67%✅ +7.5%-26.4%-68.2%
Brotli_Q915,12220.959
11.4 MB/s		0.476
504.0 MB/s		6.31%-12.5%✅ +78.9%-35.1%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_thin_L024,2149.600
54.6 MB/s		1.542
339.9 MB/s		4.62%———
Zstd_L919,4169.723
53.9 MB/s		0.417
1257.3 MB/s		3.70%-24.7%✅ +1.3%-269.9%
Zstd_L9_disjoint_window_dict35,5794.604
113.9 MB/s		0.457
1146.9 MB/s		6.79%✅ +31.9%-108.5%-237.4%
Gzip_L925,7095.683
92.2 MB/s		0.567
924.8 MB/s		4.90%✅ +5.8%-68.9%-172.1%
Brotli_Q918,52526.469
19.8 MB/s		0.765
685.1 MB/s		3.53%-30.7%✅ +63.7%-101.6%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_thin_L08,9646.181
84.8 MB/s		1.097
477.9 MB/s		1.71%———
Zstd_L916,10510.100
51.9 MB/s		0.382
1372.5 MB/s		3.07%✅ +44.3%✅ +38.8%-187.2%
Zstd_L9_disjoint_window_dict32,1464.778
109.7 MB/s		0.400
1312.0 MB/s		6.13%✅ +72.1%-29.4%-174.5%
Gzip_L919,3767.717
67.9 MB/s		0.485
1080.1 MB/s		3.70%✅ +53.7%✅ +19.9%-126.0%
Brotli_Q915,77233.921
15.5 MB/s		0.733
715.6 MB/s		3.01%✅ +43.2%✅ +81.8%-49.7%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_thin_L043,2257.661
68.4 MB/s		1.268
413.4 MB/s		8.25%———
Zstd_L939,9369.681
54.2 MB/s		0.418
1255.2 MB/s		7.62%-8.2%✅ +20.9%-203.6%
Zstd_L9_disjoint_window_dict58,9325.627
93.2 MB/s		0.467
1121.5 MB/s		11.24%✅ +26.7%-36.2%-171.3%
Gzip_L947,9996.659
78.7 MB/s		0.812
645.3 MB/s		9.16%✅ +9.9%-15.1%-56.1%
Brotli_Q940,40937.771
13.9 MB/s		1.053
497.7 MB/s		7.71%-7.0%✅ +79.7%-20.4%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_thin_L017,9847.204
72.8 MB/s		1.021
513.4 MB/s		3.43%———
Zstd_L920,6619.901
52.9 MB/s		0.383
1368.7 MB/s		3.94%✅ +13.0%✅ +27.2%-166.6%
Zstd_L9_disjoint_window_dict39,3244.680
112.0 MB/s		0.423
1238.3 MB/s		7.50%✅ +54.3%-53.9%-141.2%
Gzip_L925,7018.969
58.4 MB/s		0.551
950.7 MB/s		4.90%✅ +30.0%✅ +19.7%-85.2%
Brotli_Q923,23533.886
15.5 MB/s		0.780
671.7 MB/s		4.43%✅ +22.6%✅ +78.7%-30.8%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_thin_L020,9568.798
59.6 MB/s		1.548
338.6 MB/s		4.00%———
Zstd_L928,73910.899
48.1 MB/s		0.548
955.9 MB/s		5.48%✅ +27.1%✅ +19.3%-182.3%
Zstd_L9_disjoint_window_dict44,9526.365
82.4 MB/s		0.470
1114.8 MB/s		8.57%✅ +53.4%-38.2%-229.2%
Gzip_L935,35010.303
50.9 MB/s		0.626
837.4 MB/s		6.74%✅ +40.7%✅ +14.6%-147.3%
Brotli_Q930,37040.771
12.9 MB/s		1.020
513.7 MB/s		5.79%✅ +31.0%✅ +78.4%-51.7%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_thin_L040,42210.997
47.7 MB/s		1.572
333.6 MB/s		7.71%———
Zstd_L940,21811.204
46.8 MB/s		0.482
1086.6 MB/s		7.67%-0.5%✅ +1.8%-225.7%
Zstd_L9_disjoint_window_dict56,5077.022
74.7 MB/s		0.630
831.5 MB/s		10.78%✅ +28.5%-56.6%-149.3%
Gzip_L950,43910.367
50.6 MB/s		0.862
608.2 MB/s		9.62%✅ +19.9%-6.1%-82.3%
Brotli_Q940,03342.409
12.4 MB/s		1.168
448.8 MB/s		7.64%-1.0%✅ +74.1%-34.5%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_thin_L017,4706.959
75.3 MB/s		1.280
409.5 MB/s		3.33%———
Zstd_L914,9929.318
56.3 MB/s		0.366
1432.0 MB/s		2.86%-16.5%✅ +25.3%-249.7%
Zstd_L9_disjoint_window_dict32,8323.778
138.8 MB/s		0.384
1363.4 MB/s		6.26%✅ +46.8%-84.2%-232.9%
Gzip_L922,7067.139
73.4 MB/s		0.532
985.8 MB/s		4.33%✅ +23.1%✅ +2.5%-140.7%
Brotli_Q915,13929.454
17.8 MB/s		0.782
670.6 MB/s		2.89%-15.4%✅ +76.4%-63.8%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_thin_L031,8308.480
61.8 MB/s		1.193
439.4 MB/s		6.07%———
Zstd_L930,21211.614
45.1 MB/s		0.555
943.7 MB/s		5.76%-5.4%✅ +27.0%-114.8%
Zstd_L9_disjoint_window_dict46,5596.440
81.4 MB/s		0.618
847.7 MB/s		8.88%✅ +31.6%-31.7%-92.9%
Gzip_L941,97511.994
43.7 MB/s		0.764
685.9 MB/s		8.01%✅ +24.2%✅ +29.3%-56.1%
Brotli_Q930,78840.730
12.9 MB/s		1.134
462.3 MB/s		5.87%-3.4%✅ +79.2%-5.2%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_thin_L022,2408.336
62.9 MB/s		1.198
437.4 MB/s		4.24%———
Zstd_L927,27310.188
51.5 MB/s		0.457
1146.3 MB/s		5.20%✅ +18.5%✅ +18.2%-162.1%
Zstd_L9_disjoint_window_dict43,2315.281
99.3 MB/s		0.460
1138.9 MB/s		8.25%✅ +48.6%-57.8%-160.4%
Gzip_L936,6955.435
96.5 MB/s		0.688
761.7 MB/s		7.00%✅ +39.4%-53.4%-74.1%
Brotli_Q925,47829.248
17.9 MB/s		0.837
626.0 MB/s		4.86%✅ +12.7%✅ +71.5%-43.1%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_thin_L040,96011.032
47.5 MB/s		1.988
263.7 MB/s		7.81%———
Zstd_L945,69212.972
40.4 MB/s		0.575
912.4 MB/s		8.72%✅ +10.4%✅ +15.0%-246.0%
Zstd_L9_disjoint_window_dict65,2126.849
76.5 MB/s		0.637
823.3 MB/s		12.44%✅ +37.2%-61.1%-212.2%
Gzip_L999,26716.175
32.4 MB/s		1.492
351.4 MB/s		18.93%✅ +58.7%✅ +31.8%-33.3%
Brotli_Q942,92837.404
14.0 MB/s		1.108
473.2 MB/s		8.19%✅ +4.6%✅ +70.5%-79.5%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_thin_L044,09919.781
26.5 MB/s		0.974
538.4 MB/s		8.41%———
Zstd_L937,09011.933
43.9 MB/s		0.623
841.5 MB/s		7.07%-18.9%-65.8%-56.3%
Zstd_L9_disjoint_window_dict53,3257.233
72.5 MB/s		0.548
955.9 MB/s		10.17%✅ +17.3%-173.5%-77.5%
Gzip_L942,86514.376
36.5 MB/s		0.805
651.2 MB/s		8.18%-2.9%-37.6%-20.9%
Brotli_Q936,40941.031
12.8 MB/s		1.088
482.0 MB/s		6.94%-21.1%✅ +51.8%✅ +10.5%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_thin_L025,4709.657
54.3 MB/s		1.977
265.1 MB/s		4.86%———
Zstd_L928,56611.073
47.3 MB/s		0.460
1139.7 MB/s		5.45%✅ +10.8%✅ +12.8%-329.9%
Zstd_L9_disjoint_window_dict44,9215.803
90.3 MB/s		0.456
1150.5 MB/s		8.57%✅ +43.3%-66.4%-333.9%
Gzip_L934,1318.861
59.2 MB/s		0.743
705.2 MB/s		6.51%✅ +25.4%-9.0%-166.0%
Brotli_Q928,57432.085
16.3 MB/s		1.006
521.1 MB/s		5.45%✅ +10.9%✅ +69.9%-96.5%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_thin_L016,32719.504
26.9 MB/s		3.231
162.2 MB/s		3.11%———
Zstd_L925,78734.786
15.1 MB/s		1.284
408.4 MB/s		4.92%✅ +36.7%✅ +43.9%-151.7%
Zstd_L9_disjoint_window_dict42,01715.736
33.3 MB/s		1.136
461.4 MB/s		8.02%✅ +61.1%-23.9%-184.4%
Gzip_L933,41928.403
18.5 MB/s		1.229
426.6 MB/s		6.37%✅ +51.1%✅ +31.3%-163.0%
Brotli_Q926,831134.561
3.9 MB/s		2.095
250.2 MB/s		5.12%✅ +39.1%✅ +85.5%-54.2%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_thin_L025,97614.738
35.6 MB/s		2.047
256.1 MB/s		4.96%———
Zstd_L924,92814.321
36.6 MB/s		0.690
759.9 MB/s		4.76%-4.2%-2.9%-196.7%
Zstd_L9_disjoint_window_dict40,85311.507
45.6 MB/s		0.735
713.6 MB/s		7.79%✅ +36.4%-28.1%-178.6%
Gzip_L927,33914.153
37.0 MB/s		1.289
406.7 MB/s		5.22%✅ +5.0%-4.1%-58.8%
Brotli_Q925,01648.900
10.7 MB/s		1.574
333.0 MB/s		4.77%-3.8%✅ +69.9%-30.0%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_thin_L08610.617
5.2 MB/s		0.035
90.3 MB/s		27.10%———
Zstd_L96212.343
1.4 MB/s		0.161
19.8 MB/s		19.55%-38.6%✅ +73.7%✅ +78.1%
Zstd_L9_disjoint_window_dict16,9830.337
9.4 MB/s		0.184
17.3 MB/s		534.56%✅ +94.9%-83.0%✅ +80.8%
Gzip_L96340.082
38.6 MB/s		0.023
136.4 MB/s		19.96%-35.8%-649.1%-51.1%
Brotli_Q95876.988
0.5 MB/s		0.040
78.5 MB/s		18.48%-46.7%✅ +91.2%✅ +13.0%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_thin_L06970.541
3.0 MB/s		0.016
102.2 MB/s		43.24%———
Zstd_L95382.185
0.7 MB/s		0.175
9.2 MB/s		33.37%-29.6%✅ +75.2%✅ +91.0%
Zstd_L9_disjoint_window_dict16,8930.304
5.3 MB/s		0.250
6.5 MB/s		1047.95%✅ +95.9%-78.1%✅ +93.7%
Gzip_L95410.067
23.9 MB/s		0.018
89.0 MB/s		33.56%-28.8%-704.0%✅ +12.9%
Brotli_Q94707.003
0.2 MB/s		0.033
49.5 MB/s		29.16%-48.3%✅ +92.3%✅ +51.5%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_thin_L03,0272.191
10.6 MB/s		0.134
173.5 MB/s		12.98%———
Zstd_L92,4652.366
9.9 MB/s		0.183
127.1 MB/s		10.57%-22.8%✅ +7.4%✅ +26.7%
Zstd_L9_disjoint_window_dict18,8240.552
42.2 MB/s		0.207
112.8 MB/s		80.75%✅ +83.9%-296.6%✅ +35.0%
Gzip_L92,6570.395
59.0 MB/s		0.062
375.9 MB/s		11.40%-13.9%-454.4%-116.6%
Brotli_Q92,3767.116
3.3 MB/s		0.101
230.5 MB/s		10.19%-27.4%✅ +69.2%-32.8%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_thin_L03,1860.975
8.4 MB/s		0.094
87.5 MB/s		38.81%———
Zstd_L92,3422.114
3.9 MB/s		0.155
53.1 MB/s		28.53%-36.0%✅ +53.9%✅ +39.3%
Zstd_L9_disjoint_window_dict18,6610.421
19.5 MB/s		0.183
45.0 MB/s		227.30%✅ +82.9%-131.7%✅ +48.6%
Gzip_L92,3400.180
45.7 MB/s		0.044
187.1 MB/s		28.50%-36.2%-443.1%-113.9%
Brotli_Q92,1517.134
1.2 MB/s		0.080
102.5 MB/s		26.20%-48.1%✅ +86.3%-17.1%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_thin_L01,9450.906
5.0 MB/s		0.055
82.0 MB/s		43.20%———
Zstd_L91,4961.971
2.3 MB/s		0.149
30.2 MB/s		33.23%-30.0%✅ +54.0%✅ +63.2%
Zstd_L9_disjoint_window_dict17,7930.381
11.8 MB/s		0.181
24.9 MB/s		395.22%✅ +89.1%-137.9%✅ +69.6%
Gzip_L91,4800.108
41.6 MB/s		0.028
159.4 MB/s		32.87%-31.4%-738.0%-94.4%
Brotli_Q91,3796.193
0.7 MB/s		0.052
87.3 MB/s		30.63%-41.0%✅ +85.4%-6.4%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_thin_L01,5056.533
80.3 MB/s		1.686
311.0 MB/s		0.29%———
Zstd_L98,7929.382
55.9 MB/s		0.413
1269.1 MB/s		1.68%✅ +82.9%✅ +30.4%-308.0%
Zstd_L9_disjoint_window_dict24,9753.440
152.4 MB/s		0.409
1283.2 MB/s		4.76%✅ +94.0%-89.9%-312.6%
Gzip_L915,4593.794
138.2 MB/s		0.417
1257.1 MB/s		2.95%✅ +90.3%-72.2%-304.2%
Brotli_Q98,07322.615
23.2 MB/s		0.607
864.4 MB/s		1.54%✅ +81.4%✅ +71.1%-177.9%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_thin_L01,7884.424
1.1 MB/s		0.047
105.5 MB/s		36.16%———
Zstd_L91,3131.885
2.6 MB/s		0.126
39.1 MB/s		26.55%-36.2%-134.7%✅ +62.9%
Zstd_L9_disjoint_window_dict17,6530.359
13.8 MB/s		0.167
29.7 MB/s		356.99%✅ +89.9%-1133.7%✅ +71.9%
Gzip_L91,3050.106
46.7 MB/s		0.027
186.3 MB/s		26.39%-37.0%-4074.9%-76.5%
Brotli_Q91,2075.896
0.8 MB/s		0.046
108.1 MB/s		24.41%-48.1%✅ +25.0%-2.4%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_thin_L01,0580.513
3.2 MB/s		0.017
95.7 MB/s		63.54%———
Zstd_L99011.746
1.0 MB/s		0.128
13.0 MB/s		54.11%-17.4%✅ +70.6%✅ +86.4%
Zstd_L9_disjoint_window_dict17,2560.334
5.0 MB/s		0.142
11.7 MB/s		1036.40%✅ +93.9%-53.4%✅ +87.7%
Gzip_L99050.065
25.4 MB/s		0.017
98.8 MB/s		54.35%-16.9%-683.4%-3.3%
Brotli_Q98415.790
0.3 MB/s		0.033
50.1 MB/s		50.51%-25.8%✅ +91.1%✅ +47.6%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_thin_L036,15112.445
42.1 MB/s		1.622
323.2 MB/s		6.90%———
Zstd_L946,31012.812
40.9 MB/s		0.580
904.0 MB/s		8.83%✅ +21.9%✅ +2.9%-179.7%
Zstd_L9_disjoint_window_dict61,8218.068
65.0 MB/s		0.606
864.5 MB/s		11.79%✅ +41.5%-54.3%-167.5%
Gzip_L950,29611.256
46.6 MB/s		0.825
635.2 MB/s		9.59%✅ +28.1%-10.6%-96.5%
Brotli_Q942,96436.653
14.3 MB/s		1.022
513.1 MB/s		8.20%✅ +15.9%✅ +66.0%-58.7%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_thin_L037,28311.149
47.0 MB/s		1.447
362.4 MB/s		7.11%———
Zstd_L946,81212.015
43.6 MB/s		0.551
952.2 MB/s		8.93%✅ +20.4%✅ +7.2%-162.8%
Zstd_L9_disjoint_window_dict62,5267.236
72.4 MB/s		0.529
990.3 MB/s		11.93%✅ +40.4%-54.1%-173.3%
Gzip_L950,96510.295
50.9 MB/s		0.752
696.9 MB/s		9.72%✅ +26.8%-8.3%-92.3%
Brotli_Q943,11134.106
15.4 MB/s		0.886
591.5 MB/s		8.22%✅ +13.5%✅ +67.3%-63.2%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_thin_L077,35626.076
20.1 MB/s		1.233
424.7 MB/s		14.77%———
Zstd_L969,89612.393
42.3 MB/s		0.556
941.6 MB/s		13.35%-10.7%-110.4%-121.7%
Zstd_L9_disjoint_window_dict88,0477.907
66.2 MB/s		0.619
846.7 MB/s		16.81%✅ +12.1%-229.8%-99.4%
Gzip_L982,59214.392
36.4 MB/s		1.228
426.6 MB/s		15.77%✅ +6.3%-81.2%-0.4%
Brotli_Q967,04546.083
11.4 MB/s		1.690
310.0 MB/s		12.80%-15.4%✅ +43.4%✅ +27.0%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_thin_L072,20424.537
21.3 MB/s		1.496
350.0 MB/s		13.79%———
Zstd_L966,28112.397
42.2 MB/s		0.573
913.7 MB/s		12.66%-8.9%-97.9%-161.1%
Zstd_L9_disjoint_window_dict85,1547.322
71.5 MB/s		0.590
888.1 MB/s		16.26%✅ +15.2%-235.1%-153.8%
Gzip_L977,52312.732
41.1 MB/s		1.119
467.9 MB/s		14.80%✅ +6.9%-92.7%-33.7%
Brotli_Q963,95644.997
11.6 MB/s		1.497
349.8 MB/s		12.21%-12.9%✅ +45.5%✅ +0.1%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_thin_L068,12025.056
20.8 MB/s		1.328
392.0 MB/s		13.09%———
Zstd_L963,05811.614
44.8 MB/s		0.513
1015.1 MB/s		12.11%-8.0%-115.7%-158.9%
Zstd_L9_disjoint_window_dict80,8966.920
75.2 MB/s		0.569
915.1 MB/s		15.54%✅ +15.8%-262.1%-133.4%
Gzip_L975,46512.786
40.7 MB/s		1.091
477.3 MB/s		14.50%✅ +9.7%-96.0%-21.7%
Brotli_Q960,74342.393
12.3 MB/s		1.420
366.5 MB/s		11.67%-12.1%✅ +40.9%✅ +6.5%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_thin_L072,57085.171
6.2 MB/s		1.469
356.7 MB/s		13.85%———
Zstd_L966,46311.564
45.3 MB/s		0.597
877.6 MB/s		12.69%-9.2%-636.5%-146.1%
Zstd_L9_disjoint_window_dict84,8867.164
73.1 MB/s		0.606
864.0 MB/s		16.20%✅ +14.5%-1088.8%-142.2%
Gzip_L980,13415.274
34.3 MB/s		1.146
457.0 MB/s		15.30%✅ +9.4%-457.6%-28.1%
Brotli_Q964,20745.079
11.6 MB/s		1.534
341.5 MB/s		12.26%-13.0%-88.9%✅ +4.2%

Hybrid / thin

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_thin_L939,34812.465
42.1 MB/s		1.380
379.9 MB/s		7.51%———
Zstd_L942,49112.537
41.8 MB/s		0.676
775.1 MB/s		8.11%✅ +7.4%✅ +0.6%-104.0%
Zstd_L9_disjoint_window_dict60,3057.447
70.4 MB/s		0.550
953.8 MB/s		11.50%✅ +34.8%-67.4%-151.1%
Gzip_L949,60013.295
39.4 MB/s		0.890
588.9 MB/s		9.46%✅ +20.7%✅ +6.2%-55.0%
Brotli_Q942,01443.337
12.1 MB/s		1.187
441.5 MB/s		8.01%✅ +6.3%✅ +71.2%-16.2%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_thin_L915,9434.542
52.8 MB/s		0.511
468.9 MB/s		6.65%———
Zstd_L915,6777.611
31.5 MB/s		0.216
1109.1 MB/s		6.54%-1.7%✅ +40.3%-136.5%
Zstd_L9_disjoint_window_dict31,9602.881
83.2 MB/s		0.237
1012.9 MB/s		13.33%✅ +50.1%-57.6%-116.0%
Gzip_L918,3883.502
68.5 MB/s		0.382
627.3 MB/s		7.67%✅ +13.3%-29.7%-33.8%
Brotli_Q915,12220.959
11.4 MB/s		0.476
504.0 MB/s		6.31%-5.4%✅ +78.3%-7.5%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_thin_L921,43212.535
41.8 MB/s		1.308
400.7 MB/s		4.09%———
Zstd_L919,4169.723
53.9 MB/s		0.417
1257.3 MB/s		3.70%-10.4%-28.9%-213.8%
Zstd_L9_disjoint_window_dict35,5794.604
113.9 MB/s		0.457
1146.9 MB/s		6.79%✅ +39.8%-172.3%-186.2%
Gzip_L925,7095.683
92.2 MB/s		0.567
924.8 MB/s		4.90%✅ +16.6%-120.6%-130.8%
Brotli_Q918,52526.469
19.8 MB/s		0.765
685.1 MB/s		3.53%-15.7%✅ +52.6%-71.0%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_thin_L98,0499.710
54.0 MB/s		1.071
489.5 MB/s		1.54%———
Zstd_L916,10510.100
51.9 MB/s		0.382
1372.5 MB/s		3.07%✅ +50.0%✅ +3.9%-180.4%
Zstd_L9_disjoint_window_dict32,1464.778
109.7 MB/s		0.400
1312.0 MB/s		6.13%✅ +75.0%-103.2%-168.0%
Gzip_L919,3767.717
67.9 MB/s		0.485
1080.1 MB/s		3.70%✅ +58.5%-25.8%-120.6%
Brotli_Q915,77233.921
15.5 MB/s		0.733
715.6 MB/s		3.01%✅ +49.0%✅ +71.4%-46.2%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_thin_L939,09611.323
46.3 MB/s		0.813
645.2 MB/s		7.46%———
Zstd_L939,9369.681
54.2 MB/s		0.418
1255.2 MB/s		7.62%✅ +2.1%-17.0%-94.6%
Zstd_L9_disjoint_window_dict58,9325.627
93.2 MB/s		0.467
1121.5 MB/s		11.24%✅ +33.7%-101.2%-73.8%
Gzip_L947,9996.659
78.7 MB/s		0.812
645.3 MB/s		9.16%✅ +18.5%-70.0%-0.0%
Brotli_Q940,40937.771
13.9 MB/s		1.053
497.7 MB/s		7.71%✅ +3.2%✅ +70.0%✅ +22.9%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_thin_L917,41610.995
47.7 MB/s		1.073
488.5 MB/s		3.32%———
Zstd_L920,6619.901
52.9 MB/s		0.383
1368.7 MB/s		3.94%✅ +15.7%-11.1%-180.2%
Zstd_L9_disjoint_window_dict39,3244.680
112.0 MB/s		0.423
1238.3 MB/s		7.50%✅ +55.7%-134.9%-153.5%
Gzip_L925,7018.969
58.4 MB/s		0.551
950.7 MB/s		4.90%✅ +32.2%-22.6%-94.6%
Brotli_Q923,23533.886
15.5 MB/s		0.780
671.7 MB/s		4.43%✅ +25.0%✅ +67.6%-37.5%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_thin_L919,35112.011
43.6 MB/s		1.399
374.8 MB/s		3.69%———
Zstd_L928,73910.899
48.1 MB/s		0.548
955.9 MB/s		5.48%✅ +32.7%-10.2%-155.0%
Zstd_L9_disjoint_window_dict44,9526.365
82.4 MB/s		0.470
1114.8 MB/s		8.57%✅ +57.0%-88.7%-197.4%
Gzip_L935,35010.303
50.9 MB/s		0.626
837.4 MB/s		6.74%✅ +45.3%-16.6%-123.4%
Brotli_Q930,37040.771
12.9 MB/s		1.020
513.7 MB/s		5.79%✅ +36.3%✅ +70.5%-37.1%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_thin_L935,29414.637
35.8 MB/s		1.352
387.7 MB/s		6.73%———
Zstd_L940,21811.204
46.8 MB/s		0.482
1086.6 MB/s		7.67%✅ +12.2%-30.6%-180.3%
Zstd_L9_disjoint_window_dict56,5077.022
74.7 MB/s		0.630
831.5 MB/s		10.78%✅ +37.5%-108.4%-114.5%
Gzip_L950,43910.367
50.6 MB/s		0.862
608.2 MB/s		9.62%✅ +30.0%-41.2%-56.9%
Brotli_Q940,03342.409
12.4 MB/s		1.168
448.8 MB/s		7.64%✅ +11.8%✅ +65.5%-15.8%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_thin_L916,00310.397
50.4 MB/s		1.253
418.2 MB/s		3.05%———
Zstd_L914,9929.318
56.3 MB/s		0.366
1432.0 MB/s		2.86%-6.7%-11.6%-242.4%
Zstd_L9_disjoint_window_dict32,8323.778
138.8 MB/s		0.384
1363.4 MB/s		6.26%✅ +51.3%-175.2%-226.0%
Gzip_L922,7067.139
73.4 MB/s		0.532
985.8 MB/s		4.33%✅ +29.5%-45.6%-135.7%
Brotli_Q915,13929.454
17.8 MB/s		0.782
670.6 MB/s		2.89%-5.7%✅ +64.7%-60.4%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_thin_L930,40011.490
45.6 MB/s		1.006
521.1 MB/s		5.80%———
Zstd_L930,21211.614
45.1 MB/s		0.555
943.7 MB/s		5.76%-0.6%✅ +1.1%-81.1%
Zstd_L9_disjoint_window_dict46,5596.440
81.4 MB/s		0.618
847.7 MB/s		8.88%✅ +34.7%-78.4%-62.7%
Gzip_L941,97511.994
43.7 MB/s		0.764
685.9 MB/s		8.01%✅ +27.6%✅ +4.2%-31.6%
Brotli_Q930,78840.730
12.9 MB/s		1.134
462.3 MB/s		5.87%✅ +1.3%✅ +71.8%✅ +11.3%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_thin_L920,60511.223
46.7 MB/s		1.030
509.1 MB/s		3.93%———
Zstd_L927,27310.188
51.5 MB/s		0.457
1146.3 MB/s		5.20%✅ +24.4%-10.2%-125.2%
Zstd_L9_disjoint_window_dict43,2315.281
99.3 MB/s		0.460
1138.9 MB/s		8.25%✅ +52.3%-112.5%-123.7%
Gzip_L936,6955.435
96.5 MB/s		0.688
761.7 MB/s		7.00%✅ +43.8%-106.5%-49.6%
Brotli_Q925,47829.248
17.9 MB/s		0.837
626.0 MB/s		4.86%✅ +19.1%✅ +61.6%-23.0%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_thin_L938,97414.971
35.0 MB/s		1.795
292.1 MB/s		7.43%———
Zstd_L945,69212.972
40.4 MB/s		0.575
912.4 MB/s		8.72%✅ +14.7%-15.4%-212.4%
Zstd_L9_disjoint_window_dict65,2126.849
76.5 MB/s		0.637
823.3 MB/s		12.44%✅ +40.2%-118.6%-181.8%
Gzip_L999,26716.175
32.4 MB/s		1.492
351.4 MB/s		18.93%✅ +60.7%✅ +7.4%-20.3%
Brotli_Q942,92837.404
14.0 MB/s		1.108
473.2 MB/s		8.19%✅ +9.2%✅ +60.0%-62.0%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_thin_L937,11337.277
14.1 MB/s		0.462
1135.4 MB/s		7.08%———
Zstd_L937,09011.933
43.9 MB/s		0.623
841.5 MB/s		7.07%-0.1%-212.4%✅ +25.9%
Zstd_L9_disjoint_window_dict53,3257.233
72.5 MB/s		0.548
955.9 MB/s		10.17%✅ +30.4%-415.4%✅ +15.8%
Gzip_L942,86514.376
36.5 MB/s		0.805
651.2 MB/s		8.18%✅ +13.4%-159.3%✅ +42.6%
Brotli_Q936,40941.031
12.8 MB/s		1.088
482.0 MB/s		6.94%-1.9%✅ +9.2%✅ +57.5%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_thin_L923,97313.070
40.1 MB/s		1.745
300.5 MB/s		4.57%———
Zstd_L928,56611.073
47.3 MB/s		0.460
1139.7 MB/s		5.45%✅ +16.1%-18.0%-279.3%
Zstd_L9_disjoint_window_dict44,9215.803
90.3 MB/s		0.456
1150.5 MB/s		8.57%✅ +46.6%-125.2%-282.9%
Gzip_L934,1318.861
59.2 MB/s		0.743
705.2 MB/s		6.51%✅ +29.8%-47.5%-134.7%
Brotli_Q928,57432.085
16.3 MB/s		1.006
521.1 MB/s		5.45%✅ +16.1%✅ +59.3%-73.4%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_thin_L914,83732.167
16.3 MB/s		2.940
178.3 MB/s		2.83%———
Zstd_L925,78734.786
15.1 MB/s		1.284
408.4 MB/s		4.92%✅ +42.5%✅ +7.5%-129.0%
Zstd_L9_disjoint_window_dict42,01715.736
33.3 MB/s		1.136
461.4 MB/s		8.02%✅ +64.7%-104.4%-158.7%
Gzip_L933,41928.403
18.5 MB/s		1.229
426.6 MB/s		6.37%✅ +55.6%-13.3%-139.3%
Brotli_Q926,831134.561
3.9 MB/s		2.095
250.2 MB/s		5.12%✅ +44.7%✅ +76.1%-40.3%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_thin_L924,18218.182
28.8 MB/s		1.593
329.1 MB/s		4.61%———
Zstd_L924,92814.321
36.6 MB/s		0.690
759.9 MB/s		4.76%✅ +3.0%-27.0%-130.9%
Zstd_L9_disjoint_window_dict40,85311.507
45.6 MB/s		0.735
713.6 MB/s		7.79%✅ +40.8%-58.0%-116.8%
Gzip_L927,33914.153
37.0 MB/s		1.289
406.7 MB/s		5.22%✅ +11.5%-28.5%-23.6%
Brotli_Q925,01648.900
10.7 MB/s		1.574
333.0 MB/s		4.77%✅ +3.3%✅ +62.8%-1.2%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_thin_L964414.834
0.2 MB/s		0.178
17.8 MB/s		20.27%———
Zstd_L96212.343
1.4 MB/s		0.161
19.8 MB/s		19.55%-3.7%-533.1%-11.0%
Zstd_L9_disjoint_window_dict16,9830.337
9.4 MB/s		0.184
17.3 MB/s		534.56%✅ +96.2%-4301.4%✅ +2.9%
Gzip_L96340.082
38.6 MB/s		0.023
136.4 MB/s		19.96%-1.6%-17919.9%-665.5%
Brotli_Q95876.988
0.5 MB/s		0.040
78.5 MB/s		18.48%-9.7%-112.3%-340.6%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_thin_L95618.876
0.2 MB/s		0.186
8.7 MB/s		34.80%———
Zstd_L95382.185
0.7 MB/s		0.175
9.2 MB/s		33.37%-4.3%-306.1%-6.1%
Zstd_L9_disjoint_window_dict16,8930.304
5.3 MB/s		0.250
6.5 MB/s		1047.95%✅ +96.7%-2820.8%✅ +25.5%
Gzip_L95410.067
23.9 MB/s		0.018
89.0 MB/s		33.56%-3.7%-13085.3%-926.7%
Brotli_Q94707.003
0.2 MB/s		0.033
49.5 MB/s		29.16%-19.4%-26.7%-471.4%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_thin_L92,6823.346
7.0 MB/s		0.269
86.8 MB/s		11.50%———
Zstd_L92,4652.366
9.9 MB/s		0.183
127.1 MB/s		10.57%-8.8%-41.4%-46.4%
Zstd_L9_disjoint_window_dict18,8240.552
42.2 MB/s		0.207
112.8 MB/s		80.75%✅ +85.8%-505.8%-30.0%
Gzip_L92,6570.395
59.0 MB/s		0.062
375.9 MB/s		11.40%-0.9%-746.8%-333.0%
Brotli_Q92,3767.116
3.3 MB/s		0.101
230.5 MB/s		10.19%-12.9%✅ +53.0%-165.5%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_thin_L92,3658.954
0.9 MB/s		0.142
57.8 MB/s		28.81%———
Zstd_L92,3422.114
3.9 MB/s		0.155
53.1 MB/s		28.53%-1.0%-323.5%✅ +8.1%
Zstd_L9_disjoint_window_dict18,6610.421
19.5 MB/s		0.183
45.0 MB/s		227.30%✅ +87.3%-2027.5%✅ +22.2%
Gzip_L92,3400.180
45.7 MB/s		0.044
187.1 MB/s		28.50%-1.1%-4887.4%-223.7%
Brotli_Q92,1517.134
1.2 MB/s		0.080
102.5 MB/s		26.20%-9.9%-25.5%-77.3%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,51912.036
0.4 MB/s		0.158
28.5 MB/s		33.74%———
Zstd_L91,4961.971
2.3 MB/s		0.149
30.2 MB/s		33.23%-1.5%-510.5%-6.0%
Zstd_L9_disjoint_window_dict17,7930.381
11.8 MB/s		0.181
24.9 MB/s		395.22%✅ +91.5%-3059.2%✅ +12.5%
Gzip_L91,4800.108
41.6 MB/s		0.028
159.4 MB/s		32.87%-2.6%-11029.9%-459.5%
Brotli_Q91,3796.193
0.7 MB/s		0.052
87.3 MB/s		30.63%-10.2%-94.3%-206.2%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,16311.215
46.7 MB/s		1.658
316.1 MB/s		0.22%———
Zstd_L98,7929.382
55.9 MB/s		0.413
1269.1 MB/s		1.68%✅ +86.8%-19.5%-301.5%
Zstd_L9_disjoint_window_dict24,9753.440
152.4 MB/s		0.409
1283.2 MB/s		4.76%✅ +95.3%-226.0%-305.9%
Gzip_L915,4593.794
138.2 MB/s		0.417
1257.1 MB/s		2.95%✅ +92.5%-195.6%-297.7%
Brotli_Q98,07322.615
23.2 MB/s		0.607
864.4 MB/s		1.54%✅ +85.6%✅ +50.4%-173.4%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,3367.828
0.6 MB/s		0.136
36.2 MB/s		27.02%———
Zstd_L91,3131.885
2.6 MB/s		0.126
39.1 MB/s		26.55%-1.8%-315.2%-7.9%
Zstd_L9_disjoint_window_dict17,6530.359
13.8 MB/s		0.167
29.7 MB/s		356.99%✅ +92.4%-2082.7%✅ +18.1%
Gzip_L91,3050.106
46.7 MB/s		0.027
186.3 MB/s		26.39%-2.4%-7286.4%-413.9%
Brotli_Q91,2075.896
0.8 MB/s		0.046
108.1 MB/s		24.41%-10.7%-32.8%-198.2%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_thin_L99265.353
0.3 MB/s		0.142
11.7 MB/s		55.62%———
Zstd_L99011.746
1.0 MB/s		0.128
13.0 MB/s		54.11%-2.8%-206.6%-11.5%
Zstd_L9_disjoint_window_dict17,2560.334
5.0 MB/s		0.142
11.7 MB/s		1036.40%✅ +94.6%-1501.9%-0.3%
Gzip_L99050.065
25.4 MB/s		0.017
98.8 MB/s		54.35%-2.3%-8080.1%-745.6%
Brotli_Q98415.790
0.3 MB/s		0.033
50.1 MB/s		50.51%-10.1%✅ +7.6%-328.6%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_thin_L935,05715.302
34.3 MB/s		1.415
370.4 MB/s		6.69%———
Zstd_L946,31012.812
40.9 MB/s		0.580
904.0 MB/s		8.83%✅ +24.3%-19.4%-144.1%
Zstd_L9_disjoint_window_dict61,8218.068
65.0 MB/s		0.606
864.5 MB/s		11.79%✅ +43.3%-89.7%-133.4%
Gzip_L950,29611.256
46.6 MB/s		0.825
635.2 MB/s		9.59%✅ +30.3%-35.9%-71.5%
Brotli_Q942,96436.653
14.3 MB/s		1.022
513.1 MB/s		8.20%✅ +18.4%✅ +58.3%-38.5%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_thin_L935,95614.267
36.7 MB/s		1.247
420.5 MB/s		6.86%———
Zstd_L946,81212.015
43.6 MB/s		0.551
952.2 MB/s		8.93%✅ +23.2%-18.7%-126.4%
Zstd_L9_disjoint_window_dict62,5267.236
72.4 MB/s		0.529
990.3 MB/s		11.93%✅ +42.5%-97.2%-135.5%
Gzip_L950,96510.295
50.9 MB/s		0.752
696.9 MB/s		9.72%✅ +29.4%-38.6%-65.7%
Brotli_Q943,11134.106
15.4 MB/s		0.886
591.5 MB/s		8.22%✅ +16.6%✅ +58.2%-40.7%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_thin_L969,91937.554
13.9 MB/s		0.511
1025.8 MB/s		13.35%———
Zstd_L969,89612.393
42.3 MB/s		0.556
941.6 MB/s		13.35%-0.0%-203.0%✅ +8.2%
Zstd_L9_disjoint_window_dict88,0477.907
66.2 MB/s		0.619
846.7 MB/s		16.81%✅ +20.6%-375.0%✅ +17.5%
Gzip_L982,59214.392
36.4 MB/s		1.228
426.6 MB/s		15.77%✅ +15.3%-160.9%✅ +58.4%
Brotli_Q967,04546.083
11.4 MB/s		1.690
310.0 MB/s		12.80%-4.3%✅ +18.5%✅ +69.8%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_thin_L966,30437.445
14.0 MB/s		0.495
1057.1 MB/s		12.66%———
Zstd_L966,28112.397
42.2 MB/s		0.573
913.7 MB/s		12.66%-0.0%-202.0%✅ +13.6%
Zstd_L9_disjoint_window_dict85,1547.322
71.5 MB/s		0.590
888.1 MB/s		16.26%✅ +22.1%-411.4%✅ +16.0%
Gzip_L977,52312.732
41.1 MB/s		1.119
467.9 MB/s		14.80%✅ +14.5%-194.1%✅ +55.7%
Brotli_Q963,95644.997
11.6 MB/s		1.497
349.8 MB/s		12.21%-3.7%✅ +16.8%✅ +66.9%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_thin_L963,08136.365
14.3 MB/s		0.490
1062.9 MB/s		12.12%———
Zstd_L963,05811.614
44.8 MB/s		0.513
1015.1 MB/s		12.11%-0.0%-213.1%✅ +4.5%
Zstd_L9_disjoint_window_dict80,8966.920
75.2 MB/s		0.569
915.1 MB/s		15.54%✅ +22.0%-425.5%✅ +13.9%
Gzip_L975,46512.786
40.7 MB/s		1.091
477.3 MB/s		14.50%✅ +16.4%-184.4%✅ +55.1%
Brotli_Q960,74342.393
12.3 MB/s		1.420
366.5 MB/s		11.67%-3.8%✅ +14.2%✅ +65.5%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_thin_L966,48686.235
6.1 MB/s		0.486
1078.2 MB/s		12.69%———
Zstd_L966,46311.564
45.3 MB/s		0.597
877.6 MB/s		12.69%-0.0%-645.7%✅ +18.6%
Zstd_L9_disjoint_window_dict84,8867.164
73.1 MB/s		0.606
864.0 MB/s		16.20%✅ +21.7%-1103.7%✅ +19.9%
Gzip_L980,13415.274
34.3 MB/s		1.146
457.0 MB/s		15.30%✅ +17.0%-464.6%✅ +57.6%
Brotli_Q964,20745.079
11.6 MB/s		1.534
341.5 MB/s		12.26%-3.5%-91.3%✅ +68.3%