Public 30-file benchmark

PIZD 5.0.0-rc6 · 11,815,190 input bytes · 540 verified configuration rows · 5 measured rounds + 3 warmups.

16 system logs + 2 historical HTTP windows + 4 public JSON event windows + 8 parser fixtures. Bounded excerpts, not 30 complete production captures. Methodology and limits · CSV · Source provenance · Pairwise wins · Results by source category

Aggregate measurements

Times sum the per-file medians. Full external dictionary bytes are charged per file. 🏆 indicates best metric across all 18 configurations.

ConfigurationArchive bytesBytes incl. dictionarySource %Encode msVerified decode msEncode MB/sVerified decode MB/sBytes with shared dictionaryWins vs Zstd baseline (/30)
Brotli_Q11,099,6941,099,6949.31%38.77036.175304.7326.61,099,694— (Baseline)
Brotli_Q6834,540834,5407.06%300.13824.08439.4490.6834,540— (Baseline)
Brotli_Q9815,753815,7536.90%867.06524.02113.6491.9815,753— (Baseline)
Gzip_L11,562,3991,562,39913.22%37.37023.533316.2502.11,562,399— (Baseline)
Gzip_L61,058,9181,058,9188.96%146.07318.05280.9654.51,058,918— (Baseline)
Gzip_L91,053,2551,053,2558.91%218.24717.83054.1662.61,053,255— (Baseline)
PIZD_hybrid_default835,493835,4937.07%141.02817.86283.8661.5835,493Size 18/30 · Encode 0/30 · Decode 9/30
PIZD_hybrid_fast940,743940,7437.96%70.50211.569167.61021.3940,743Size 5/30 · Encode 0/30 · Decode 25/30
PIZD_hybrid_thin_L9🏆 690,053🏆 690,053🏆 5.84%1033.44842.70111.4276.7🏆 690,053Size 25/30 · Encode 2/30 · Decode 9/30
PIZD_native_default847,603847,6037.17%179.84627.70165.7426.5847,603Size 18/30 · Encode 0/30 · Decode 0/30
PIZD_native_fast1,282,6761,282,67610.86%118.23826.01899.9454.11,282,676Size 2/30 · Encode 0/30 · Decode 0/30
PIZD_native_thin_L0757,504757,5046.41%1232.32850.3069.6234.9757,504Size 16/30 · Encode 2/30 · Decode 6/30
Zstd_L1985,110985,1108.34%26.94511.901438.5992.8985,110— (Baseline)
Zstd_L1_disjoint_window_dict1,014,1811,505,70112.74%26.43712.430446.9950.51,030,565— (Baseline)
Zstd_L3980,830980,8308.30%🏆 25.629🏆 11.190🏆 461.0🏆 1055.9980,830— (Baseline)
Zstd_L3_disjoint_window_dict981,8961,473,41612.47%32.49211.918363.6991.4998,280— (Baseline)
Zstd_L9835,071835,0717.07%261.16211.52445.21025.2835,071— (Baseline)
Zstd_L9_disjoint_window_dict849,5031,341,02311.35%139.64912.53084.6943.0865,887— (Baseline)

Pairwise Head-to-Head Win Rates (out of 30 files)

Number of files where PIZD achieves strictly smaller compressed bytes or lower execution latency than the reference codec.

PIZD ConfigurationReference BaselineSize Wins / 30Compression Speed Wins / 30Verified Decompression Wins / 30
Native DefaultZstd_L3✅ 18/30 (60.0%)0/30 (0.0%)0/30 (0.0%)
Native DefaultZstd_L3_disjoint_window_dict✅ 30/30 (100.0%)0/30 (0.0%)2/30 (6.7%)
Native DefaultGzip_L6✅ 21/30 (70.0%)5/30 (16.7%)3/30 (10.0%)
Native DefaultBrotli_Q611/30 (36.7%)✅ 24/30 (80.0%)11/30 (36.7%)
Hybrid DefaultZstd_L3✅ 18/30 (60.0%)0/30 (0.0%)9/30 (30.0%)
Hybrid DefaultZstd_L3_disjoint_window_dict✅ 30/30 (100.0%)2/30 (6.7%)10/30 (33.3%)
Hybrid DefaultGzip_L6✅ 22/30 (73.3%)14/30 (46.7%)✅ 17/30 (56.7%)
Hybrid DefaultBrotli_Q612/30 (40.0%)✅ 26/30 (86.7%)✅ 24/30 (80.0%)
Native FastZstd_L12/30 (6.7%)0/30 (0.0%)0/30 (0.0%)
Native FastZstd_L1_disjoint_window_dict✅ 24/30 (80.0%)0/30 (0.0%)4/30 (13.3%)
Native FastGzip_L1✅ 15/30 (50.0%)0/30 (0.0%)12/30 (40.0%)
Native FastBrotli_Q18/30 (26.7%)0/30 (0.0%)✅ 25/30 (83.3%)
Hybrid FastZstd_L15/30 (16.7%)0/30 (0.0%)✅ 25/30 (83.3%)
Hybrid FastZstd_L1_disjoint_window_dict✅ 30/30 (100.0%)2/30 (6.7%)✅ 25/30 (83.3%)
Hybrid FastGzip_L1✅ 28/30 (93.3%)1/30 (3.3%)✅ 27/30 (90.0%)
Hybrid FastBrotli_Q1✅ 27/30 (90.0%)2/30 (6.7%)✅ 29/30 (96.7%)
Native ThinZstd_L9✅ 16/30 (53.3%)2/30 (6.7%)6/30 (20.0%)
Native ThinZstd_L9_disjoint_window_dict✅ 30/30 (100.0%)0/30 (0.0%)6/30 (20.0%)
Native ThinGzip_L9✅ 24/30 (80.0%)0/30 (0.0%)1/30 (3.3%)
Native ThinBrotli_Q9✅ 16/30 (53.3%)9/30 (30.0%)11/30 (36.7%)
Hybrid ThinZstd_L9✅ 25/30 (83.3%)2/30 (6.7%)9/30 (30.0%)
Hybrid ThinZstd_L9_disjoint_window_dict✅ 30/30 (100.0%)0/30 (0.0%)10/30 (33.3%)
Hybrid ThinGzip_L9✅ 25/30 (83.3%)0/30 (0.0%)12/30 (40.0%)
Hybrid ThinBrotli_Q9✅ 20/30 (66.7%)10/30 (33.3%)✅ 16/30 (53.3%)

Three preset comparisons, each with Native and Hybrid

✅ means PIZD is better for that individual measure. Advantage = 100 × (reference − PIZD) / reference. Negative values retain PIZD losses. All decode times include BLAKE3 source verification; every restoration also passes exact-byte and SHA-256 checks outside the timer.

Native / default

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_default47,8839.869
53.1 MB/s		1.492
351.4 MB/s		9.13%———
Zstd_L350,1551.335
392.6 MB/s		0.561
933.9 MB/s		9.57%✅ +4.5%-639.2%-165.8%
Zstd_L3_disjoint_window_dict66,8671.469
356.9 MB/s		0.556
942.5 MB/s		12.76%✅ +28.4%-572.0%-168.2%
Gzip_L650,1747.760
67.6 MB/s		0.902
581.1 MB/s		9.57%✅ +4.6%-27.2%-65.4%
Brotli_Q643,32114.541
36.0 MB/s		1.327
395.0 MB/s		8.26%-10.5%✅ +32.1%-12.4%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_default17,5873.426
70.0 MB/s		0.541
443.3 MB/s		7.34%———
Zstd_L318,6500.482
497.6 MB/s		0.205
1168.8 MB/s		7.78%✅ +5.7%-610.9%-163.6%
Zstd_L3_disjoint_window_dict34,9320.617
388.4 MB/s		0.248
968.0 MB/s		14.57%✅ +49.7%-455.0%-118.3%
Gzip_L618,4622.583
92.8 MB/s		0.306
784.0 MB/s		7.70%✅ +4.7%-32.6%-76.9%
Brotli_Q615,2704.819
49.8 MB/s		0.470
510.7 MB/s		6.37%-15.2%✅ +28.9%-15.2%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_default25,7646.170
85.0 MB/s		1.292
405.8 MB/s		4.92%———
Zstd_L323,4370.738
710.3 MB/s		0.412
1271.0 MB/s		4.47%-9.9%-736.1%-213.2%
Zstd_L3_disjoint_window_dict39,7450.882
594.5 MB/s		0.416
1258.7 MB/s		7.58%✅ +35.2%-599.7%-210.2%
Gzip_L625,7064.214
124.4 MB/s		0.547
958.3 MB/s		4.90%-0.2%-46.4%-136.1%
Brotli_Q618,88810.349
50.7 MB/s		0.689
760.5 MB/s		3.60%-36.4%✅ +40.4%-87.4%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_default9,5824.628
113.3 MB/s		0.723
724.9 MB/s		1.83%———
Zstd_L321,8080.740
708.1 MB/s		0.444
1181.7 MB/s		4.16%✅ +56.1%-525.1%-63.0%
Zstd_L3_disjoint_window_dict38,0140.903
580.8 MB/s		0.445
1177.4 MB/s		7.25%✅ +74.8%-412.7%-62.4%
Gzip_L619,5024.000
131.1 MB/s		0.495
1059.8 MB/s		3.72%✅ +50.9%-15.7%-46.2%
Brotli_Q615,75711.287
46.4 MB/s		0.677
774.2 MB/s		3.01%✅ +39.2%✅ +59.0%-6.8%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_default44,0195.745
91.2 MB/s		0.946
554.2 MB/s		8.40%———
Zstd_L345,5571.158
452.5 MB/s		0.472
1110.0 MB/s		8.69%✅ +3.4%-395.9%-100.3%
Zstd_L3_disjoint_window_dict61,8701.708
307.0 MB/s		0.493
1062.3 MB/s		11.80%✅ +28.9%-236.4%-91.7%
Gzip_L648,1955.755
91.1 MB/s		0.837
626.1 MB/s		9.19%✅ +8.7%✅ +0.2%-13.0%
Brotli_Q640,69513.843
37.9 MB/s		1.124
466.6 MB/s		7.76%-8.2%✅ +58.5%✅ +15.8%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_default18,4234.162
126.0 MB/s		0.782
670.0 MB/s		3.51%———
Zstd_L325,2790.763
686.7 MB/s		0.370
1415.7 MB/s		4.82%✅ +27.1%-445.1%-111.3%
Zstd_L3_disjoint_window_dict41,5960.974
538.4 MB/s		0.394
1330.9 MB/s		7.93%✅ +55.7%-327.4%-98.6%
Gzip_L625,6723.901
134.4 MB/s		0.517
1014.3 MB/s		4.90%✅ +28.2%-6.7%-51.4%
Brotli_Q623,1999.918
52.9 MB/s		0.755
694.7 MB/s		4.43%✅ +20.6%✅ +58.0%-3.7%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_default22,3106.006
87.3 MB/s		1.384
378.8 MB/s		4.26%———
Zstd_L336,7510.996
526.4 MB/s		0.494
1061.9 MB/s		7.01%✅ +39.3%-503.1%-180.4%
Zstd_L3_disjoint_window_dict53,5571.151
455.6 MB/s		0.513
1021.7 MB/s		10.22%✅ +58.3%-422.0%-169.7%
Gzip_L635,5225.883
89.1 MB/s		0.677
774.3 MB/s		6.78%✅ +37.2%-2.1%-104.4%
Brotli_Q630,68614.218
36.9 MB/s		1.004
522.0 MB/s		5.85%✅ +27.3%✅ +57.8%-37.8%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_default43,4966.486
80.8 MB/s		1.280
409.6 MB/s		8.30%———
Zstd_L347,7101.193
439.6 MB/s		0.543
964.9 MB/s		9.10%✅ +8.8%-443.9%-135.5%
Zstd_L3_disjoint_window_dict64,1811.600
327.6 MB/s		0.579
905.9 MB/s		12.24%✅ +32.2%-305.3%-121.1%
Gzip_L650,6287.213
72.7 MB/s		0.867
604.9 MB/s		9.66%✅ +14.1%✅ +10.1%-47.7%
Brotli_Q640,47214.659
35.8 MB/s		1.186
442.2 MB/s		7.72%-7.5%✅ +55.8%-7.9%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_default17,7874.574
114.6 MB/s		1.016
516.0 MB/s		3.39%———
Zstd_L320,3400.659
795.7 MB/s		0.381
1377.5 MB/s		3.88%✅ +12.6%-594.3%-167.0%
Zstd_L3_disjoint_window_dict36,8540.885
592.0 MB/s		0.422
1242.4 MB/s		7.03%✅ +51.7%-416.6%-140.8%
Gzip_L622,8163.924
133.6 MB/s		0.520
1009.0 MB/s		4.35%✅ +22.0%-16.5%-95.5%
Brotli_Q615,2319.713
54.0 MB/s		0.900
582.8 MB/s		2.91%-16.8%✅ +52.9%-12.9%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_default32,7605.423
96.7 MB/s		1.353
387.4 MB/s		6.25%———
Zstd_L337,1131.002
523.4 MB/s		0.495
1058.8 MB/s		7.08%✅ +11.7%-441.5%-173.3%
Zstd_L3_disjoint_window_dict53,6681.215
431.5 MB/s		0.522
1004.2 MB/s		10.24%✅ +39.0%-346.5%-159.2%
Gzip_L642,1146.666
78.6 MB/s		0.749
699.3 MB/s		8.03%✅ +22.2%✅ +18.7%-80.5%
Brotli_Q631,18213.530
38.7 MB/s		1.000
524.0 MB/s		5.95%-5.1%✅ +59.9%-35.3%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_default23,3565.344
98.1 MB/s		0.761
688.8 MB/s		4.46%———
Zstd_L333,1020.934
561.4 MB/s		0.551
951.2 MB/s		6.31%✅ +29.4%-472.3%-38.1%
Zstd_L3_disjoint_window_dict49,2731.077
486.6 MB/s		0.519
1010.1 MB/s		9.40%✅ +52.6%-396.0%-46.6%
Gzip_L637,0154.696
111.6 MB/s		0.692
757.2 MB/s		7.06%✅ +36.9%-13.8%-9.9%
Brotli_Q626,06211.433
45.9 MB/s		1.044
502.2 MB/s		4.97%✅ +10.4%✅ +53.3%✅ +27.1%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_default42,3086.369
82.3 MB/s		1.422
368.6 MB/s		8.07%———
Zstd_L354,8241.296
404.5 MB/s		0.560
935.7 MB/s		10.46%✅ +22.8%-391.4%-153.8%
Zstd_L3_disjoint_window_dict71,0401.774
295.6 MB/s		0.605
867.2 MB/s		13.55%✅ +40.4%-259.1%-135.2%
Gzip_L699,45712.087
43.4 MB/s		1.471
356.3 MB/s		18.97%✅ +57.5%✅ +47.3%✅ +3.3%
Brotli_Q645,18914.865
35.3 MB/s		1.186
441.9 MB/s		8.62%✅ +6.4%✅ +57.2%-19.9%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_default36,40912.846
40.8 MB/s		1.426
367.8 MB/s		6.94%———
Zstd_L347,0751.223
428.7 MB/s		0.583
898.5 MB/s		8.98%✅ +22.7%-950.6%-144.3%
Zstd_L3_disjoint_window_dict63,5301.508
347.7 MB/s		0.624
840.1 MB/s		12.12%✅ +42.7%-752.1%-128.4%
Gzip_L642,9956.922
75.7 MB/s		0.836
626.8 MB/s		8.20%✅ +15.3%-85.6%-70.4%
Brotli_Q636,90815.102
34.7 MB/s		1.107
473.4 MB/s		7.04%✅ +1.4%✅ +14.9%-28.7%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_default26,2946.456
81.2 MB/s		1.495
350.8 MB/s		5.02%———
Zstd_L335,0451.171
447.5 MB/s		0.449
1166.3 MB/s		6.69%✅ +25.0%-451.1%-232.5%
Zstd_L3_disjoint_window_dict51,4511.134
462.3 MB/s		0.462
1134.1 MB/s		9.81%✅ +48.9%-469.3%-223.3%
Gzip_L634,3094.793
109.4 MB/s		0.633
827.8 MB/s		6.54%✅ +23.4%-34.7%-136.0%
Brotli_Q628,93311.422
45.9 MB/s		0.951
551.2 MB/s		5.52%✅ +9.1%✅ +43.5%-57.1%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_default17,6185.261
99.6 MB/s		1.222
428.9 MB/s		3.36%———
Zstd_L335,5410.954
549.5 MB/s		0.480
1092.9 MB/s		6.78%✅ +50.4%-451.5%-154.8%
Zstd_L3_disjoint_window_dict52,1231.192
439.9 MB/s		0.543
965.1 MB/s		9.94%✅ +66.2%-341.5%-125.0%
Gzip_L633,4506.688
78.4 MB/s		0.614
854.2 MB/s		6.38%✅ +47.3%✅ +21.3%-99.2%
Brotli_Q627,10414.275
36.7 MB/s		0.865
605.8 MB/s		5.17%✅ +35.0%✅ +63.1%-41.2%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_default27,9786.323
82.9 MB/s		0.935
560.5 MB/s		5.34%———
Zstd_L332,2910.912
574.7 MB/s		0.455
1152.6 MB/s		6.16%✅ +13.4%-593.2%-105.6%
Zstd_L3_disjoint_window_dict48,8361.084
483.7 MB/s		0.484
1084.2 MB/s		9.32%✅ +42.7%-483.4%-93.4%
Gzip_L627,5825.244
100.0 MB/s		0.660
794.5 MB/s		5.26%-1.4%-20.6%-41.7%
Brotli_Q625,46410.725
48.9 MB/s		0.972
539.1 MB/s		4.86%-9.9%✅ +41.0%✅ +3.8%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_default8010.353
9.0 MB/s		0.020
161.1 MB/s		25.21%———
Zstd_L36680.059
53.6 MB/s		0.012
269.5 MB/s		21.03%-19.9%-495.8%-67.3%
Zstd_L3_disjoint_window_dict17,0070.101
31.3 MB/s		0.019
169.4 MB/s		535.32%✅ +95.3%-248.5%-5.2%
Gzip_L66340.057
55.9 MB/s		0.018
175.2 MB/s		19.96%-26.3%-521.4%-8.7%
Brotli_Q65920.229
13.8 MB/s		0.030
107.1 MB/s		18.63%-35.3%-54.0%✅ +33.5%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_default6780.279
5.8 MB/s		0.015
108.6 MB/s		42.06%———
Zstd_L35450.052
31.2 MB/s		0.008
209.8 MB/s		33.81%-24.4%-439.9%-93.2%
Zstd_L3_disjoint_window_dict16,9080.107
15.1 MB/s		0.017
96.9 MB/s		1048.88%✅ +96.0%-161.1%✅ +10.8%
Gzip_L65410.048
33.4 MB/s		0.015
107.6 MB/s		33.56%-25.3%-477.2%✅ +0.9%
Brotli_Q64740.195
8.3 MB/s		0.026
62.6 MB/s		29.40%-43.0%-43.2%✅ +42.3%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_default3,1001.955
11.9 MB/s		0.107
217.3 MB/s		13.30%———
Zstd_L32,7540.103
225.3 MB/s		0.033
697.1 MB/s		11.81%-12.6%-1789.3%-220.8%
Zstd_L3_disjoint_window_dict19,1390.157
148.8 MB/s		0.047
496.6 MB/s		82.10%✅ +83.8%-1148.4%-128.6%
Gzip_L62,6600.279
83.5 MB/s		0.052
444.2 MB/s		11.41%-16.5%-600.2%-104.5%
Brotli_Q62,3950.585
39.9 MB/s		0.084
277.6 MB/s		10.27%-29.4%-234.5%-27.8%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_default2,9940.567
14.5 MB/s		0.048
170.4 MB/s		36.47%———
Zstd_L32,4550.086
95.7 MB/s		0.018
449.2 MB/s		29.90%-22.0%-561.5%-163.7%
Zstd_L3_disjoint_window_dict18,8520.140
58.5 MB/s		0.028
292.9 MB/s		229.62%✅ +84.1%-303.9%-71.9%
Gzip_L62,3400.154
53.2 MB/s		0.040
207.7 MB/s		28.50%-27.9%-267.8%-21.9%
Brotli_Q62,1580.434
18.9 MB/s		0.071
115.6 MB/s		26.29%-38.7%-30.8%✅ +32.2%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_default1,8840.767
5.9 MB/s		0.033
136.4 MB/s		41.85%———
Zstd_L31,5650.073
61.4 MB/s		0.014
324.5 MB/s		34.76%-20.4%-946.3%-137.9%
Zstd_L3_disjoint_window_dict17,8960.122
36.9 MB/s		0.024
191.3 MB/s		397.51%✅ +89.5%-529.2%-40.3%
Gzip_L61,4800.094
47.9 MB/s		0.026
176.2 MB/s		32.87%-27.3%-715.6%-29.2%
Brotli_Q61,3780.302
14.9 MB/s		0.049
92.7 MB/s		30.61%-36.7%-154.2%✅ +32.0%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_default1,7575.922
88.5 MB/s		0.949
552.2 MB/s		0.34%———
Zstd_L38,1480.591
887.3 MB/s		0.360
1455.6 MB/s		1.55%✅ +78.4%-902.3%-163.6%
Zstd_L3_disjoint_window_dict24,5650.667
785.4 MB/s		0.374
1400.8 MB/s		4.69%✅ +92.8%-787.2%-153.7%
Gzip_L615,4592.561
204.7 MB/s		0.411
1274.4 MB/s		2.95%✅ +88.6%-131.2%-130.8%
Brotli_Q68,12511.188
46.9 MB/s		0.581
903.1 MB/s		1.55%✅ +78.4%✅ +47.1%-63.5%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_default1,7140.707
7.0 MB/s		0.031
160.9 MB/s		34.66%———
Zstd_L31,3850.065
75.8 MB/s		0.013
375.1 MB/s		28.01%-23.8%-984.8%-133.1%
Zstd_L3_disjoint_window_dict17,7430.116
42.7 MB/s		0.022
224.1 MB/s		358.81%✅ +90.3%-511.5%-39.3%
Gzip_L61,3050.094
52.6 MB/s		0.024
202.1 MB/s		26.39%-31.3%-653.0%-25.6%
Brotli_Q61,2080.296
16.7 MB/s		0.042
118.9 MB/s		24.43%-41.9%-139.1%✅ +26.1%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_default1,0640.129
12.9 MB/s		0.016
102.3 MB/s		63.90%———
Zstd_L39010.057
29.1 MB/s		0.008
199.5 MB/s		54.11%-18.1%-124.8%-95.1%
Zstd_L3_disjoint_window_dict17,2820.104
16.0 MB/s		0.017
96.3 MB/s		1037.96%✅ +93.8%-23.7%✅ +5.8%
Gzip_L69050.056
29.7 MB/s		0.017
96.7 MB/s		54.35%-17.6%-129.6%✅ +5.5%
Brotli_Q68510.243
6.8 MB/s		0.030
56.1 MB/s		51.11%-25.0%✅ +47.1%✅ +45.1%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_default37,05610.565
49.6 MB/s		1.553
337.5 MB/s		7.07%———
Zstd_L356,1011.970
266.1 MB/s		0.636
823.7 MB/s		10.70%✅ +33.9%-436.3%-144.0%
Zstd_L3_disjoint_window_dict72,7151.613
325.1 MB/s		0.662
791.5 MB/s		13.87%✅ +49.0%-555.1%-134.5%
Gzip_L651,2117.916
66.2 MB/s		0.849
617.3 MB/s		9.77%✅ +27.6%-33.5%-82.9%
Brotli_Q645,27614.685
35.7 MB/s		1.072
489.2 MB/s		8.64%✅ +18.2%✅ +28.1%-44.9%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_default38,1038.468
61.9 MB/s		1.453
360.8 MB/s		7.27%———
Zstd_L356,5001.307
401.0 MB/s		0.600
874.3 MB/s		10.78%✅ +32.6%-547.7%-142.3%
Zstd_L3_disjoint_window_dict73,0851.563
335.3 MB/s		0.621
844.4 MB/s		13.94%✅ +47.9%-441.7%-134.0%
Gzip_L651,7607.396
70.9 MB/s		0.870
602.5 MB/s		9.87%✅ +26.4%-14.5%-67.0%
Brotli_Q645,75414.491
36.2 MB/s		1.077
486.8 MB/s		8.73%✅ +16.7%✅ +41.6%-34.9%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_default81,59812.196
42.9 MB/s		1.271
412.2 MB/s		15.58%———
Zstd_L374,9781.577
332.0 MB/s		0.548
955.2 MB/s		14.32%-8.8%-673.2%-131.7%
Zstd_L3_disjoint_window_dict91,4942.320
225.7 MB/s		0.592
885.1 MB/s		17.47%✅ +10.8%-425.6%-114.7%
Gzip_L682,9279.528
55.0 MB/s		1.183
442.6 MB/s		15.83%✅ +1.6%-28.0%-7.4%
Brotli_Q668,87317.214
30.4 MB/s		1.561
335.5 MB/s		13.15%-18.5%✅ +29.1%✅ +18.6%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_default75,23812.915
40.6 MB/s		1.467
357.1 MB/s		14.37%———
Zstd_L370,8421.463
358.1 MB/s		0.505
1036.5 MB/s		13.53%-6.2%-783.0%-190.2%
Zstd_L3_disjoint_window_dict86,9872.044
256.2 MB/s		0.551
950.1 MB/s		16.61%✅ +13.5%-531.8%-166.1%
Gzip_L677,7418.502
61.6 MB/s		1.130
463.5 MB/s		14.84%✅ +3.2%-51.9%-29.8%
Brotli_Q665,43116.147
32.4 MB/s		1.440
363.7 MB/s		12.49%-15.0%✅ +20.0%-1.8%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_default71,61112.699
41.0 MB/s		1.346
386.7 MB/s		13.76%———
Zstd_L368,0861.203
432.8 MB/s		0.442
1178.6 MB/s		13.08%-5.2%-955.8%-204.8%
Zstd_L3_disjoint_window_dict84,5222.069
251.5 MB/s		0.540
963.5 MB/s		16.24%✅ +15.3%-513.7%-149.2%
Gzip_L675,8737.668
67.9 MB/s		0.926
562.1 MB/s		14.58%✅ +5.6%-65.6%-45.4%
Brotli_Q662,02812.813
40.6 MB/s		1.247
417.3 MB/s		11.92%-15.4%✅ +0.9%-7.9%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_default76,43113.233
39.6 MB/s		1.322
396.1 MB/s		14.59%———
Zstd_L371,2241.465
357.5 MB/s		0.535
979.2 MB/s		13.60%-7.3%-803.1%-147.2%
Zstd_L3_disjoint_window_dict87,6842.196
238.5 MB/s		0.578
905.7 MB/s		16.74%✅ +12.8%-502.5%-128.6%
Gzip_L680,4839.390
55.8 MB/s		1.166
449.1 MB/s		15.36%✅ +5.0%-40.9%-13.4%
Brotli_Q665,63616.616
31.5 MB/s		1.519
344.9 MB/s		12.53%-16.4%✅ +20.4%✅ +12.9%

Hybrid / default

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_default42,9375.806
90.3 MB/s		0.835
627.8 MB/s		8.19%———
Zstd_L350,1551.335
392.6 MB/s		0.561
933.9 MB/s		9.57%✅ +14.4%-334.9%-48.8%
Zstd_L3_disjoint_window_dict66,8671.469
356.9 MB/s		0.556
942.5 MB/s		12.76%✅ +35.8%-295.3%-50.1%
Gzip_L650,1747.760
67.6 MB/s		0.902
581.1 MB/s		9.57%✅ +14.4%✅ +25.2%✅ +7.4%
Brotli_Q643,32114.541
36.0 MB/s		1.327
395.0 MB/s		8.26%✅ +0.9%✅ +60.1%✅ +37.1%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_default17,9582.655
90.3 MB/s		0.376
638.2 MB/s		7.49%———
Zstd_L318,6500.482
497.6 MB/s		0.205
1168.8 MB/s		7.78%✅ +3.7%-450.9%-83.1%
Zstd_L3_disjoint_window_dict34,9320.617
388.4 MB/s		0.248
968.0 MB/s		14.57%✅ +48.6%-330.1%-51.7%
Gzip_L618,4622.583
92.8 MB/s		0.306
784.0 MB/s		7.70%✅ +2.7%-2.8%-22.8%
Brotli_Q615,2704.819
49.8 MB/s		0.470
510.7 MB/s		6.37%-17.6%✅ +44.9%✅ +20.0%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_default24,2324.358
120.3 MB/s		0.934
561.1 MB/s		4.62%———
Zstd_L323,4370.738
710.3 MB/s		0.412
1271.0 MB/s		4.47%-3.4%-490.6%-126.5%
Zstd_L3_disjoint_window_dict39,7450.882
594.5 MB/s		0.416
1258.7 MB/s		7.58%✅ +39.0%-394.3%-124.3%
Gzip_L625,7064.214
124.4 MB/s		0.547
958.3 MB/s		4.90%✅ +5.7%-3.4%-70.8%
Brotli_Q618,88810.349
50.7 MB/s		0.689
760.5 MB/s		3.60%-28.3%✅ +57.9%-35.5%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_default9,2573.712
141.2 MB/s		0.601
871.8 MB/s		1.77%———
Zstd_L321,8080.740
708.1 MB/s		0.444
1181.7 MB/s		4.16%✅ +57.6%-401.4%-35.6%
Zstd_L3_disjoint_window_dict38,0140.903
580.8 MB/s		0.445
1177.4 MB/s		7.25%✅ +75.6%-311.3%-35.1%
Gzip_L619,5024.000
131.1 MB/s		0.495
1059.8 MB/s		3.72%✅ +52.5%✅ +7.2%-21.6%
Brotli_Q615,75711.287
46.4 MB/s		0.677
774.2 MB/s		3.01%✅ +41.3%✅ +67.1%✅ +11.2%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_default42,6813.708
141.4 MB/s		0.587
892.6 MB/s		8.14%———
Zstd_L345,5571.158
452.5 MB/s		0.472
1110.0 MB/s		8.69%✅ +6.3%-220.1%-24.3%
Zstd_L3_disjoint_window_dict61,8701.708
307.0 MB/s		0.493
1062.3 MB/s		11.80%✅ +31.0%-117.1%-19.0%
Gzip_L648,1955.755
91.1 MB/s		0.837
626.1 MB/s		9.19%✅ +11.4%✅ +35.6%✅ +29.9%
Brotli_Q640,69513.843
37.9 MB/s		1.124
466.6 MB/s		7.76%-4.9%✅ +73.2%✅ +47.7%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_default19,4683.111
168.5 MB/s		0.561
934.9 MB/s		3.71%———
Zstd_L325,2790.763
686.7 MB/s		0.370
1415.7 MB/s		4.82%✅ +23.0%-307.6%-51.4%
Zstd_L3_disjoint_window_dict41,5960.974
538.4 MB/s		0.394
1330.9 MB/s		7.93%✅ +53.2%-219.5%-42.4%
Gzip_L625,6723.901
134.4 MB/s		0.517
1014.3 MB/s		4.90%✅ +24.2%✅ +20.2%-8.5%
Brotli_Q623,1999.918
52.9 MB/s		0.755
694.7 MB/s		4.43%✅ +16.1%✅ +68.6%✅ +25.7%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_default22,8384.801
109.2 MB/s		0.933
561.8 MB/s		4.36%———
Zstd_L336,7510.996
526.4 MB/s		0.494
1061.9 MB/s		7.01%✅ +37.9%-382.1%-89.0%
Zstd_L3_disjoint_window_dict53,5571.151
455.6 MB/s		0.513
1021.7 MB/s		10.22%✅ +57.4%-317.3%-81.9%
Gzip_L635,5225.883
89.1 MB/s		0.677
774.3 MB/s		6.78%✅ +35.7%✅ +18.4%-37.8%
Brotli_Q630,68614.218
36.9 MB/s		1.004
522.0 MB/s		5.85%✅ +25.6%✅ +66.2%✅ +7.1%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_default41,4864.793
109.4 MB/s		0.770
681.1 MB/s		7.91%———
Zstd_L347,7101.193
439.6 MB/s		0.543
964.9 MB/s		9.10%✅ +13.0%-301.9%-41.7%
Zstd_L3_disjoint_window_dict64,1811.600
327.6 MB/s		0.579
905.9 MB/s		12.24%✅ +35.4%-199.5%-33.0%
Gzip_L650,6287.213
72.7 MB/s		0.867
604.9 MB/s		9.66%✅ +18.1%✅ +33.5%✅ +11.2%
Brotli_Q640,47214.659
35.8 MB/s		1.186
442.2 MB/s		7.72%-2.5%✅ +67.3%✅ +35.1%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_default17,5723.746
140.0 MB/s		0.674
778.1 MB/s		3.35%———
Zstd_L320,3400.659
795.7 MB/s		0.381
1377.5 MB/s		3.88%✅ +13.6%-468.6%-77.0%
Zstd_L3_disjoint_window_dict36,8540.885
592.0 MB/s		0.422
1242.4 MB/s		7.03%✅ +52.3%-323.0%-59.7%
Gzip_L622,8163.924
133.6 MB/s		0.520
1009.0 MB/s		4.35%✅ +23.0%✅ +4.6%-29.7%
Brotli_Q615,2319.713
54.0 MB/s		0.900
582.8 MB/s		2.91%-15.4%✅ +61.4%✅ +25.1%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_default33,6393.939
133.1 MB/s		0.797
657.7 MB/s		6.42%———
Zstd_L337,1131.002
523.4 MB/s		0.495
1058.8 MB/s		7.08%✅ +9.4%-293.3%-61.0%
Zstd_L3_disjoint_window_dict53,6681.215
431.5 MB/s		0.522
1004.2 MB/s		10.24%✅ +37.3%-224.3%-52.7%
Gzip_L642,1146.666
78.6 MB/s		0.749
699.3 MB/s		8.03%✅ +20.1%✅ +40.9%-6.3%
Brotli_Q631,18213.530
38.7 MB/s		1.000
524.0 MB/s		5.95%-7.9%✅ +70.9%✅ +20.3%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_default22,9994.297
122.0 MB/s		0.552
950.5 MB/s		4.39%———
Zstd_L333,1020.934
561.4 MB/s		0.551
951.2 MB/s		6.31%✅ +30.5%-360.1%-0.1%
Zstd_L3_disjoint_window_dict49,2731.077
486.6 MB/s		0.519
1010.1 MB/s		9.40%✅ +53.3%-298.8%-6.3%
Gzip_L637,0154.696
111.6 MB/s		0.692
757.2 MB/s		7.06%✅ +37.9%✅ +8.5%✅ +20.3%
Brotli_Q626,06211.433
45.9 MB/s		1.044
502.2 MB/s		4.97%✅ +11.8%✅ +62.4%✅ +47.2%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_default44,2074.235
123.8 MB/s		1.221
429.5 MB/s		8.43%———
Zstd_L354,8241.296
404.5 MB/s		0.560
935.7 MB/s		10.46%✅ +19.4%-226.7%-117.9%
Zstd_L3_disjoint_window_dict71,0401.774
295.6 MB/s		0.605
867.2 MB/s		13.55%✅ +37.8%-138.8%-101.9%
Gzip_L699,45712.087
43.4 MB/s		1.471
356.3 MB/s		18.97%✅ +55.6%✅ +65.0%✅ +17.0%
Brotli_Q645,18914.865
35.3 MB/s		1.186
441.9 MB/s		8.62%✅ +2.2%✅ +71.5%-2.9%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_default36,63715.218
34.5 MB/s		0.966
542.4 MB/s		6.99%———
Zstd_L347,0751.223
428.7 MB/s		0.583
898.5 MB/s		8.98%✅ +22.2%-1144.5%-65.7%
Zstd_L3_disjoint_window_dict63,5301.508
347.7 MB/s		0.624
840.1 MB/s		12.12%✅ +42.3%-909.4%-54.9%
Gzip_L642,9956.922
75.7 MB/s		0.836
626.8 MB/s		8.20%✅ +14.8%-119.8%-15.6%
Brotli_Q636,90815.102
34.7 MB/s		1.107
473.4 MB/s		7.04%✅ +0.7%-0.8%✅ +12.7%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_default27,6195.132
102.2 MB/s		1.208
434.0 MB/s		5.27%———
Zstd_L335,0451.171
447.5 MB/s		0.449
1166.3 MB/s		6.69%✅ +21.2%-338.0%-168.7%
Zstd_L3_disjoint_window_dict51,4511.134
462.3 MB/s		0.462
1134.1 MB/s		9.81%✅ +46.3%-352.5%-161.3%
Gzip_L634,3094.793
109.4 MB/s		0.633
827.8 MB/s		6.54%✅ +19.5%-7.1%-90.7%
Brotli_Q628,93311.422
45.9 MB/s		0.951
551.2 MB/s		5.52%✅ +4.5%✅ +55.1%-27.0%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_default18,2504.151
126.3 MB/s		0.781
671.1 MB/s		3.48%———
Zstd_L335,5410.954
549.5 MB/s		0.480
1092.9 MB/s		6.78%✅ +48.7%-335.1%-62.9%
Zstd_L3_disjoint_window_dict52,1231.192
439.9 MB/s		0.543
965.1 MB/s		9.94%✅ +65.0%-248.4%-43.8%
Gzip_L633,4506.688
78.4 MB/s		0.614
854.2 MB/s		6.38%✅ +45.4%✅ +37.9%-27.3%
Brotli_Q627,10414.275
36.7 MB/s		0.865
605.8 MB/s		5.17%✅ +32.7%✅ +70.9%✅ +9.7%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_default27,8054.550
115.2 MB/s		0.642
816.8 MB/s		5.30%———
Zstd_L332,2910.912
574.7 MB/s		0.455
1152.6 MB/s		6.16%✅ +13.9%-398.8%-41.1%
Zstd_L3_disjoint_window_dict48,8361.084
483.7 MB/s		0.484
1084.2 MB/s		9.32%✅ +43.1%-319.8%-32.7%
Gzip_L627,5825.244
100.0 MB/s		0.660
794.5 MB/s		5.26%-0.8%✅ +13.2%✅ +2.7%
Brotli_Q625,46410.725
48.9 MB/s		0.972
539.1 MB/s		4.86%-9.2%✅ +57.6%✅ +34.0%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_default6840.221
14.4 MB/s		0.009
358.3 MB/s		21.53%———
Zstd_L36680.059
53.6 MB/s		0.012
269.5 MB/s		21.03%-2.4%-272.7%✅ +24.8%
Zstd_L3_disjoint_window_dict17,0070.101
31.3 MB/s		0.019
169.4 MB/s		535.32%✅ +96.0%-118.1%✅ +52.7%
Gzip_L66340.057
55.9 MB/s		0.018
175.2 MB/s		19.96%-7.9%-288.7%✅ +51.1%
Brotli_Q65920.229
13.8 MB/s		0.030
107.1 MB/s		18.63%-15.5%✅ +3.6%✅ +70.1%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_default5720.060
26.9 MB/s		0.006
273.4 MB/s		35.48%———
Zstd_L35450.052
31.2 MB/s		0.008
209.8 MB/s		33.81%-5.0%-16.2%✅ +23.2%
Zstd_L3_disjoint_window_dict16,9080.107
15.1 MB/s		0.017
96.9 MB/s		1048.88%✅ +96.6%✅ +43.8%✅ +64.5%
Gzip_L65410.048
33.4 MB/s		0.015
107.6 MB/s		33.56%-5.7%-24.2%✅ +60.6%
Brotli_Q64740.195
8.3 MB/s		0.026
62.6 MB/s		29.40%-20.7%✅ +69.2%✅ +77.1%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_default2,8291.355
17.2 MB/s		0.030
784.6 MB/s		12.14%———
Zstd_L32,7540.103
225.3 MB/s		0.033
697.1 MB/s		11.81%-2.7%-1209.0%✅ +11.2%
Zstd_L3_disjoint_window_dict19,1390.157
148.8 MB/s		0.047
496.6 MB/s		82.10%✅ +85.2%-764.9%✅ +36.7%
Gzip_L62,6600.279
83.5 MB/s		0.052
444.2 MB/s		11.41%-6.4%-385.1%✅ +43.4%
Brotli_Q62,3950.585
39.9 MB/s		0.084
277.6 MB/s		10.27%-18.1%-131.8%✅ +64.6%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_default2,6630.303
27.1 MB/s		0.015
565.8 MB/s		32.44%———
Zstd_L32,4550.086
95.7 MB/s		0.018
449.2 MB/s		29.90%-8.5%-253.2%✅ +20.6%
Zstd_L3_disjoint_window_dict18,8520.140
58.5 MB/s		0.028
292.9 MB/s		229.62%✅ +85.9%-115.7%✅ +48.2%
Gzip_L62,3400.154
53.2 MB/s		0.040
207.7 MB/s		28.50%-13.8%-96.4%✅ +63.3%
Brotli_Q62,1580.434
18.9 MB/s		0.071
115.6 MB/s		26.29%-23.4%✅ +30.2%✅ +79.6%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_default1,6450.369
12.2 MB/s		0.012
366.8 MB/s		36.54%———
Zstd_L31,5650.073
61.4 MB/s		0.014
324.5 MB/s		34.76%-5.1%-403.0%✅ +11.5%
Zstd_L3_disjoint_window_dict17,8960.122
36.9 MB/s		0.024
191.3 MB/s		397.51%✅ +90.8%-202.5%✅ +47.8%
Gzip_L61,4800.094
47.9 MB/s		0.026
176.2 MB/s		32.87%-11.1%-292.1%✅ +52.0%
Brotli_Q61,3780.302
14.9 MB/s		0.049
92.7 MB/s		30.61%-19.4%-22.2%✅ +74.7%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_default1,4583.777
138.8 MB/s		0.924
567.3 MB/s		0.28%———
Zstd_L38,1480.591
887.3 MB/s		0.360
1455.6 MB/s		1.55%✅ +82.1%-539.1%-156.6%
Zstd_L3_disjoint_window_dict24,5650.667
785.4 MB/s		0.374
1400.8 MB/s		4.69%✅ +94.1%-465.8%-146.9%
Gzip_L615,4592.561
204.7 MB/s		0.411
1274.4 MB/s		2.95%✅ +90.6%-47.4%-124.6%
Brotli_Q68,12511.188
46.9 MB/s		0.581
903.1 MB/s		1.55%✅ +82.1%✅ +66.2%-59.2%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_default1,4670.336
14.7 MB/s		0.012
421.4 MB/s		29.67%———
Zstd_L31,3850.065
75.8 MB/s		0.013
375.1 MB/s		28.01%-5.9%-415.8%✅ +11.0%
Zstd_L3_disjoint_window_dict17,7430.116
42.7 MB/s		0.022
224.1 MB/s		358.81%✅ +91.7%-190.7%✅ +46.8%
Gzip_L61,3050.094
52.6 MB/s		0.024
202.1 MB/s		26.39%-12.4%-258.0%✅ +52.0%
Brotli_Q61,2080.296
16.7 MB/s		0.042
118.9 MB/s		24.43%-21.4%-13.7%✅ +71.8%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_default9410.060
27.7 MB/s		0.007
253.6 MB/s		56.52%———
Zstd_L39010.057
29.1 MB/s		0.008
199.5 MB/s		54.11%-4.4%-5.1%✅ +21.3%
Zstd_L3_disjoint_window_dict17,2820.104
16.0 MB/s		0.017
96.3 MB/s		1037.96%✅ +94.6%✅ +42.2%✅ +62.0%
Gzip_L69050.056
29.7 MB/s		0.017
96.7 MB/s		54.35%-4.0%-7.3%✅ +61.9%
Brotli_Q68510.243
6.8 MB/s		0.030
56.1 MB/s		51.11%-10.6%✅ +75.3%✅ +77.9%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_default37,7578.688
60.3 MB/s		1.229
426.5 MB/s		7.20%———
Zstd_L356,1011.970
266.1 MB/s		0.636
823.7 MB/s		10.70%✅ +32.7%-341.0%-93.1%
Zstd_L3_disjoint_window_dict72,7151.613
325.1 MB/s		0.662
791.5 MB/s		13.87%✅ +48.1%-438.7%-85.6%
Gzip_L651,2117.916
66.2 MB/s		0.849
617.3 MB/s		9.77%✅ +26.3%-9.8%-44.7%
Brotli_Q645,27614.685
35.7 MB/s		1.072
489.2 MB/s		8.64%✅ +16.6%✅ +40.8%-14.7%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_default39,0806.833
76.7 MB/s		1.119
468.4 MB/s		7.45%———
Zstd_L356,5001.307
401.0 MB/s		0.600
874.3 MB/s		10.78%✅ +30.8%-422.6%-86.7%
Zstd_L3_disjoint_window_dict73,0851.563
335.3 MB/s		0.621
844.4 MB/s		13.94%✅ +46.5%-337.1%-80.3%
Gzip_L651,7607.396
70.9 MB/s		0.870
602.5 MB/s		9.87%✅ +24.5%✅ +7.6%-28.6%
Brotli_Q645,75414.491
36.2 MB/s		1.077
486.8 MB/s		8.73%✅ +14.6%✅ +52.8%-3.9%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_default78,89711.625
45.1 MB/s		0.473
1108.2 MB/s		15.06%———
Zstd_L374,9781.577
332.0 MB/s		0.548
955.2 MB/s		14.32%-5.2%-637.0%✅ +13.8%
Zstd_L3_disjoint_window_dict91,4942.320
225.7 MB/s		0.592
885.1 MB/s		17.47%✅ +13.8%-401.0%✅ +20.1%
Gzip_L682,9279.528
55.0 MB/s		1.183
442.6 MB/s		15.83%✅ +4.9%-22.0%✅ +60.1%
Brotli_Q668,87317.214
30.4 MB/s		1.561
335.5 MB/s		13.15%-14.6%✅ +32.5%✅ +69.7%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_default72,6655.466
95.8 MB/s		0.693
755.4 MB/s		13.87%———
Zstd_L370,8421.463
358.1 MB/s		0.505
1036.5 MB/s		13.53%-2.6%-273.7%-37.2%
Zstd_L3_disjoint_window_dict86,9872.044
256.2 MB/s		0.551
950.1 MB/s		16.61%✅ +16.5%-167.4%-25.8%
Gzip_L677,7418.502
61.6 MB/s		1.130
463.5 MB/s		14.84%✅ +6.5%✅ +35.7%✅ +38.6%
Brotli_Q665,43116.147
32.4 MB/s		1.440
363.7 MB/s		12.49%-11.1%✅ +66.2%✅ +51.9%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_default71,10711.168
46.6 MB/s		0.446
1167.8 MB/s		13.66%———
Zstd_L368,0861.203
432.8 MB/s		0.442
1178.6 MB/s		13.08%-4.4%-828.5%-0.9%
Zstd_L3_disjoint_window_dict84,5222.069
251.5 MB/s		0.540
963.5 MB/s		16.24%✅ +15.9%-439.7%✅ +17.5%
Gzip_L675,8737.668
67.9 MB/s		0.926
562.1 MB/s		14.58%✅ +6.3%-45.6%✅ +51.9%
Brotli_Q662,02812.813
40.6 MB/s		1.247
417.3 MB/s		11.92%-14.6%✅ +12.8%✅ +64.3%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_default74,14312.555
41.7 MB/s		0.451
1161.5 MB/s		14.15%———
Zstd_L371,2241.465
357.5 MB/s		0.535
979.2 MB/s		13.60%-4.1%-756.8%✅ +15.7%
Zstd_L3_disjoint_window_dict87,6842.196
238.5 MB/s		0.578
905.7 MB/s		16.74%✅ +15.4%-471.6%✅ +22.0%
Gzip_L680,4839.390
55.8 MB/s		1.166
449.1 MB/s		15.36%✅ +7.9%-33.7%✅ +61.3%
Brotli_Q665,63616.616
31.5 MB/s		1.519
344.9 MB/s		12.53%-13.0%✅ +24.4%✅ +70.3%

Native / fast

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_fast72,4225.351
98.0 MB/s		1.431
366.4 MB/s		13.82%———
Zstd_L149,6811.320
397.0 MB/s		0.638
821.7 MB/s		9.48%-45.8%-305.2%-124.3%
Zstd_L1_disjoint_window_dict66,8701.372
382.0 MB/s		0.653
803.1 MB/s		12.76%-8.3%-289.9%-119.2%
Gzip_L177,3061.844
284.3 MB/s		1.157
452.9 MB/s		14.75%✅ +6.3%-190.2%-23.6%
Brotli_Q154,2511.986
264.0 MB/s		2.440
214.8 MB/s		10.35%-33.5%-169.4%✅ +41.4%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_fast27,6172.319
103.4 MB/s		0.411
583.3 MB/s		11.52%———
Zstd_L118,4570.514
466.6 MB/s		0.277
864.2 MB/s		7.70%-49.6%-351.3%-48.2%
Zstd_L1_disjoint_window_dict35,0650.682
351.8 MB/s		0.269
890.2 MB/s		14.62%✅ +21.2%-240.3%-52.6%
Gzip_L125,7020.603
397.7 MB/s		0.382
627.3 MB/s		10.72%-7.5%-284.7%-7.5%
Brotli_Q120,2861.215
197.3 MB/s		0.624
384.5 MB/s		8.46%-36.1%-90.9%✅ +34.1%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_fast35,9642.724
192.5 MB/s		0.649
807.2 MB/s		6.86%———
Zstd_L123,6460.894
586.2 MB/s		0.433
1210.4 MB/s		4.51%-52.1%-204.6%-50.0%
Zstd_L1_disjoint_window_dict40,2770.821
638.6 MB/s		0.444
1181.3 MB/s		7.68%✅ +10.7%-231.8%-46.3%
Gzip_L145,1911.275
411.1 MB/s		0.769
681.3 MB/s		8.62%✅ +20.4%-113.6%✅ +15.6%
Brotli_Q126,7491.276
410.9 MB/s		0.897
584.3 MB/s		5.10%-34.4%-113.5%✅ +27.6%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_fast34,7743.372
155.5 MB/s		0.666
787.6 MB/s		6.63%———
Zstd_L122,1480.955
549.0 MB/s		0.426
1229.8 MB/s		4.22%-57.0%-253.1%-56.1%
Zstd_L1_disjoint_window_dict37,8220.867
604.9 MB/s		0.441
1189.7 MB/s		7.21%✅ +8.1%-289.0%-51.0%
Gzip_L130,8100.938
559.2 MB/s		0.648
808.8 MB/s		5.88%-12.9%-259.7%-2.7%
Brotli_Q124,9431.205
435.0 MB/s		0.929
564.4 MB/s		4.76%-39.4%-179.8%✅ +28.3%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_fast59,8554.414
118.8 MB/s		0.884
592.8 MB/s		11.42%———
Zstd_L143,0811.145
457.9 MB/s		0.457
1146.3 MB/s		8.22%-38.9%-285.6%-93.4%
Zstd_L1_disjoint_window_dict61,0311.208
433.8 MB/s		0.484
1082.5 MB/s		11.64%✅ +1.9%-265.3%-82.6%
Gzip_L169,6071.685
311.2 MB/s		0.995
527.0 MB/s		13.28%✅ +14.0%-162.0%✅ +11.1%
Brotli_Q149,7291.727
303.6 MB/s		1.399
374.7 MB/s		9.49%-20.4%-155.6%✅ +36.8%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_fast35,0203.472
151.0 MB/s		0.617
849.7 MB/s		6.68%———
Zstd_L123,5730.817
641.6 MB/s		0.381
1374.4 MB/s		4.50%-48.6%-325.0%-61.7%
Zstd_L1_disjoint_window_dict41,0740.716
732.2 MB/s		0.447
1172.9 MB/s		7.84%✅ +14.7%-385.0%-38.0%
Gzip_L131,5051.046
501.3 MB/s		0.549
954.1 MB/s		6.01%-11.2%-232.0%-12.3%
Brotli_Q125,8901.268
413.6 MB/s		1.179
444.6 MB/s		4.94%-35.3%-173.9%✅ +47.7%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_fast58,5563.954
132.6 MB/s		0.962
544.8 MB/s		11.17%———
Zstd_L132,8801.160
451.9 MB/s		0.499
1050.1 MB/s		6.27%-78.1%-240.8%-92.7%
Zstd_L1_disjoint_window_dict52,2871.050
499.4 MB/s		0.516
1015.2 MB/s		9.97%-12.0%-276.6%-86.3%
Gzip_L148,5381.231
426.0 MB/s		0.856
612.2 MB/s		9.26%-20.6%-221.3%-12.4%
Brotli_Q140,2101.753
299.1 MB/s		1.309
400.4 MB/s		7.67%-45.6%-125.6%✅ +26.5%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_fast71,6904.537
115.5 MB/s		1.131
463.7 MB/s		13.68%———
Zstd_L147,5671.271
412.6 MB/s		0.514
1018.9 MB/s		9.07%-50.7%-257.1%-119.7%
Zstd_L1_disjoint_window_dict65,0401.269
413.0 MB/s		0.568
923.6 MB/s		12.41%-10.2%-257.5%-99.2%
Gzip_L169,1661.660
315.7 MB/s		1.064
492.7 MB/s		13.19%-3.6%-173.3%-6.3%
Brotli_Q151,5961.842
284.5 MB/s		1.657
316.3 MB/s		9.84%-38.9%-146.3%✅ +31.8%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_fast33,9192.913
179.9 MB/s		0.582
900.7 MB/s		6.47%———
Zstd_L119,7290.884
593.0 MB/s		0.382
1372.8 MB/s		3.76%-71.9%-229.5%-52.4%
Zstd_L1_disjoint_window_dict37,1130.763
686.9 MB/s		0.455
1152.2 MB/s		7.08%✅ +8.6%-281.7%-27.9%
Gzip_L132,8170.914
573.4 MB/s		0.615
852.4 MB/s		6.26%-3.4%-218.7%✅ +5.4%
Brotli_Q121,5461.261
415.7 MB/s		1.020
513.8 MB/s		4.11%-57.4%-131.0%✅ +43.0%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_fast43,5033.587
146.1 MB/s		1.709
306.6 MB/s		8.30%———
Zstd_L134,7881.125
466.0 MB/s		0.463
1133.3 MB/s		6.64%-25.1%-218.9%-269.6%
Zstd_L1_disjoint_window_dict53,2491.076
486.9 MB/s		0.513
1022.2 MB/s		10.16%✅ +18.3%-233.2%-233.4%
Gzip_L161,0881.465
357.7 MB/s		0.974
538.3 MB/s		11.65%✅ +28.8%-144.8%-75.5%
Brotli_Q145,5341.903
275.4 MB/s		1.443
363.4 MB/s		8.69%✅ +4.5%-88.5%-18.5%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_fast51,4723.627
144.5 MB/s		0.811
646.2 MB/s		9.82%———
Zstd_L132,8671.100
476.8 MB/s		0.494
1060.3 MB/s		6.27%-56.6%-229.9%-64.1%
Zstd_L1_disjoint_window_dict49,5290.980
534.7 MB/s		0.617
849.4 MB/s		9.45%-3.9%-270.0%-31.5%
Gzip_L173,3721.994
263.0 MB/s		1.147
457.2 MB/s		14.00%✅ +29.8%-82.0%✅ +29.2%
Brotli_Q139,4141.350
388.5 MB/s		1.110
472.5 MB/s		7.52%-30.6%-168.8%✅ +26.9%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_fast122,1726.307
83.1 MB/s		1.771
296.0 MB/s		23.30%———
Zstd_L158,0801.468
357.1 MB/s		0.562
932.4 MB/s		11.08%-110.4%-329.6%-215.0%
Zstd_L1_disjoint_window_dict80,3661.551
338.1 MB/s		0.604
867.5 MB/s		15.33%-52.0%-306.7%-193.1%
Gzip_L1142,8792.987
175.5 MB/s		1.878
279.1 MB/s		27.25%✅ +14.5%-111.2%✅ +5.7%
Brotli_Q171,6482.146
244.3 MB/s		1.667
314.6 MB/s		13.67%-70.5%-193.9%-6.3%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_fast45,7428.413
62.3 MB/s		1.643
319.1 MB/s		8.73%———
Zstd_L145,4071.367
383.5 MB/s		0.560
936.9 MB/s		8.66%-0.7%-515.4%-193.6%
Zstd_L1_disjoint_window_dict62,7921.297
404.2 MB/s		0.623
841.0 MB/s		11.98%✅ +27.2%-548.6%-163.5%
Gzip_L166,2831.630
321.6 MB/s		1.116
469.6 MB/s		12.64%✅ +31.0%-416.1%-47.1%
Brotli_Q152,6741.904
275.3 MB/s		1.596
328.4 MB/s		10.05%✅ +13.2%-341.8%-2.9%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_fast48,6284.685
111.9 MB/s		0.786
667.2 MB/s		9.28%———
Zstd_L135,2610.958
547.3 MB/s		0.471
1112.8 MB/s		6.73%-37.9%-389.1%-66.8%
Zstd_L1_disjoint_window_dict50,9390.880
595.7 MB/s		0.572
916.8 MB/s		9.72%✅ +4.5%-432.4%-37.4%
Gzip_L149,8211.149
456.1 MB/s		0.759
691.0 MB/s		9.50%✅ +2.4%-307.6%-3.6%
Brotli_Q137,4851.248
420.0 MB/s		1.178
445.1 MB/s		7.15%-29.7%-275.3%✅ +33.3%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_fast25,5992.683
195.4 MB/s		1.083
484.0 MB/s		4.88%———
Zstd_L132,3261.109
472.6 MB/s		0.495
1059.5 MB/s		6.17%✅ +20.8%-141.9%-118.9%
Zstd_L1_disjoint_window_dict50,6441.022
512.9 MB/s		0.622
843.1 MB/s		9.66%✅ +49.5%-162.5%-74.2%
Gzip_L145,2901.078
486.5 MB/s		0.773
678.3 MB/s		8.64%✅ +43.5%-149.0%-40.2%
Brotli_Q135,4511.433
365.9 MB/s		1.173
447.0 MB/s		6.76%✅ +27.8%-87.3%✅ +7.7%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_fast45,0723.739
140.2 MB/s		0.804
651.6 MB/s		8.60%———
Zstd_L132,0851.139
460.4 MB/s		0.468
1120.5 MB/s		6.12%-40.5%-228.4%-72.0%
Zstd_L1_disjoint_window_dict49,6600.933
562.2 MB/s		0.484
1082.5 MB/s		9.47%✅ +9.2%-301.0%-66.1%
Gzip_L143,4141.194
439.1 MB/s		0.835
628.0 MB/s		8.28%-3.8%-213.2%✅ +3.6%
Brotli_Q134,8561.406
372.8 MB/s		1.438
364.6 MB/s		6.65%-29.3%-165.9%✅ +44.0%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_fast1,9090.135
23.5 MB/s		0.018
177.1 MB/s		60.09%———
Zstd_L16610.030
105.0 MB/s		0.011
289.9 MB/s		20.81%-188.8%-346.4%-63.6%
Zstd_L1_disjoint_window_dict17,0170.071
44.5 MB/s		0.018
173.5 MB/s		535.63%✅ +88.8%-89.0%✅ +2.1%
Gzip_L16860.044
72.6 MB/s		0.020
156.4 MB/s		21.59%-178.3%-208.6%✅ +11.7%
Brotli_Q16960.044
72.9 MB/s		0.565
5.6 MB/s		21.91%-174.3%-209.9%✅ +96.8%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_fast7120.087
18.4 MB/s		0.014
118.4 MB/s		44.17%———
Zstd_L15490.022
72.2 MB/s		0.008
206.1 MB/s		34.06%-29.7%-291.8%-74.1%
Zstd_L1_disjoint_window_dict16,9090.071
22.8 MB/s		0.018
88.6 MB/s		1048.95%✅ +95.8%-23.6%✅ +25.1%
Gzip_L15600.038
42.7 MB/s		0.017
97.5 MB/s		34.74%-27.1%-131.6%✅ +17.6%
Brotli_Q15670.035
45.6 MB/s		0.578
2.8 MB/s		35.17%-25.6%-147.5%✅ +97.6%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_fast5,3780.715
32.6 MB/s		0.075
309.3 MB/s		23.07%———
Zstd_L12,8060.067
347.1 MB/s		0.060
390.3 MB/s		12.04%-91.7%-965.0%-26.2%
Zstd_L1_disjoint_window_dict19,2330.135
173.0 MB/s		0.079
293.7 MB/s		82.50%✅ +72.0%-430.9%✅ +5.1%
Gzip_L13,4590.098
238.2 MB/s		0.064
364.3 MB/s		14.84%-55.5%-631.0%-17.8%
Brotli_Q13,1370.135
172.8 MB/s		0.192
121.3 MB/s		13.46%-71.4%-430.2%✅ +60.8%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_fast3,7050.309
26.6 MB/s		0.046
178.0 MB/s		45.13%———
Zstd_L12,6400.042
195.7 MB/s		0.017
487.2 MB/s		32.16%-40.3%-636.7%-173.7%
Zstd_L1_disjoint_window_dict18,8810.100
82.4 MB/s		0.027
309.2 MB/s		229.98%✅ +80.4%-210.2%-73.7%
Gzip_L12,8190.080
103.2 MB/s		0.045
183.5 MB/s		34.34%-31.4%-288.5%-3.1%
Brotli_Q12,6430.099
83.3 MB/s		0.583
14.1 MB/s		32.19%-40.2%-213.7%✅ +92.1%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_fast2,1990.197
22.8 MB/s		0.032
139.9 MB/s		48.84%———
Zstd_L11,6220.035
129.9 MB/s		0.014
331.7 MB/s		36.03%-35.6%-468.8%-137.1%
Zstd_L1_disjoint_window_dict17,9410.086
52.1 MB/s		0.023
197.2 MB/s		398.51%✅ +87.7%-128.0%-40.9%
Gzip_L11,6600.056
80.2 MB/s		0.029
155.7 MB/s		36.87%-32.5%-251.1%-11.3%
Brotli_Q11,6360.063
71.3 MB/s		0.608
7.4 MB/s		36.34%-34.4%-212.0%✅ +94.7%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_fast26,3552.913
180.0 MB/s		0.525
998.6 MB/s		5.03%———
Zstd_L18,5130.770
681.2 MB/s		0.499
1050.1 MB/s		1.62%-209.6%-278.6%-5.2%
Zstd_L1_disjoint_window_dict24,0840.642
816.7 MB/s		0.368
1423.2 MB/s		4.59%-9.4%-353.9%-42.5%
Gzip_L119,9640.989
529.8 MB/s		0.476
1100.9 MB/s		3.81%-32.0%-194.4%-10.2%
Brotli_Q112,5141.063
493.2 MB/s		0.835
627.6 MB/s		2.39%-110.6%-174.1%✅ +37.2%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_fast2,4730.213
23.2 MB/s		0.029
171.2 MB/s		50.01%———
Zstd_L11,4440.032
152.3 MB/s		0.013
381.4 MB/s		29.20%-71.3%-555.8%-122.8%
Zstd_L1_disjoint_window_dict17,7770.086
57.3 MB/s		0.023
212.6 MB/s		359.49%✅ +86.1%-146.8%-24.2%
Gzip_L11,5490.061
80.6 MB/s		0.028
175.3 MB/s		31.32%-59.7%-247.1%-2.4%
Brotli_Q11,4970.063
78.9 MB/s		0.616
8.0 MB/s		30.27%-65.2%-239.7%✅ +95.3%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_fast1,0640.143
11.6 MB/s		0.017
98.7 MB/s		63.90%———
Zstd_L19150.024
69.5 MB/s		0.008
199.4 MB/s		54.95%-16.3%-497.0%-102.1%
Zstd_L1_disjoint_window_dict17,2940.068
24.5 MB/s		0.017
98.5 MB/s		1038.68%✅ +93.8%-110.3%✅ +0.1%
Gzip_L19390.037
44.9 MB/s		0.016
103.1 MB/s		56.40%-13.3%-285.9%-4.5%
Brotli_Q19510.041
40.3 MB/s		0.885
1.9 MB/s		57.12%-11.9%-246.0%✅ +98.1%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_fast59,4216.063
86.5 MB/s		2.103
249.2 MB/s		11.33%———
Zstd_L158,7941.523
344.3 MB/s		0.735
713.2 MB/s		11.22%-1.1%-298.2%-186.2%
Zstd_L1_disjoint_window_dict76,7651.511
346.8 MB/s		0.675
776.1 MB/s		14.64%✅ +22.6%-301.1%-211.4%
Gzip_L185,1501.997
262.5 MB/s		1.289
406.8 MB/s		16.24%✅ +30.2%-203.6%-63.2%
Brotli_Q165,8822.060
254.5 MB/s		1.687
310.8 MB/s		12.57%✅ +9.8%-194.3%-24.7%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_fast58,8456.150
85.2 MB/s		2.066
253.8 MB/s		11.23%———
Zstd_L158,8601.459
359.2 MB/s		0.625
838.2 MB/s		11.23%✅ +0.0%-321.4%-230.3%
Zstd_L1_disjoint_window_dict77,4161.456
359.9 MB/s		0.623
841.3 MB/s		14.77%✅ +24.0%-322.2%-231.5%
Gzip_L182,3791.922
272.7 MB/s		1.230
426.1 MB/s		15.71%✅ +28.6%-220.0%-67.9%
Brotli_Q165,4071.996
262.6 MB/s		1.622
323.1 MB/s		12.48%✅ +10.0%-208.1%-27.3%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_fast80,9839.226
56.8 MB/s		1.403
373.3 MB/s		15.46%———
Zstd_L178,8741.534
341.4 MB/s		0.610
858.9 MB/s		15.06%-2.7%-501.4%-130.1%
Zstd_L1_disjoint_window_dict96,9901.547
338.6 MB/s		0.581
901.1 MB/s		18.52%✅ +16.5%-496.5%-141.4%
Gzip_L1117,7492.459
213.0 MB/s		1.566
334.5 MB/s		22.48%✅ +31.2%-275.2%✅ +10.4%
Brotli_Q182,1712.298
227.9 MB/s		1.818
288.1 MB/s		15.69%✅ +1.4%-301.4%✅ +22.8%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_fast75,3388.463
61.9 MB/s		1.271
412.2 MB/s		14.38%———
Zstd_L172,6521.426
367.4 MB/s		0.584
896.2 MB/s		13.87%-3.7%-493.7%-117.4%
Zstd_L1_disjoint_window_dict90,7551.306
400.9 MB/s		0.540
969.0 MB/s		17.33%✅ +17.0%-547.9%-135.1%
Gzip_L1106,7162.209
237.1 MB/s		1.380
379.6 MB/s		20.38%✅ +29.4%-283.2%✅ +7.9%
Brotli_Q176,6561.944
269.4 MB/s		1.790
292.6 MB/s		14.64%✅ +1.7%-335.3%✅ +29.0%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_fast72,7118.145
63.9 MB/s		1.103
471.9 MB/s		13.97%———
Zstd_L171,0841.266
411.2 MB/s		0.570
913.9 MB/s		13.66%-2.3%-543.4%-93.7%
Zstd_L1_disjoint_window_dict88,4421.353
384.6 MB/s		0.555
937.3 MB/s		16.99%✅ +17.8%-501.9%-98.6%
Gzip_L1111,2802.178
239.0 MB/s		1.293
402.6 MB/s		21.38%✅ +34.7%-274.0%✅ +14.7%
Brotli_Q174,7351.804
288.5 MB/s		1.575
330.5 MB/s		14.36%✅ +2.7%-351.4%✅ +30.0%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_fast79,5789.380
55.8 MB/s		1.376
380.8 MB/s		15.19%———
Zstd_L174,1201.489
351.8 MB/s		0.626
837.4 MB/s		14.15%-7.4%-529.9%-119.9%
Zstd_L1_disjoint_window_dict92,4391.516
345.5 MB/s		0.568
921.8 MB/s		17.65%✅ +13.9%-518.7%-142.1%
Gzip_L1114,7002.511
208.6 MB/s		1.563
335.2 MB/s		21.90%✅ +30.6%-273.6%✅ +12.0%
Brotli_Q178,9402.203
237.8 MB/s		1.762
297.3 MB/s		15.07%-0.8%-325.9%✅ +21.9%

Hybrid / fast

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_fast49,7043.191
164.3 MB/s		0.544
962.7 MB/s		9.48%———
Zstd_L149,6811.320
397.0 MB/s		0.638
821.7 MB/s		9.48%-0.0%-141.6%✅ +14.7%
Zstd_L1_disjoint_window_dict66,8701.372
382.0 MB/s		0.653
803.1 MB/s		12.76%✅ +25.7%-132.5%✅ +16.6%
Gzip_L177,3061.844
284.3 MB/s		1.157
452.9 MB/s		14.75%✅ +35.7%-73.1%✅ +53.0%
Brotli_Q154,2511.986
264.0 MB/s		2.440
214.8 MB/s		10.35%✅ +8.4%-60.7%✅ +77.7%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_fast18,4801.196
200.5 MB/s		0.168
1424.2 MB/s		7.71%———
Zstd_L118,4570.514
466.6 MB/s		0.277
864.2 MB/s		7.70%-0.1%-132.7%✅ +39.3%
Zstd_L1_disjoint_window_dict35,0650.682
351.8 MB/s		0.269
890.2 MB/s		14.62%✅ +47.3%-75.5%✅ +37.5%
Gzip_L125,7020.603
397.7 MB/s		0.382
627.3 MB/s		10.72%✅ +28.1%-98.4%✅ +56.0%
Brotli_Q120,2861.215
197.3 MB/s		0.624
384.5 MB/s		8.46%✅ +8.9%✅ +1.6%✅ +73.0%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_fast23,6692.701
194.1 MB/s		0.338
1553.0 MB/s		4.52%———
Zstd_L123,6460.894
586.2 MB/s		0.433
1210.4 MB/s		4.51%-0.1%-202.0%✅ +22.1%
Zstd_L1_disjoint_window_dict40,2770.821
638.6 MB/s		0.444
1181.3 MB/s		7.68%✅ +41.2%-229.0%✅ +23.9%
Gzip_L145,1911.275
411.1 MB/s		0.769
681.3 MB/s		8.62%✅ +47.6%-111.8%✅ +56.1%
Brotli_Q126,7491.276
410.9 MB/s		0.897
584.3 MB/s		5.10%✅ +11.5%-111.7%✅ +62.4%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_fast11,2032.366
221.6 MB/s		0.768
682.3 MB/s		2.14%———
Zstd_L122,1480.955
549.0 MB/s		0.426
1229.8 MB/s		4.22%✅ +49.4%-147.8%-80.2%
Zstd_L1_disjoint_window_dict37,8220.867
604.9 MB/s		0.441
1189.7 MB/s		7.21%✅ +70.4%-173.0%-74.4%
Gzip_L130,8100.938
559.2 MB/s		0.648
808.8 MB/s		5.88%✅ +63.6%-152.4%-18.5%
Brotli_Q124,9431.205
435.0 MB/s		0.929
564.4 MB/s		4.76%✅ +55.1%-96.3%✅ +17.3%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_fast43,1042.618
200.2 MB/s		0.359
1459.5 MB/s		8.22%———
Zstd_L143,0811.145
457.9 MB/s		0.457
1146.3 MB/s		8.22%-0.1%-128.7%✅ +21.5%
Zstd_L1_disjoint_window_dict61,0311.208
433.8 MB/s		0.484
1082.5 MB/s		11.64%✅ +29.4%-116.7%✅ +25.8%
Gzip_L169,6071.685
311.2 MB/s		0.995
527.0 MB/s		13.28%✅ +38.1%-55.4%✅ +63.9%
Brotli_Q149,7291.727
303.6 MB/s		1.399
374.7 MB/s		9.49%✅ +13.3%-51.6%✅ +74.3%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_fast23,5962.352
222.9 MB/s		0.310
1692.9 MB/s		4.50%———
Zstd_L123,5730.817
641.6 MB/s		0.381
1374.4 MB/s		4.50%-0.1%-187.8%✅ +18.8%
Zstd_L1_disjoint_window_dict41,0740.716
732.2 MB/s		0.447
1172.9 MB/s		7.84%✅ +42.6%-228.4%✅ +30.7%
Gzip_L131,5051.046
501.3 MB/s		0.549
954.1 MB/s		6.01%✅ +25.1%-124.9%✅ +43.6%
Brotli_Q125,8901.268
413.6 MB/s		1.179
444.6 MB/s		4.94%✅ +8.9%-85.5%✅ +73.7%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_fast32,9032.834
185.0 MB/s		0.411
1274.7 MB/s		6.28%———
Zstd_L132,8801.160
451.9 MB/s		0.499
1050.1 MB/s		6.27%-0.1%-144.3%✅ +17.6%
Zstd_L1_disjoint_window_dict52,2871.050
499.4 MB/s		0.516
1015.2 MB/s		9.97%✅ +37.1%-170.0%✅ +20.4%
Gzip_L148,5381.231
426.0 MB/s		0.856
612.2 MB/s		9.26%✅ +32.2%-130.3%✅ +52.0%
Brotli_Q140,2101.753
299.1 MB/s		1.309
400.4 MB/s		7.67%✅ +18.2%-61.7%✅ +68.6%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_fast47,5903.265
160.6 MB/s		0.442
1185.8 MB/s		9.08%———
Zstd_L147,5671.271
412.6 MB/s		0.514
1018.9 MB/s		9.07%-0.0%-156.9%✅ +14.1%
Zstd_L1_disjoint_window_dict65,0401.269
413.0 MB/s		0.568
923.6 MB/s		12.41%✅ +26.8%-157.2%✅ +22.1%
Gzip_L169,1661.660
315.7 MB/s		1.064
492.7 MB/s		13.19%✅ +31.2%-96.6%✅ +58.4%
Brotli_Q151,5961.842
284.5 MB/s		1.657
316.3 MB/s		9.84%✅ +7.8%-77.2%✅ +73.3%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_fast19,7522.241
233.9 MB/s		0.311
1684.1 MB/s		3.77%———
Zstd_L119,7290.884
593.0 MB/s		0.382
1372.8 MB/s		3.76%-0.1%-153.5%✅ +18.5%
Zstd_L1_disjoint_window_dict37,1130.763
686.9 MB/s		0.455
1152.2 MB/s		7.08%✅ +46.8%-193.7%✅ +31.6%
Gzip_L132,8170.914
573.4 MB/s		0.615
852.4 MB/s		6.26%✅ +39.8%-145.2%✅ +49.4%
Brotli_Q121,5461.261
415.7 MB/s		1.020
513.8 MB/s		4.11%✅ +8.3%-77.7%✅ +69.5%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_fast34,8111.818
288.4 MB/s		0.413
1270.5 MB/s		6.64%———
Zstd_L134,7881.125
466.0 MB/s		0.463
1133.3 MB/s		6.64%-0.1%-61.6%✅ +10.8%
Zstd_L1_disjoint_window_dict53,2491.076
486.9 MB/s		0.513
1022.2 MB/s		10.16%✅ +34.6%-68.9%✅ +19.5%
Gzip_L161,0881.465
357.7 MB/s		0.974
538.3 MB/s		11.65%✅ +43.0%-24.1%✅ +57.6%
Brotli_Q145,5341.903
275.4 MB/s		1.443
363.4 MB/s		8.69%✅ +23.5%✅ +4.5%✅ +71.4%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_fast32,8902.790
187.9 MB/s		0.409
1280.9 MB/s		6.27%———
Zstd_L132,8671.100
476.8 MB/s		0.494
1060.3 MB/s		6.27%-0.1%-153.7%✅ +17.2%
Zstd_L1_disjoint_window_dict49,5290.980
534.7 MB/s		0.617
849.4 MB/s		9.45%✅ +33.6%-184.6%✅ +33.7%
Gzip_L173,3721.994
263.0 MB/s		1.147
457.2 MB/s		14.00%✅ +55.2%-39.9%✅ +64.3%
Brotli_Q139,4141.350
388.5 MB/s		1.110
472.5 MB/s		7.52%✅ +16.6%-106.7%✅ +63.1%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_fast58,1033.337
157.1 MB/s		0.513
1022.9 MB/s		11.08%———
Zstd_L158,0801.468
357.1 MB/s		0.562
932.4 MB/s		11.08%-0.0%-127.3%✅ +8.8%
Zstd_L1_disjoint_window_dict80,3661.551
338.1 MB/s		0.604
867.5 MB/s		15.33%✅ +27.7%-115.2%✅ +15.2%
Gzip_L1142,8792.987
175.5 MB/s		1.878
279.1 MB/s		27.25%✅ +59.3%-11.7%✅ +72.7%
Brotli_Q171,6482.146
244.3 MB/s		1.667
314.6 MB/s		13.67%✅ +18.9%-55.5%✅ +69.2%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_fast36,92210.158
51.6 MB/s		0.825
635.5 MB/s		7.04%———
Zstd_L145,4071.367
383.5 MB/s		0.560
936.9 MB/s		8.66%✅ +18.7%-643.1%-47.4%
Zstd_L1_disjoint_window_dict62,7921.297
404.2 MB/s		0.623
841.0 MB/s		11.98%✅ +41.2%-683.1%-32.3%
Gzip_L166,2831.630
321.6 MB/s		1.116
469.6 MB/s		12.64%✅ +44.3%-523.2%✅ +26.1%
Brotli_Q152,6741.904
275.3 MB/s		1.596
328.4 MB/s		10.05%✅ +29.9%-433.5%✅ +48.3%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_fast27,1023.094
169.4 MB/s		0.808
648.7 MB/s		5.17%———
Zstd_L135,2610.958
547.3 MB/s		0.471
1112.8 MB/s		6.73%✅ +23.1%-223.0%-71.6%
Zstd_L1_disjoint_window_dict50,9390.880
595.7 MB/s		0.572
916.8 MB/s		9.72%✅ +46.8%-251.6%-41.3%
Gzip_L149,8211.149
456.1 MB/s		0.759
691.0 MB/s		9.50%✅ +45.6%-169.2%-6.5%
Brotli_Q137,4851.248
420.0 MB/s		1.178
445.1 MB/s		7.15%✅ +27.7%-147.9%✅ +31.4%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_fast17,4241.650
317.8 MB/s		0.732
716.1 MB/s		3.32%———
Zstd_L132,3261.109
472.6 MB/s		0.495
1059.5 MB/s		6.17%✅ +46.1%-48.7%-47.9%
Zstd_L1_disjoint_window_dict50,6441.022
512.9 MB/s		0.622
843.1 MB/s		9.66%✅ +65.6%-61.4%-17.7%
Gzip_L145,2901.078
486.5 MB/s		0.773
678.3 MB/s		8.64%✅ +61.5%-53.1%✅ +5.3%
Brotli_Q135,4511.433
365.9 MB/s		1.173
447.0 MB/s		6.76%✅ +50.9%-15.1%✅ +37.6%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_fast32,1082.897
180.9 MB/s		0.399
1312.2 MB/s		6.12%———
Zstd_L132,0851.139
460.4 MB/s		0.468
1120.5 MB/s		6.12%-0.1%-154.4%✅ +14.6%
Zstd_L1_disjoint_window_dict49,6600.933
562.2 MB/s		0.484
1082.5 MB/s		9.47%✅ +35.3%-210.7%✅ +17.5%
Gzip_L143,4141.194
439.1 MB/s		0.835
628.0 MB/s		8.28%✅ +26.0%-142.7%✅ +52.1%
Brotli_Q134,8561.406
372.8 MB/s		1.438
364.6 MB/s		6.65%✅ +7.9%-106.0%✅ +72.2%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_fast6840.074
43.0 MB/s		0.009
353.2 MB/s		21.53%———
Zstd_L16610.030
105.0 MB/s		0.011
289.9 MB/s		20.81%-3.5%-144.0%✅ +17.9%
Zstd_L1_disjoint_window_dict17,0170.071
44.5 MB/s		0.018
173.5 MB/s		535.63%✅ +96.0%-3.3%✅ +50.9%
Gzip_L16860.044
72.6 MB/s		0.020
156.4 MB/s		21.59%✅ +0.3%-68.7%✅ +55.7%
Brotli_Q16960.044
72.9 MB/s		0.565
5.6 MB/s		21.91%✅ +1.7%-69.4%✅ +98.4%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_fast5720.065
24.9 MB/s		0.006
250.7 MB/s		35.48%———
Zstd_L15490.022
72.2 MB/s		0.008
206.1 MB/s		34.06%-4.2%-189.5%✅ +17.8%
Zstd_L1_disjoint_window_dict16,9090.071
22.8 MB/s		0.018
88.6 MB/s		1048.95%✅ +96.6%✅ +8.6%✅ +64.6%
Gzip_L15600.038
42.7 MB/s		0.017
97.5 MB/s		34.74%-2.1%-71.1%✅ +61.1%
Brotli_Q15670.035
45.6 MB/s		0.578
2.8 MB/s		35.17%-0.9%-82.9%✅ +98.9%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_fast2,8290.235
99.3 MB/s		0.029
791.8 MB/s		12.14%———
Zstd_L12,8060.067
347.1 MB/s		0.060
390.3 MB/s		12.04%-0.8%-249.4%✅ +50.7%
Zstd_L1_disjoint_window_dict19,2330.135
173.0 MB/s		0.079
293.7 MB/s		82.50%✅ +85.3%-74.2%✅ +62.9%
Gzip_L13,4590.098
238.2 MB/s		0.064
364.3 MB/s		14.84%✅ +18.2%-139.8%✅ +54.0%
Brotli_Q13,1370.135
172.8 MB/s		0.192
121.3 MB/s		13.46%✅ +9.8%-74.0%✅ +84.7%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_fast2,6630.283
29.0 MB/s		0.015
557.7 MB/s		32.44%———
Zstd_L12,6400.042
195.7 MB/s		0.017
487.2 MB/s		32.16%-0.9%-574.1%✅ +12.6%
Zstd_L1_disjoint_window_dict18,8810.100
82.4 MB/s		0.027
309.2 MB/s		229.98%✅ +85.9%-183.8%✅ +44.6%
Gzip_L12,8190.080
103.2 MB/s		0.045
183.5 MB/s		34.34%✅ +5.5%-255.6%✅ +67.1%
Brotli_Q12,6430.099
83.3 MB/s		0.583
14.1 MB/s		32.19%-0.8%-187.1%✅ +97.5%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_fast1,6450.105
42.7 MB/s		0.012
380.8 MB/s		36.54%———
Zstd_L11,6220.035
129.9 MB/s		0.014
331.7 MB/s		36.03%-1.4%-204.3%✅ +12.9%
Zstd_L1_disjoint_window_dict17,9410.086
52.1 MB/s		0.023
197.2 MB/s		398.51%✅ +90.8%-22.0%✅ +48.2%
Gzip_L11,6600.056
80.2 MB/s		0.029
155.7 MB/s		36.87%✅ +0.9%-87.9%✅ +59.1%
Brotli_Q11,6360.063
71.3 MB/s		0.608
7.4 MB/s		36.34%-0.6%-67.0%✅ +98.1%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_fast6,0592.047
256.1 MB/s		0.929
564.1 MB/s		1.16%———
Zstd_L18,5130.770
681.2 MB/s		0.499
1050.1 MB/s		1.62%✅ +28.8%-166.0%-86.2%
Zstd_L1_disjoint_window_dict24,0840.642
816.7 MB/s		0.368
1423.2 MB/s		4.59%✅ +74.8%-218.9%-152.3%
Gzip_L119,9640.989
529.8 MB/s		0.476
1100.9 MB/s		3.81%✅ +69.7%-106.9%-95.2%
Brotli_Q112,5141.063
493.2 MB/s		0.835
627.6 MB/s		2.39%✅ +51.6%-92.6%-11.3%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_fast1,4670.115
43.1 MB/s		0.012
424.6 MB/s		29.67%———
Zstd_L11,4440.032
152.3 MB/s		0.013
381.4 MB/s		29.20%-1.6%-253.6%✅ +10.2%
Zstd_L1_disjoint_window_dict17,7770.086
57.3 MB/s		0.023
212.6 MB/s		359.49%✅ +91.7%-33.1%✅ +49.9%
Gzip_L11,5490.061
80.6 MB/s		0.028
175.3 MB/s		31.32%✅ +5.3%-87.2%✅ +58.7%
Brotli_Q11,4970.063
78.9 MB/s		0.616
8.0 MB/s		30.27%✅ +2.0%-83.2%✅ +98.1%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_fast9410.061
27.1 MB/s		0.007
234.4 MB/s		56.52%———
Zstd_L19150.024
69.5 MB/s		0.008
199.4 MB/s		54.95%-2.8%-155.8%✅ +14.9%
Zstd_L1_disjoint_window_dict17,2940.068
24.5 MB/s		0.017
98.5 MB/s		1038.68%✅ +94.6%✅ +9.9%✅ +58.0%
Gzip_L19390.037
44.9 MB/s		0.016
103.1 MB/s		56.40%-0.2%-65.4%✅ +56.0%
Brotli_Q19510.041
40.3 MB/s		0.885
1.9 MB/s		57.12%✅ +1.1%-48.3%✅ +99.2%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_fast58,8174.678
112.1 MB/s		0.539
972.5 MB/s		11.22%———
Zstd_L158,7941.523
344.3 MB/s		0.735
713.2 MB/s		11.22%-0.0%-207.2%✅ +26.7%
Zstd_L1_disjoint_window_dict76,7651.511
346.8 MB/s		0.675
776.1 MB/s		14.64%✅ +23.4%-209.5%✅ +20.2%
Gzip_L185,1501.997
262.5 MB/s		1.289
406.8 MB/s		16.24%✅ +30.9%-134.2%✅ +58.2%
Brotli_Q165,8822.060
254.5 MB/s		1.687
310.8 MB/s		12.57%✅ +10.7%-127.0%✅ +68.0%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_fast58,8834.644
112.9 MB/s		0.521
1005.7 MB/s		11.23%———
Zstd_L158,8601.459
359.2 MB/s		0.625
838.2 MB/s		11.23%-0.0%-218.3%✅ +16.6%
Zstd_L1_disjoint_window_dict77,4161.456
359.9 MB/s		0.623
841.3 MB/s		14.77%✅ +23.9%-218.9%✅ +16.3%
Gzip_L182,3791.922
272.7 MB/s		1.230
426.1 MB/s		15.71%✅ +28.5%-141.6%✅ +57.6%
Brotli_Q165,4071.996
262.6 MB/s		1.622
323.1 MB/s		12.48%✅ +10.0%-132.6%✅ +67.9%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_fast78,8972.606
201.0 MB/s		0.466
1124.8 MB/s		15.06%———
Zstd_L178,8741.534
341.4 MB/s		0.610
858.9 MB/s		15.06%-0.0%-69.9%✅ +23.6%
Zstd_L1_disjoint_window_dict96,9901.547
338.6 MB/s		0.581
901.1 MB/s		18.52%✅ +18.7%-68.5%✅ +19.9%
Gzip_L1117,7492.459
213.0 MB/s		1.566
334.5 MB/s		22.48%✅ +33.0%-6.0%✅ +70.3%
Brotli_Q182,1712.298
227.9 MB/s		1.818
288.1 MB/s		15.69%✅ +4.0%-13.4%✅ +74.4%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_fast72,6752.331
224.6 MB/s		0.429
1221.8 MB/s		13.88%———
Zstd_L172,6521.426
367.4 MB/s		0.584
896.2 MB/s		13.87%-0.0%-63.5%✅ +26.6%
Zstd_L1_disjoint_window_dict90,7551.306
400.9 MB/s		0.540
969.0 MB/s		17.33%✅ +19.9%-78.5%✅ +20.7%
Gzip_L1106,7162.209
237.1 MB/s		1.380
379.6 MB/s		20.38%✅ +31.9%-5.5%✅ +68.9%
Brotli_Q176,6561.944
269.4 MB/s		1.790
292.6 MB/s		14.64%✅ +5.2%-19.9%✅ +76.1%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_fast71,1072.249
231.4 MB/s		0.385
1351.3 MB/s		13.66%———
Zstd_L171,0841.266
411.2 MB/s		0.570
913.9 MB/s		13.66%-0.0%-77.7%✅ +32.4%
Zstd_L1_disjoint_window_dict88,4421.353
384.6 MB/s		0.555
937.3 MB/s		16.99%✅ +19.6%-66.2%✅ +30.6%
Gzip_L1111,2802.178
239.0 MB/s		1.293
402.6 MB/s		21.38%✅ +36.1%-3.3%✅ +70.2%
Brotli_Q174,7351.804
288.5 MB/s		1.575
330.5 MB/s		14.36%✅ +4.9%-24.6%✅ +75.5%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_fast74,1432.502
209.3 MB/s		0.459
1142.2 MB/s		14.15%———
Zstd_L174,1201.489
351.8 MB/s		0.626
837.4 MB/s		14.15%-0.0%-68.1%✅ +26.7%
Zstd_L1_disjoint_window_dict92,4391.516
345.5 MB/s		0.568
921.8 MB/s		17.65%✅ +19.8%-65.1%✅ +19.3%
Gzip_L1114,7002.511
208.6 MB/s		1.563
335.2 MB/s		21.90%✅ +35.4%✅ +0.3%✅ +70.7%
Brotli_Q178,9402.203
237.8 MB/s		1.762
297.3 MB/s		15.07%✅ +6.1%-13.6%✅ +74.0%

Native / thin

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_thin_L043,75675.363
7.0 MB/s		1.312
399.4 MB/s		8.35%———
Zstd_L942,49113.121
40.0 MB/s		0.519
1009.2 MB/s		8.11%-3.0%-474.4%-152.6%
Zstd_L9_disjoint_window_dict60,3059.052
57.9 MB/s		0.520
1007.6 MB/s		11.50%✅ +27.4%-732.6%-152.3%
Gzip_L949,60011.333
46.3 MB/s		0.775
676.4 MB/s		9.46%✅ +11.8%-565.0%-69.3%
Brotli_Q942,01445.234
11.6 MB/s		1.005
521.6 MB/s		8.01%-4.1%-66.6%-30.6%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_thin_L014,20423.928
10.0 MB/s		1.504
159.4 MB/s		5.92%———
Zstd_L915,6777.622
31.5 MB/s		0.240
1000.1 MB/s		6.54%✅ +9.4%-214.0%-527.3%
Zstd_L9_disjoint_window_dict31,9602.838
84.5 MB/s		0.234
1025.3 MB/s		13.33%✅ +55.6%-743.0%-543.1%
Gzip_L918,3883.965
60.5 MB/s		0.347
690.7 MB/s		7.67%✅ +22.8%-503.5%-333.2%
Brotli_Q915,12220.252
11.8 MB/s		0.478
501.5 MB/s		6.31%✅ +6.1%-18.2%-214.5%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_thin_L016,34939.934
13.1 MB/s		2.795
187.5 MB/s		3.12%———
Zstd_L919,41610.451
50.2 MB/s		0.456
1150.4 MB/s		3.70%✅ +15.8%-282.1%-513.5%
Zstd_L9_disjoint_window_dict35,5794.365
120.1 MB/s		0.564
929.2 MB/s		6.79%✅ +54.0%-814.8%-395.5%
Gzip_L925,7095.529
94.8 MB/s		0.531
988.0 MB/s		4.90%✅ +36.4%-622.2%-426.8%
Brotli_Q918,52525.137
20.9 MB/s		0.672
780.5 MB/s		3.53%✅ +11.7%-58.9%-316.2%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_thin_L06,31034.843
15.0 MB/s		3.426
153.0 MB/s		1.20%———
Zstd_L916,1059.945
52.7 MB/s		0.390
1344.2 MB/s		3.07%✅ +60.8%-250.3%-778.4%
Zstd_L9_disjoint_window_dict32,1464.767
110.0 MB/s		0.389
1346.9 MB/s		6.13%✅ +80.4%-630.9%-780.1%
Gzip_L919,3767.599
69.0 MB/s		0.494
1060.7 MB/s		3.70%✅ +67.4%-358.5%-593.1%
Brotli_Q915,77234.896
15.0 MB/s		0.667
785.5 MB/s		3.01%✅ +60.0%✅ +0.2%-413.3%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_thin_L041,82171.181
7.4 MB/s		1.011
518.3 MB/s		7.98%———
Zstd_L939,93610.771
48.7 MB/s		0.425
1234.9 MB/s		7.62%-4.7%-560.9%-138.2%
Zstd_L9_disjoint_window_dict58,9325.810
90.2 MB/s		0.485
1080.8 MB/s		11.24%✅ +29.0%-1125.1%-108.5%
Gzip_L947,9996.396
82.0 MB/s		0.805
651.4 MB/s		9.16%✅ +12.9%-1012.8%-25.7%
Brotli_Q940,40939.118
13.4 MB/s		1.115
470.0 MB/s		7.71%-3.5%-82.0%✅ +9.3%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_thin_L013,88843.302
12.1 MB/s		4.358
120.3 MB/s		2.65%———
Zstd_L920,6619.357
56.0 MB/s		0.364
1441.1 MB/s		3.94%✅ +32.8%-362.8%-1098.0%
Zstd_L9_disjoint_window_dict39,3244.676
112.1 MB/s		0.396
1325.4 MB/s		7.50%✅ +64.7%-826.0%-1001.8%
Gzip_L925,7017.820
67.0 MB/s		0.520
1007.2 MB/s		4.90%✅ +46.0%-453.7%-737.3%
Brotli_Q923,23531.955
16.4 MB/s		0.753
696.3 MB/s		4.43%✅ +40.2%-35.5%-478.8%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_thin_L016,77043.279
12.1 MB/s		3.321
157.8 MB/s		3.20%———
Zstd_L928,73911.161
47.0 MB/s		0.519
1009.3 MB/s		5.48%✅ +41.6%-287.8%-539.4%
Zstd_L9_disjoint_window_dict44,9526.587
79.6 MB/s		0.470
1115.6 MB/s		8.57%✅ +62.7%-557.0%-606.7%
Gzip_L935,3509.966
52.6 MB/s		0.682
768.7 MB/s		6.74%✅ +52.6%-334.3%-387.0%
Brotli_Q930,37041.673
12.6 MB/s		0.979
535.6 MB/s		5.79%✅ +44.8%-3.9%-239.3%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_thin_L039,01557.978
9.0 MB/s		3.895
134.6 MB/s		7.44%———
Zstd_L940,21811.792
44.5 MB/s		0.515
1017.9 MB/s		7.67%✅ +3.0%-391.7%-656.3%
Zstd_L9_disjoint_window_dict56,5077.054
74.3 MB/s		0.565
928.5 MB/s		10.78%✅ +31.0%-721.9%-589.9%
Gzip_L950,43910.638
49.3 MB/s		0.864
607.0 MB/s		9.62%✅ +22.6%-445.0%-351.0%
Brotli_Q940,03344.411
11.8 MB/s		1.221
429.2 MB/s		7.64%✅ +2.5%-30.5%-218.9%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_thin_L010,77033.647
15.6 MB/s		3.283
159.7 MB/s		2.05%———
Zstd_L914,9928.169
64.2 MB/s		0.366
1431.7 MB/s		2.86%✅ +28.2%-311.9%-796.7%
Zstd_L9_disjoint_window_dict32,8323.627
144.5 MB/s		0.415
1263.8 MB/s		6.26%✅ +67.2%-827.8%-691.5%
Gzip_L922,7065.574
94.0 MB/s		0.521
1006.7 MB/s		4.33%✅ +52.6%-503.6%-530.5%
Brotli_Q915,13927.432
19.1 MB/s		0.886
591.5 MB/s		2.89%✅ +28.9%-22.7%-270.5%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_thin_L031,83053.098
9.9 MB/s		1.326
395.2 MB/s		6.07%———
Zstd_L930,21210.712
48.9 MB/s		0.461
1135.8 MB/s		5.76%-5.4%-395.7%-187.4%
Zstd_L9_disjoint_window_dict46,5596.176
84.9 MB/s		0.488
1074.0 MB/s		8.88%✅ +31.6%-759.8%-171.8%
Gzip_L941,97511.632
45.1 MB/s		0.753
696.4 MB/s		8.01%✅ +24.2%-356.5%-76.2%
Brotli_Q930,78838.812
13.5 MB/s		0.981
534.2 MB/s		5.87%-3.4%-36.8%-35.2%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_thin_L022,24045.097
11.6 MB/s		0.757
692.8 MB/s		4.24%———
Zstd_L927,27310.725
48.9 MB/s		0.485
1081.3 MB/s		5.20%✅ +18.5%-320.5%-56.1%
Zstd_L9_disjoint_window_dict43,2315.105
102.7 MB/s		0.468
1121.1 MB/s		8.25%✅ +48.6%-783.4%-61.8%
Gzip_L936,6955.341
98.2 MB/s		0.702
746.3 MB/s		7.00%✅ +39.4%-744.3%-7.7%
Brotli_Q925,47830.393
17.2 MB/s		0.941
557.4 MB/s		4.86%✅ +12.7%-48.4%✅ +19.5%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_thin_L040,96067.943
7.7 MB/s		1.564
335.1 MB/s		7.81%———
Zstd_L945,69211.825
44.3 MB/s		0.545
962.6 MB/s		8.72%✅ +10.4%-474.6%-187.2%
Zstd_L9_disjoint_window_dict65,2126.789
77.2 MB/s		0.716
731.8 MB/s		12.44%✅ +37.2%-900.7%-118.3%
Gzip_L999,26715.300
34.3 MB/s		1.472
356.3 MB/s		18.93%✅ +58.7%-344.1%-6.3%
Brotli_Q942,92836.197
14.5 MB/s		1.143
458.5 MB/s		8.19%✅ +4.6%-87.7%-36.8%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_thin_L020,54555.926
9.4 MB/s		4.322
121.3 MB/s		3.92%———
Zstd_L937,09011.802
44.4 MB/s		0.505
1038.4 MB/s		7.07%✅ +44.6%-373.9%-756.0%
Zstd_L9_disjoint_window_dict53,3257.253
72.3 MB/s		0.525
997.6 MB/s		10.17%✅ +61.5%-671.1%-722.4%
Gzip_L942,86513.079
40.1 MB/s		0.804
652.0 MB/s		8.18%✅ +52.1%-327.6%-437.5%
Brotli_Q936,40940.344
13.0 MB/s		1.123
466.9 MB/s		6.94%✅ +43.6%-38.6%-284.9%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_thin_L025,47046.238
11.3 MB/s		1.339
391.4 MB/s		4.86%———
Zstd_L928,5669.981
52.5 MB/s		0.370
1417.8 MB/s		5.45%✅ +10.8%-363.3%-262.2%
Zstd_L9_disjoint_window_dict44,9215.432
96.5 MB/s		0.382
1371.5 MB/s		8.57%✅ +43.3%-751.3%-250.4%
Gzip_L934,1317.270
72.1 MB/s		0.630
832.0 MB/s		6.51%✅ +25.4%-536.0%-112.6%
Brotli_Q928,57427.298
19.2 MB/s		0.911
575.3 MB/s		5.45%✅ +10.9%-69.4%-47.0%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_thin_L013,40142.443
12.4 MB/s		3.666
143.0 MB/s		2.56%———
Zstd_L925,78710.518
49.8 MB/s		0.450
1165.0 MB/s		4.92%✅ +48.0%-303.5%-714.6%
Zstd_L9_disjoint_window_dict42,0176.047
86.7 MB/s		0.478
1097.5 MB/s		8.02%✅ +68.1%-601.8%-667.5%
Gzip_L933,41911.295
46.4 MB/s		0.619
846.8 MB/s		6.37%✅ +59.9%-275.8%-492.1%
Brotli_Q926,83150.502
10.4 MB/s		0.989
530.2 MB/s		5.12%✅ +50.1%✅ +16.0%-270.7%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_thin_L024,69641.937
12.5 MB/s		3.003
174.6 MB/s		4.71%———
Zstd_L924,92810.143
51.7 MB/s		0.423
1240.6 MB/s		4.76%✅ +0.9%-313.4%-610.6%
Zstd_L9_disjoint_window_dict40,8535.604
93.6 MB/s		0.431
1217.4 MB/s		7.79%✅ +39.5%-648.4%-597.3%
Gzip_L927,3398.803
59.6 MB/s		0.657
798.3 MB/s		5.22%✅ +9.7%-376.4%-357.2%
Brotli_Q925,01628.611
18.3 MB/s		0.961
545.4 MB/s		4.77%✅ +1.3%-46.6%-212.4%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_thin_L07742.565
1.2 MB/s		0.021
149.2 MB/s		24.36%———
Zstd_L96211.805
1.8 MB/s		0.131
24.3 MB/s		19.55%-24.6%-42.1%✅ +83.7%
Zstd_L9_disjoint_window_dict16,9830.284
11.2 MB/s		0.156
20.3 MB/s		534.56%✅ +95.4%-802.3%✅ +86.4%
Gzip_L96340.065
49.0 MB/s		0.019
165.5 MB/s		19.96%-22.1%-3856.7%-10.9%
Brotli_Q95875.548
0.6 MB/s		0.034
94.2 MB/s		18.48%-31.9%✅ +53.8%✅ +36.8%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_thin_L06631.590
1.0 MB/s		0.015
106.5 MB/s		41.13%———
Zstd_L95381.863
0.9 MB/s		0.115
14.0 MB/s		33.37%-23.2%✅ +14.6%✅ +86.8%
Zstd_L9_disjoint_window_dict16,8930.228
7.1 MB/s		0.156
10.3 MB/s		1047.95%✅ +96.1%-596.4%✅ +90.3%
Gzip_L95410.060
27.0 MB/s		0.016
98.0 MB/s		33.56%-22.6%-2559.7%✅ +8.0%
Brotli_Q94705.771
0.3 MB/s		0.028
58.2 MB/s		29.16%-41.1%✅ +72.4%✅ +45.3%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_thin_L02,5315.922
3.9 MB/s		0.186
125.4 MB/s		10.86%———
Zstd_L92,4651.988
11.7 MB/s		0.033
700.7 MB/s		10.57%-2.7%-197.9%-458.7%
Zstd_L9_disjoint_window_dict18,8240.521
44.8 MB/s		0.048
482.1 MB/s		80.75%✅ +86.6%-1037.6%-284.4%
Gzip_L92,6570.335
69.6 MB/s		0.053
443.8 MB/s		11.40%✅ +4.7%-1668.8%-253.9%
Brotli_Q92,3766.599
3.5 MB/s		0.092
254.1 MB/s		10.19%-6.5%✅ +10.3%-102.6%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_thin_L02,4942.893
2.8 MB/s		0.091
90.0 MB/s		30.38%———
Zstd_L92,3421.938
4.2 MB/s		0.135
60.8 MB/s		28.53%-6.5%-49.3%✅ +32.4%
Zstd_L9_disjoint_window_dict18,6610.406
20.2 MB/s		0.170
48.3 MB/s		227.30%✅ +86.6%-612.3%✅ +46.4%
Gzip_L92,3400.166
49.4 MB/s		0.041
198.5 MB/s		28.50%-6.6%-1640.8%-120.6%
Brotli_Q92,1516.105
1.3 MB/s		0.075
110.0 MB/s		26.20%-15.9%✅ +52.6%-22.2%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_thin_L01,7843.317
1.4 MB/s		0.034
133.7 MB/s		39.63%———
Zstd_L91,4961.889
2.4 MB/s		0.140
32.2 MB/s		33.23%-19.3%-75.6%✅ +75.9%
Zstd_L9_disjoint_window_dict17,7930.309
14.6 MB/s		0.161
28.0 MB/s		395.22%✅ +90.0%-973.5%✅ +79.0%
Gzip_L91,4800.103
43.5 MB/s		0.028
162.5 MB/s		32.87%-20.5%-3106.5%-21.5%
Brotli_Q91,3795.829
0.8 MB/s		0.050
90.7 MB/s		30.63%-29.4%✅ +43.1%✅ +32.2%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_thin_L01,50535.002
15.0 MB/s		1.172
447.2 MB/s		0.29%———
Zstd_L98,7928.714
60.2 MB/s		0.383
1369.1 MB/s		1.68%✅ +82.9%-301.7%-206.1%
Zstd_L9_disjoint_window_dict24,9753.189
164.4 MB/s		0.376
1395.3 MB/s		4.76%✅ +94.0%-997.4%-212.0%
Gzip_L915,4593.215
163.1 MB/s		0.391
1341.3 MB/s		2.95%✅ +90.3%-988.6%-199.9%
Brotli_Q98,07321.450
24.4 MB/s		0.782
670.2 MB/s		1.54%✅ +81.4%-63.2%-49.9%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_thin_L01,6332.964
1.7 MB/s		0.030
165.8 MB/s		33.02%———
Zstd_L91,3131.904
2.6 MB/s		0.135
36.6 MB/s		26.55%-24.4%-55.7%✅ +77.9%
Zstd_L9_disjoint_window_dict17,6530.306
16.2 MB/s		0.151
32.7 MB/s		356.99%✅ +90.7%-870.1%✅ +80.3%
Gzip_L91,3050.109
45.2 MB/s		0.027
184.7 MB/s		26.39%-25.1%-2611.0%-11.4%
Brotli_Q91,2075.828
0.8 MB/s		0.044
113.6 MB/s		24.41%-35.3%✅ +49.1%✅ +31.5%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_thin_L01,0581.759
0.9 MB/s		0.019
89.9 MB/s		63.54%———
Zstd_L99012.542
0.7 MB/s		0.314
5.3 MB/s		54.11%-17.4%✅ +30.8%✅ +94.1%
Zstd_L9_disjoint_window_dict17,2560.331
5.0 MB/s		0.279
6.0 MB/s		1036.40%✅ +93.9%-431.1%✅ +93.4%
Gzip_L99050.063
26.3 MB/s		0.017
97.0 MB/s		54.35%-16.9%-2673.8%-7.9%
Brotli_Q98415.821
0.3 MB/s		0.031
53.2 MB/s		50.51%-25.8%✅ +69.8%✅ +40.8%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_thin_L036,15172.762
7.2 MB/s		1.297
404.2 MB/s		6.90%———
Zstd_L946,31012.649
41.4 MB/s		0.544
964.0 MB/s		8.83%✅ +21.9%-475.2%-138.5%
Zstd_L9_disjoint_window_dict61,8217.750
67.6 MB/s		0.563
931.1 MB/s		11.79%✅ +41.5%-838.8%-130.3%
Gzip_L950,29611.300
46.4 MB/s		0.840
624.3 MB/s		9.59%✅ +28.1%-543.9%-54.4%
Brotli_Q942,96442.340
12.4 MB/s		1.081
485.1 MB/s		8.20%✅ +15.9%-71.9%-20.0%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_thin_L037,28364.508
8.1 MB/s		1.206
434.6 MB/s		7.11%———
Zstd_L946,81212.245
42.8 MB/s		0.529
990.7 MB/s		8.93%✅ +20.4%-426.8%-127.9%
Zstd_L9_disjoint_window_dict62,5267.706
68.0 MB/s		0.528
992.2 MB/s		11.93%✅ +40.4%-737.1%-128.3%
Gzip_L950,96510.997
47.7 MB/s		0.857
611.6 MB/s		9.72%✅ +26.8%-486.6%-40.7%
Brotli_Q943,11135.564
14.7 MB/s		1.045
501.9 MB/s		8.22%✅ +13.5%-81.4%-15.5%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_thin_L076,93566.869
7.8 MB/s		1.349
388.2 MB/s		14.69%———
Zstd_L969,89611.923
43.9 MB/s		0.533
982.6 MB/s		13.35%-10.1%-460.9%-153.1%
Zstd_L9_disjoint_window_dict88,0477.384
70.9 MB/s		0.607
863.1 MB/s		16.81%✅ +12.6%-805.6%-122.3%
Gzip_L982,59213.601
38.5 MB/s		1.174
446.2 MB/s		15.77%✅ +6.8%-391.7%-14.9%
Brotli_Q967,04541.981
12.5 MB/s		1.504
348.3 MB/s		12.80%-14.8%-59.3%✅ +10.3%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_thin_L071,97866.837
7.8 MB/s		1.240
422.2 MB/s		13.74%———
Zstd_L966,28111.141
47.0 MB/s		0.541
967.9 MB/s		12.66%-8.6%-499.9%-129.2%
Zstd_L9_disjoint_window_dict85,1546.549
80.0 MB/s		0.560
936.0 MB/s		16.26%✅ +15.5%-920.5%-121.7%
Gzip_L977,52312.509
41.9 MB/s		0.990
529.3 MB/s		14.80%✅ +7.2%-434.3%-25.3%
Brotli_Q963,95640.042
13.1 MB/s		1.457
359.5 MB/s		12.21%-12.5%-66.9%✅ +14.9%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_thin_L068,12055.276
9.4 MB/s		1.284
405.2 MB/s		13.09%———
Zstd_L963,0589.632
54.0 MB/s		0.435
1197.7 MB/s		12.11%-8.0%-473.9%-195.6%
Zstd_L9_disjoint_window_dict80,8966.574
79.2 MB/s		0.649
802.3 MB/s		15.54%✅ +15.8%-740.8%-98.0%
Gzip_L975,46510.488
49.6 MB/s		1.056
492.8 MB/s		14.50%✅ +9.7%-427.0%-21.6%
Brotli_Q960,74339.315
13.2 MB/s		1.388
375.0 MB/s		11.67%-12.1%-40.6%✅ +7.5%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_thin_L072,57073.929
7.1 MB/s		1.478
354.3 MB/s		13.85%———
Zstd_L966,46312.838
40.8 MB/s		0.525
997.3 MB/s		12.69%-9.2%-475.9%-181.5%
Zstd_L9_disjoint_window_dict84,8866.929
75.6 MB/s		0.599
873.9 MB/s		16.20%✅ +14.5%-967.0%-146.7%
Gzip_L980,13413.695
38.2 MB/s		1.147
456.9 MB/s		15.30%✅ +9.4%-439.8%-28.9%
Brotli_Q964,20742.608
12.3 MB/s		1.587
330.1 MB/s		12.26%-13.0%-73.5%✅ +6.8%

Hybrid / thin

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_thin_L937,69752.224
10.0 MB/s		0.809
648.1 MB/s		7.19%———
Zstd_L942,49113.121
40.0 MB/s		0.519
1009.2 MB/s		8.11%✅ +11.3%-298.0%-55.7%
Zstd_L9_disjoint_window_dict60,3059.052
57.9 MB/s		0.520
1007.6 MB/s		11.50%✅ +37.5%-477.0%-55.5%
Gzip_L949,60011.333
46.3 MB/s		0.775
676.4 MB/s		9.46%✅ +24.0%-360.8%-4.4%
Brotli_Q942,01445.234
11.6 MB/s		1.005
521.6 MB/s		8.01%✅ +10.3%-15.5%✅ +19.5%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_thin_L912,90822.332
10.7 MB/s		1.377
174.1 MB/s		5.38%———
Zstd_L915,6777.622
31.5 MB/s		0.240
1000.1 MB/s		6.54%✅ +17.7%-193.0%-474.3%
Zstd_L9_disjoint_window_dict31,9602.838
84.5 MB/s		0.234
1025.3 MB/s		13.33%✅ +59.6%-686.8%-488.8%
Gzip_L918,3883.965
60.5 MB/s		0.347
690.7 MB/s		7.67%✅ +29.8%-463.2%-296.7%
Brotli_Q915,12220.252
11.8 MB/s		0.478
501.5 MB/s		6.31%✅ +14.6%-10.3%-188.0%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_thin_L914,51847.125
11.1 MB/s		2.638
198.7 MB/s		2.77%———
Zstd_L919,41610.451
50.2 MB/s		0.456
1150.4 MB/s		3.70%✅ +25.2%-350.9%-478.9%
Zstd_L9_disjoint_window_dict35,5794.365
120.1 MB/s		0.564
929.2 MB/s		6.79%✅ +59.2%-979.5%-367.6%
Gzip_L925,7095.529
94.8 MB/s		0.531
988.0 MB/s		4.90%✅ +43.5%-752.3%-397.1%
Brotli_Q918,52525.137
20.9 MB/s		0.672
780.5 MB/s		3.53%✅ +21.6%-87.5%-292.7%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_thin_L95,45128.813
18.2 MB/s		3.205
163.6 MB/s		1.04%———
Zstd_L916,1059.945
52.7 MB/s		0.390
1344.2 MB/s		3.07%✅ +66.2%-189.7%-721.8%
Zstd_L9_disjoint_window_dict32,1464.767
110.0 MB/s		0.389
1346.9 MB/s		6.13%✅ +83.0%-504.4%-723.4%
Gzip_L919,3767.599
69.0 MB/s		0.494
1060.7 MB/s		3.70%✅ +71.9%-279.2%-548.4%
Brotli_Q915,77234.896
15.0 MB/s		0.667
785.5 MB/s		3.01%✅ +65.4%✅ +17.4%-380.2%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_thin_L937,77259.083
8.9 MB/s		0.596
879.3 MB/s		7.21%———
Zstd_L939,93610.771
48.7 MB/s		0.425
1234.9 MB/s		7.62%✅ +5.4%-448.6%-40.4%
Zstd_L9_disjoint_window_dict58,9325.810
90.2 MB/s		0.485
1080.8 MB/s		11.24%✅ +35.9%-916.9%-22.9%
Gzip_L947,9996.396
82.0 MB/s		0.805
651.4 MB/s		9.16%✅ +21.3%-823.7%✅ +25.9%
Brotli_Q940,40939.118
13.4 MB/s		1.115
470.0 MB/s		7.71%✅ +6.5%-51.0%✅ +46.6%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_thin_L913,02735.396
14.8 MB/s		4.065
129.0 MB/s		2.48%———
Zstd_L920,6619.357
56.0 MB/s		0.364
1441.1 MB/s		3.94%✅ +36.9%-278.3%-1017.5%
Zstd_L9_disjoint_window_dict39,3244.676
112.1 MB/s		0.396
1325.4 MB/s		7.50%✅ +66.9%-657.0%-927.7%
Gzip_L925,7017.820
67.0 MB/s		0.520
1007.2 MB/s		4.90%✅ +49.3%-352.6%-681.0%
Brotli_Q923,23531.955
16.4 MB/s		0.753
696.3 MB/s		4.43%✅ +43.9%-10.8%-439.9%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_thin_L916,10934.998
15.0 MB/s		3.052
171.8 MB/s		3.07%———
Zstd_L928,73911.161
47.0 MB/s		0.519
1009.3 MB/s		5.48%✅ +43.9%-213.6%-487.6%
Zstd_L9_disjoint_window_dict44,9526.587
79.6 MB/s		0.470
1115.6 MB/s		8.57%✅ +64.2%-431.3%-549.5%
Gzip_L935,3509.966
52.6 MB/s		0.682
768.7 MB/s		6.74%✅ +54.4%-251.2%-347.5%
Brotli_Q930,37041.673
12.6 MB/s		0.979
535.6 MB/s		5.79%✅ +47.0%✅ +16.0%-211.8%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_thin_L935,16649.412
10.6 MB/s		3.437
152.5 MB/s		6.71%———
Zstd_L940,21811.792
44.5 MB/s		0.515
1017.9 MB/s		7.67%✅ +12.6%-319.0%-567.3%
Zstd_L9_disjoint_window_dict56,5077.054
74.3 MB/s		0.565
928.5 MB/s		10.78%✅ +37.8%-600.5%-508.7%
Gzip_L950,43910.638
49.3 MB/s		0.864
607.0 MB/s		9.62%✅ +30.3%-364.5%-297.9%
Brotli_Q940,03344.411
11.8 MB/s		1.221
429.2 MB/s		7.64%✅ +12.2%-11.3%-181.4%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_thin_L99,65038.691
13.5 MB/s		2.866
182.9 MB/s		1.84%———
Zstd_L914,9928.169
64.2 MB/s		0.366
1431.7 MB/s		2.86%✅ +35.6%-373.6%-682.8%
Zstd_L9_disjoint_window_dict32,8323.627
144.5 MB/s		0.415
1263.8 MB/s		6.26%✅ +70.6%-966.9%-591.0%
Gzip_L922,7065.574
94.0 MB/s		0.521
1006.7 MB/s		4.33%✅ +57.5%-594.1%-450.4%
Brotli_Q915,13927.432
19.1 MB/s		0.886
591.5 MB/s		2.89%✅ +36.3%-41.0%-223.4%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_thin_L926,07140.884
12.8 MB/s		0.737
710.9 MB/s		4.97%———
Zstd_L930,21210.712
48.9 MB/s		0.461
1135.8 MB/s		5.76%✅ +13.7%-281.7%-59.8%
Zstd_L9_disjoint_window_dict46,5596.176
84.9 MB/s		0.488
1074.0 MB/s		8.88%✅ +44.0%-562.0%-51.1%
Gzip_L941,97511.632
45.1 MB/s		0.753
696.4 MB/s		8.01%✅ +37.9%-251.5%✅ +2.0%
Brotli_Q930,78838.812
13.5 MB/s		0.981
534.2 MB/s		5.87%✅ +15.3%-5.3%✅ +24.9%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_thin_L920,02136.976
14.2 MB/s		2.860
183.3 MB/s		3.82%———
Zstd_L927,27310.725
48.9 MB/s		0.485
1081.3 MB/s		5.20%✅ +26.6%-244.8%-490.0%
Zstd_L9_disjoint_window_dict43,2315.105
102.7 MB/s		0.468
1121.1 MB/s		8.25%✅ +53.7%-624.3%-511.7%
Gzip_L936,6955.341
98.2 MB/s		0.702
746.3 MB/s		7.00%✅ +45.4%-592.3%-307.2%
Brotli_Q925,47830.393
17.2 MB/s		0.941
557.4 MB/s		4.86%✅ +21.4%-21.7%-204.1%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_thin_L938,97448.867
10.7 MB/s		1.177
445.3 MB/s		7.43%———
Zstd_L945,69211.825
44.3 MB/s		0.545
962.6 MB/s		8.72%✅ +14.7%-313.2%-116.2%
Zstd_L9_disjoint_window_dict65,2126.789
77.2 MB/s		0.716
731.8 MB/s		12.44%✅ +40.2%-619.8%-64.3%
Gzip_L999,26715.300
34.3 MB/s		1.472
356.3 MB/s		18.93%✅ +60.7%-219.4%✅ +20.0%
Brotli_Q942,92836.197
14.5 MB/s		1.143
458.5 MB/s		8.19%✅ +9.2%-35.0%-3.0%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_thin_L918,13654.525
9.6 MB/s		3.907
134.2 MB/s		3.46%———
Zstd_L937,09011.802
44.4 MB/s		0.505
1038.4 MB/s		7.07%✅ +51.1%-362.0%-673.8%
Zstd_L9_disjoint_window_dict53,3257.253
72.3 MB/s		0.525
997.6 MB/s		10.17%✅ +66.0%-651.8%-643.4%
Gzip_L942,86513.079
40.1 MB/s		0.804
652.0 MB/s		8.18%✅ +57.7%-316.9%-385.9%
Brotli_Q936,40940.344
13.0 MB/s		1.123
466.9 MB/s		6.94%✅ +50.2%-35.1%-247.9%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_thin_L923,97337.558
14.0 MB/s		1.037
505.5 MB/s		4.57%———
Zstd_L928,5669.981
52.5 MB/s		0.370
1417.8 MB/s		5.45%✅ +16.1%-276.3%-180.5%
Zstd_L9_disjoint_window_dict44,9215.432
96.5 MB/s		0.382
1371.5 MB/s		8.57%✅ +46.6%-591.4%-171.3%
Gzip_L934,1317.270
72.1 MB/s		0.630
832.0 MB/s		6.51%✅ +29.8%-416.6%-64.6%
Brotli_Q928,57427.298
19.2 MB/s		0.911
575.3 MB/s		5.45%✅ +16.1%-37.6%-13.8%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_thin_L911,94834.366
15.3 MB/s		3.115
168.3 MB/s		2.28%———
Zstd_L925,78710.518
49.8 MB/s		0.450
1165.0 MB/s		4.92%✅ +53.7%-226.7%-592.3%
Zstd_L9_disjoint_window_dict42,0176.047
86.7 MB/s		0.478
1097.5 MB/s		8.02%✅ +71.6%-468.3%-552.2%
Gzip_L933,41911.295
46.4 MB/s		0.619
846.8 MB/s		6.37%✅ +64.2%-204.3%-403.2%
Brotli_Q926,83150.502
10.4 MB/s		0.989
530.2 MB/s		5.12%✅ +55.5%✅ +32.0%-215.1%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_thin_L922,76635.741
14.7 MB/s		2.760
189.9 MB/s		4.34%———
Zstd_L924,92810.143
51.7 MB/s		0.423
1240.6 MB/s		4.76%✅ +8.7%-252.4%-553.3%
Zstd_L9_disjoint_window_dict40,8535.604
93.6 MB/s		0.431
1217.4 MB/s		7.79%✅ +44.3%-537.8%-541.1%
Gzip_L927,3398.803
59.6 MB/s		0.657
798.3 MB/s		5.22%✅ +16.7%-306.0%-320.4%
Brotli_Q925,01628.611
18.3 MB/s		0.961
545.4 MB/s		4.77%✅ +9.0%-24.9%-187.2%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_thin_L96442.047
1.6 MB/s		0.010
325.3 MB/s		20.27%———
Zstd_L96211.805
1.8 MB/s		0.131
24.3 MB/s		19.55%-3.7%-13.4%✅ +92.5%
Zstd_L9_disjoint_window_dict16,9830.284
11.2 MB/s		0.156
20.3 MB/s		534.56%✅ +96.2%-620.1%✅ +93.8%
Gzip_L96340.065
49.0 MB/s		0.019
165.5 MB/s		19.96%-1.6%-3057.7%✅ +49.1%
Brotli_Q95875.548
0.6 MB/s		0.034
94.2 MB/s		18.48%-9.7%✅ +63.1%✅ +71.0%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_thin_L95611.210
1.3 MB/s		0.007
230.3 MB/s		34.80%———
Zstd_L95381.863
0.9 MB/s		0.115
14.0 MB/s		33.37%-4.3%✅ +35.0%✅ +93.9%
Zstd_L9_disjoint_window_dict16,8930.228
7.1 MB/s		0.156
10.3 MB/s		1047.95%✅ +96.7%-430.0%✅ +95.5%
Gzip_L95410.060
27.0 MB/s		0.016
98.0 MB/s		33.56%-3.7%-1923.9%✅ +57.4%
Brotli_Q94705.771
0.3 MB/s		0.028
58.2 MB/s		29.16%-19.4%✅ +79.0%✅ +74.7%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_thin_L92,2644.949
4.7 MB/s		0.059
393.1 MB/s		9.71%———
Zstd_L92,4651.988
11.7 MB/s		0.033
700.7 MB/s		10.57%✅ +8.2%-149.0%-78.2%
Zstd_L9_disjoint_window_dict18,8240.521
44.8 MB/s		0.048
482.1 MB/s		80.75%✅ +88.0%-850.8%-22.6%
Gzip_L92,6570.335
69.6 MB/s		0.053
443.8 MB/s		11.40%✅ +14.8%-1378.3%-12.9%
Brotli_Q92,3766.599
3.5 MB/s		0.092
254.1 MB/s		10.19%✅ +4.7%✅ +25.0%✅ +35.4%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_thin_L92,2282.619
3.1 MB/s		0.063
129.3 MB/s		27.14%———
Zstd_L92,3421.938
4.2 MB/s		0.135
60.8 MB/s		28.53%✅ +4.9%-35.1%✅ +53.0%
Zstd_L9_disjoint_window_dict18,6610.406
20.2 MB/s		0.170
48.3 MB/s		227.30%✅ +88.1%-544.8%✅ +62.7%
Gzip_L92,3400.166
49.4 MB/s		0.041
198.5 MB/s		28.50%✅ +4.8%-1475.8%-53.5%
Brotli_Q92,1516.105
1.3 MB/s		0.075
110.0 MB/s		26.20%-3.6%✅ +57.1%✅ +14.9%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,5192.530
1.8 MB/s		0.011
409.1 MB/s		33.74%———
Zstd_L91,4961.889
2.4 MB/s		0.140
32.2 MB/s		33.23%-1.5%-34.0%✅ +92.1%
Zstd_L9_disjoint_window_dict17,7930.309
14.6 MB/s		0.161
28.0 MB/s		395.22%✅ +91.5%-718.8%✅ +93.1%
Gzip_L91,4800.103
43.5 MB/s		0.028
162.5 MB/s		32.87%-2.6%-2345.9%✅ +60.3%
Brotli_Q91,3795.829
0.8 MB/s		0.050
90.7 MB/s		30.63%-10.2%✅ +56.6%✅ +77.8%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,16327.988
18.7 MB/s		0.931
563.1 MB/s		0.22%———
Zstd_L98,7928.714
60.2 MB/s		0.383
1369.1 MB/s		1.68%✅ +86.8%-221.2%-143.1%
Zstd_L9_disjoint_window_dict24,9753.189
164.4 MB/s		0.376
1395.3 MB/s		4.76%✅ +95.3%-777.5%-147.8%
Gzip_L915,4593.215
163.1 MB/s		0.391
1341.3 MB/s		2.95%✅ +92.5%-770.5%-138.2%
Brotli_Q98,07321.450
24.4 MB/s		0.782
670.2 MB/s		1.54%✅ +85.6%-30.5%-19.0%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,3362.379
2.1 MB/s		0.011
437.8 MB/s		27.02%———
Zstd_L91,3131.904
2.6 MB/s		0.135
36.6 MB/s		26.55%-1.8%-25.0%✅ +91.6%
Zstd_L9_disjoint_window_dict17,6530.306
16.2 MB/s		0.151
32.7 MB/s		356.99%✅ +92.4%-678.7%✅ +92.5%
Gzip_L91,3050.109
45.2 MB/s		0.027
184.7 MB/s		26.39%-2.4%-2076.0%✅ +57.8%
Brotli_Q91,2075.828
0.8 MB/s		0.044
113.6 MB/s		24.41%-10.7%✅ +59.2%✅ +74.1%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_thin_L99261.436
1.2 MB/s		0.008
219.2 MB/s		55.62%———
Zstd_L99012.542
0.7 MB/s		0.314
5.3 MB/s		54.11%-2.8%✅ +43.5%✅ +97.6%
Zstd_L9_disjoint_window_dict17,2560.331
5.0 MB/s		0.279
6.0 MB/s		1036.40%✅ +94.6%-333.5%✅ +97.3%
Gzip_L99050.063
26.3 MB/s		0.017
97.0 MB/s		54.35%-2.3%-2164.0%✅ +55.7%
Brotli_Q98415.821
0.3 MB/s		0.031
53.2 MB/s		50.51%-10.1%✅ +75.3%✅ +75.7%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_thin_L935,05758.863
8.9 MB/s		1.044
502.2 MB/s		6.69%———
Zstd_L946,31012.649
41.4 MB/s		0.544
964.0 MB/s		8.83%✅ +24.3%-365.4%-91.9%
Zstd_L9_disjoint_window_dict61,8217.750
67.6 MB/s		0.563
931.1 MB/s		11.79%✅ +43.3%-659.5%-85.4%
Gzip_L950,29611.300
46.4 MB/s		0.840
624.3 MB/s		9.59%✅ +30.3%-420.9%-24.3%
Brotli_Q942,96442.340
12.4 MB/s		1.081
485.1 MB/s		8.20%✅ +18.4%-39.0%✅ +3.4%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_thin_L935,95655.462
9.5 MB/s		0.915
572.9 MB/s		6.86%———
Zstd_L946,81212.245
42.8 MB/s		0.529
990.7 MB/s		8.93%✅ +23.2%-352.9%-72.9%
Zstd_L9_disjoint_window_dict62,5267.706
68.0 MB/s		0.528
992.2 MB/s		11.93%✅ +42.5%-619.7%-73.2%
Gzip_L950,96510.997
47.7 MB/s		0.857
611.6 MB/s		9.72%✅ +29.4%-404.3%-6.7%
Brotli_Q943,11135.564
14.7 MB/s		1.045
501.9 MB/s		8.22%✅ +16.6%-55.9%✅ +12.4%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_thin_L969,50754.390
9.6 MB/s		0.526
996.0 MB/s		13.27%———
Zstd_L969,89611.923
43.9 MB/s		0.533
982.6 MB/s		13.35%✅ +0.6%-356.2%✅ +1.3%
Zstd_L9_disjoint_window_dict88,0477.384
70.9 MB/s		0.607
863.1 MB/s		16.81%✅ +21.1%-636.6%✅ +13.3%
Gzip_L982,59213.601
38.5 MB/s		1.174
446.2 MB/s		15.77%✅ +15.8%-299.9%✅ +55.2%
Brotli_Q967,04541.981
12.5 MB/s		1.504
348.3 MB/s		12.80%-3.7%-29.6%✅ +65.0%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_thin_L965,77555.939
9.4 MB/s		0.515
1016.6 MB/s		12.56%———
Zstd_L966,28111.141
47.0 MB/s		0.541
967.9 MB/s		12.66%✅ +0.8%-402.1%✅ +4.8%
Zstd_L9_disjoint_window_dict85,1546.549
80.0 MB/s		0.560
936.0 MB/s		16.26%✅ +22.8%-754.1%✅ +7.9%
Gzip_L977,52312.509
41.9 MB/s		0.990
529.3 MB/s		14.80%✅ +15.2%-347.2%✅ +47.9%
Brotli_Q963,95640.042
13.1 MB/s		1.457
359.5 MB/s		12.21%-2.8%-39.7%✅ +64.6%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_thin_L962,75341.741
12.5 MB/s		0.415
1254.5 MB/s		12.06%———
Zstd_L963,0589.632
54.0 MB/s		0.435
1197.7 MB/s		12.11%✅ +0.5%-333.4%✅ +4.5%
Zstd_L9_disjoint_window_dict80,8966.574
79.2 MB/s		0.649
802.3 MB/s		15.54%✅ +22.4%-534.9%✅ +36.1%
Gzip_L975,46510.488
49.6 MB/s		1.056
492.8 MB/s		14.50%✅ +16.8%-298.0%✅ +60.7%
Brotli_Q960,74339.315
13.2 MB/s		1.388
375.0 MB/s		11.67%-3.3%-6.2%✅ +70.1%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_thin_L966,17764.904
8.1 MB/s		0.546
959.8 MB/s		12.63%———
Zstd_L966,46312.838
40.8 MB/s		0.525
997.3 MB/s		12.69%✅ +0.4%-405.6%-3.9%
Zstd_L9_disjoint_window_dict84,8866.929
75.6 MB/s		0.599
873.9 MB/s		16.20%✅ +22.0%-836.8%✅ +8.9%
Gzip_L980,13413.695
38.2 MB/s		1.147
456.9 MB/s		15.30%✅ +17.4%-373.9%✅ +52.4%
Brotli_Q964,20742.608
12.3 MB/s		1.587
330.1 MB/s		12.26%-3.1%-52.3%✅ +65.6%