Public 30-file benchmark

PIZD 6.0.0-rc9 · 11,815,190 input bytes · 540 verified configuration rows · 5 measured rounds + 3 warmups.

16 system logs + 2 historical HTTP windows + 4 public JSON event windows + 8 parser fixtures. Bounded excerpts, not 30 complete production captures. Methodology and limits · CSV · Source provenance · Pairwise wins · Results by source category

Aggregate measurements

Times sum the per-file medians. Full external dictionary bytes are charged per file. 🏆 indicates best metric across all 18 configurations.

ConfigurationArchive bytesBytes incl. dictionarySource %Encode msVerified decode msEncode MB/sVerified decode MB/sBytes with shared dictionaryWins vs Zstd baseline (/30)
Brotli_Q11,099,6941,099,6949.31%46.16741.368255.9285.61,099,694— (Baseline)
Brotli_Q6834,540834,5407.06%357.56128.45233.0415.3834,540— (Baseline)
Brotli_Q9815,753815,7536.90%983.43029.40212.0401.8815,753— (Baseline)
Gzip_L11,562,3991,562,39913.22%43.27528.593273.0413.21,562,399— (Baseline)
Gzip_L61,058,9181,058,9188.96%174.13521.50967.9549.31,058,918— (Baseline)
Gzip_L91,053,2551,053,2558.91%265.44321.61844.5546.51,053,255— (Baseline)
PIZD_hybrid_default835,189835,1897.07%155.56721.79975.9542.0835,189Size 20/30 · Encode 0/30 · Decode 10/30
PIZD_hybrid_fast957,119957,1198.10%76.44213.959154.6846.5957,119Size 9/30 · Encode 0/30 · Decode 25/30
PIZD_hybrid_thin_L9🏆 687,206🏆 687,206🏆 5.82%994.97342.72011.9276.6🏆 687,206Size 30/30 · Encode 2/30 · Decode 6/30
PIZD_native_default797,458797,4586.75%315.10544.26537.5266.9797,458Size 21/30 · Encode 0/30 · Decode 0/30
PIZD_native_fast1,250,1901,250,19010.58%218.33138.62354.1305.91,250,190Size 8/30 · Encode 0/30 · Decode 0/30
PIZD_native_thin_L0711,835711,8356.02%10276.14960.6101.1194.9711,835Size 21/30 · Encode 0/30 · Decode 5/30
Zstd_L1985,110985,1108.34%31.34713.876376.9851.5985,110— (Baseline)
Zstd_L1_disjoint_window_dict1,014,1811,505,70112.74%31.33314.170377.1833.81,030,565— (Baseline)
Zstd_L3980,830980,8308.30%🏆 30.014🏆 13.355🏆 393.7🏆 884.7980,830— (Baseline)
Zstd_L3_disjoint_window_dict981,8961,473,41612.47%38.98614.081303.1839.1998,280— (Baseline)
Zstd_L9835,071835,0717.07%295.60014.07440.0839.5835,071— (Baseline)
Zstd_L9_disjoint_window_dict849,5031,341,02311.35%163.57814.41072.2819.9865,887— (Baseline)

Pairwise Head-to-Head Win Rates (out of 30 files)

Number of files where PIZD achieves strictly smaller compressed bytes or lower execution latency than the reference codec.

PIZD ConfigurationReference BaselineSize Wins / 30Compression Speed Wins / 30Verified Decompression Wins / 30
Native DefaultZstd_L3✅ 21/30 (70.0%)0/30 (0.0%)0/30 (0.0%)
Native DefaultZstd_L3_disjoint_window_dict✅ 30/30 (100.0%)0/30 (0.0%)1/30 (3.3%)
Native DefaultGzip_L6✅ 23/30 (76.7%)1/30 (3.3%)0/30 (0.0%)
Native DefaultBrotli_Q612/30 (40.0%)✅ 18/30 (60.0%)5/30 (16.7%)
Hybrid DefaultZstd_L3✅ 20/30 (66.7%)0/30 (0.0%)10/30 (33.3%)
Hybrid DefaultZstd_L3_disjoint_window_dict✅ 30/30 (100.0%)2/30 (6.7%)10/30 (33.3%)
Hybrid DefaultGzip_L6✅ 22/30 (73.3%)✅ 19/30 (63.3%)✅ 16/30 (53.3%)
Hybrid DefaultBrotli_Q612/30 (40.0%)✅ 27/30 (90.0%)✅ 25/30 (83.3%)
Native FastZstd_L18/30 (26.7%)0/30 (0.0%)0/30 (0.0%)
Native FastZstd_L1_disjoint_window_dict✅ 24/30 (80.0%)0/30 (0.0%)2/30 (6.7%)
Native FastGzip_L1✅ 15/30 (50.0%)0/30 (0.0%)12/30 (40.0%)
Native FastBrotli_Q19/30 (30.0%)0/30 (0.0%)✅ 21/30 (70.0%)
Hybrid FastZstd_L19/30 (30.0%)0/30 (0.0%)✅ 25/30 (83.3%)
Hybrid FastZstd_L1_disjoint_window_dict✅ 30/30 (100.0%)4/30 (13.3%)✅ 25/30 (83.3%)
Hybrid FastGzip_L1✅ 30/30 (100.0%)2/30 (6.7%)✅ 28/30 (93.3%)
Hybrid FastBrotli_Q1✅ 29/30 (96.7%)5/30 (16.7%)✅ 29/30 (96.7%)
Native ThinZstd_L9✅ 21/30 (70.0%)0/30 (0.0%)5/30 (16.7%)
Native ThinZstd_L9_disjoint_window_dict✅ 30/30 (100.0%)0/30 (0.0%)5/30 (16.7%)
Native ThinGzip_L9✅ 24/30 (80.0%)0/30 (0.0%)2/30 (6.7%)
Native ThinBrotli_Q9✅ 19/30 (63.3%)2/30 (6.7%)7/30 (23.3%)
Hybrid ThinZstd_L9✅ 30/30 (100.0%)2/30 (6.7%)6/30 (20.0%)
Hybrid ThinZstd_L9_disjoint_window_dict✅ 30/30 (100.0%)0/30 (0.0%)6/30 (20.0%)
Hybrid ThinGzip_L9✅ 28/30 (93.3%)0/30 (0.0%)11/30 (36.7%)
Hybrid ThinBrotli_Q9✅ 20/30 (66.7%)✅ 15/30 (50.0%)✅ 16/30 (53.3%)

Three preset comparisons, each with Native and Hybrid

✅ means PIZD is better for that individual measure. Advantage = 100 × (reference − PIZD) / reference. Negative values retain PIZD losses. All decode times include BLAKE3 source verification; every restoration also passes exact-byte and SHA-256 checks outside the timer.

Native / default

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_default44,59311.963
43.8 MB/s		1.680
312.1 MB/s		8.51%———
Zstd_L350,1551.577
332.4 MB/s		0.563
931.2 MB/s		9.57%✅ +11.1%-658.7%-198.4%
Zstd_L3_disjoint_window_dict66,8671.547
338.8 MB/s		0.620
845.5 MB/s		12.76%✅ +33.3%-673.3%-170.9%
Gzip_L650,1747.564
69.3 MB/s		0.901
581.6 MB/s		9.57%✅ +11.1%-58.2%-86.4%
Brotli_Q643,32115.106
34.7 MB/s		1.122
467.3 MB/s		8.26%-2.9%✅ +20.8%-49.8%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_default16,2515.526
43.4 MB/s		0.741
323.4 MB/s		6.78%———
Zstd_L318,6500.476
503.2 MB/s		0.231
1037.7 MB/s		7.78%✅ +12.9%-1059.7%-220.9%
Zstd_L3_disjoint_window_dict34,9320.617
388.5 MB/s		0.261
920.0 MB/s		14.57%✅ +53.5%-795.4%-184.5%
Gzip_L618,4622.785
86.1 MB/s		0.362
661.8 MB/s		7.70%✅ +12.0%-98.4%-104.7%
Brotli_Q615,2705.008
47.9 MB/s		0.502
478.1 MB/s		6.37%-6.4%-10.3%-47.8%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_default24,3579.563
54.8 MB/s		1.644
318.9 MB/s		4.65%———
Zstd_L323,4370.767
683.8 MB/s		0.454
1154.5 MB/s		4.47%-3.9%-1147.5%-262.0%
Zstd_L3_disjoint_window_dict39,7450.934
561.3 MB/s		0.461
1136.8 MB/s		7.58%✅ +38.7%-923.9%-256.5%
Gzip_L625,7064.335
120.9 MB/s		0.602
870.3 MB/s		4.90%✅ +5.2%-120.6%-172.9%
Brotli_Q618,88811.114
47.2 MB/s		0.770
680.5 MB/s		3.60%-29.0%✅ +14.0%-113.4%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_default9,2746.219
84.3 MB/s		0.848
618.2 MB/s		1.77%———
Zstd_L321,8080.728
719.9 MB/s		0.424
1236.8 MB/s		4.16%✅ +57.5%-754.0%-100.1%
Zstd_L3_disjoint_window_dict38,0140.884
593.3 MB/s		0.461
1136.5 MB/s		7.25%✅ +75.6%-603.8%-83.8%
Gzip_L619,5024.068
128.9 MB/s		0.514
1019.6 MB/s		3.72%✅ +52.4%-52.9%-64.9%
Brotli_Q615,75711.699
44.8 MB/s		0.693
756.9 MB/s		3.01%✅ +41.1%✅ +46.8%-22.4%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_default41,9839.876
53.1 MB/s		1.344
390.0 MB/s		8.01%———
Zstd_L345,5571.141
459.5 MB/s		0.474
1106.2 MB/s		8.69%✅ +7.8%-765.6%-183.6%
Zstd_L3_disjoint_window_dict61,8701.746
300.2 MB/s		0.507
1034.0 MB/s		11.80%✅ +32.1%-465.5%-165.1%
Gzip_L648,1956.061
86.5 MB/s		0.837
626.2 MB/s		9.19%✅ +12.9%-62.9%-60.5%
Brotli_Q640,69513.503
38.8 MB/s		1.162
451.2 MB/s		7.76%-3.2%✅ +26.9%-15.7%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_default18,0286.133
85.5 MB/s		1.084
483.4 MB/s		3.44%———
Zstd_L325,2790.732
716.1 MB/s		0.386
1358.1 MB/s		4.82%✅ +28.7%-737.8%-180.9%
Zstd_L3_disjoint_window_dict41,5960.996
526.1 MB/s		0.401
1306.4 MB/s		7.93%✅ +56.7%-515.5%-170.2%
Gzip_L625,6724.381
119.7 MB/s		0.563
931.4 MB/s		4.90%✅ +29.8%-40.0%-92.7%
Brotli_Q623,19911.025
47.6 MB/s		0.793
660.9 MB/s		4.43%✅ +22.3%✅ +44.4%-36.7%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_default21,5729.280
56.5 MB/s		1.509
347.4 MB/s		4.11%———
Zstd_L336,7510.960
546.4 MB/s		0.489
1071.7 MB/s		7.01%✅ +41.3%-867.1%-208.5%
Zstd_L3_disjoint_window_dict53,5571.176
445.6 MB/s		0.516
1015.8 MB/s		10.22%✅ +59.7%-688.8%-192.5%
Gzip_L635,5225.856
89.5 MB/s		0.667
786.3 MB/s		6.78%✅ +39.3%-58.5%-126.4%
Brotli_Q630,68613.943
37.6 MB/s		0.958
547.5 MB/s		5.85%✅ +29.7%✅ +33.4%-57.6%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_default41,66811.240
46.6 MB/s		1.620
323.6 MB/s		7.95%———
Zstd_L347,7101.135
462.0 MB/s		0.513
1021.2 MB/s		9.10%✅ +12.7%-890.7%-215.6%
Zstd_L3_disjoint_window_dict64,1811.466
357.5 MB/s		0.551
950.7 MB/s		12.24%✅ +35.1%-666.6%-193.8%
Gzip_L650,6287.175
73.1 MB/s		0.852
615.4 MB/s		9.66%✅ +17.7%-56.7%-90.2%
Brotli_Q640,47214.202
36.9 MB/s		1.134
462.4 MB/s		7.72%-3.0%✅ +20.9%-42.9%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_default16,5276.972
75.2 MB/s		0.917
571.9 MB/s		3.15%———
Zstd_L320,3400.638
821.4 MB/s		0.377
1391.2 MB/s		3.88%✅ +18.7%-992.4%-143.2%
Zstd_L3_disjoint_window_dict36,8540.842
622.7 MB/s		0.399
1313.7 MB/s		7.03%✅ +55.2%-728.1%-129.7%
Gzip_L622,8163.822
137.2 MB/s		0.517
1014.3 MB/s		4.35%✅ +27.6%-82.4%-77.3%
Brotli_Q615,23110.006
52.4 MB/s		0.887
591.2 MB/s		2.91%-8.5%✅ +30.3%-3.4%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_default30,5248.663
60.5 MB/s		1.573
333.1 MB/s		5.82%———
Zstd_L337,1130.983
533.2 MB/s		0.492
1066.0 MB/s		7.08%✅ +17.8%-781.3%-220.0%
Zstd_L3_disjoint_window_dict53,6681.275
411.0 MB/s		0.527
995.4 MB/s		10.24%✅ +43.1%-579.3%-198.8%
Gzip_L642,1146.635
79.0 MB/s		0.746
702.4 MB/s		8.03%✅ +27.5%-30.6%-110.9%
Brotli_Q631,18213.169
39.8 MB/s		0.982
533.8 MB/s		5.95%✅ +2.1%✅ +34.2%-60.2%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_default21,6957.983
65.7 MB/s		0.982
534.1 MB/s		4.14%———
Zstd_L333,1020.866
605.2 MB/s		0.510
1026.9 MB/s		6.31%✅ +34.5%-821.6%-92.3%
Zstd_L3_disjoint_window_dict49,2731.079
485.6 MB/s		0.543
966.0 MB/s		9.40%✅ +56.0%-639.5%-80.9%
Gzip_L637,0154.441
118.0 MB/s		0.690
760.0 MB/s		7.06%✅ +41.4%-79.8%-42.3%
Brotli_Q626,06211.182
46.9 MB/s		0.875
599.4 MB/s		4.97%✅ +16.8%✅ +28.6%-12.2%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_default39,76610.398
50.4 MB/s		1.976
265.3 MB/s		7.58%———
Zstd_L354,8241.342
390.6 MB/s		0.589
890.5 MB/s		10.46%✅ +27.5%-674.6%-235.7%
Zstd_L3_disjoint_window_dict71,0402.082
251.9 MB/s		0.599
875.9 MB/s		13.55%✅ +44.0%-399.5%-230.2%
Gzip_L699,45711.769
44.5 MB/s		1.485
353.0 MB/s		18.97%✅ +60.0%✅ +11.6%-33.1%
Brotli_Q645,18914.281
36.7 MB/s		1.184
442.7 MB/s		8.62%✅ +12.0%✅ +27.2%-66.9%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_default33,89928.490
18.4 MB/s		1.847
283.8 MB/s		6.47%———
Zstd_L347,0751.327
395.1 MB/s		0.644
814.5 MB/s		8.98%✅ +28.0%-2047.1%-186.9%
Zstd_L3_disjoint_window_dict63,5301.591
329.6 MB/s		0.676
776.0 MB/s		12.12%✅ +46.6%-1691.1%-173.4%
Gzip_L642,9957.825
67.0 MB/s		0.901
581.6 MB/s		8.20%✅ +21.2%-264.1%-104.9%
Brotli_Q636,90816.088
32.6 MB/s		1.231
426.0 MB/s		7.04%✅ +8.2%-77.1%-50.1%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_default25,22112.346
42.5 MB/s		2.238
234.3 MB/s		4.81%———
Zstd_L335,0451.458
359.6 MB/s		0.580
903.8 MB/s		6.69%✅ +28.0%-746.9%-285.8%
Zstd_L3_disjoint_window_dict51,4511.397
375.2 MB/s		0.601
872.0 MB/s		9.81%✅ +51.0%-783.7%-272.2%
Gzip_L634,3096.645
78.9 MB/s		0.910
576.3 MB/s		6.54%✅ +26.5%-85.8%-146.0%
Brotli_Q628,93315.501
33.8 MB/s		1.397
375.4 MB/s		5.52%✅ +12.8%✅ +20.4%-60.2%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_default17,01910.002
52.4 MB/s		1.744
300.6 MB/s		3.25%———
Zstd_L335,5411.199
437.3 MB/s		0.618
847.8 MB/s		6.78%✅ +52.1%-734.3%-182.1%
Zstd_L3_disjoint_window_dict52,1231.460
359.1 MB/s		0.655
799.9 MB/s		9.94%✅ +67.3%-585.2%-166.1%
Gzip_L633,4508.778
59.7 MB/s		0.787
665.7 MB/s		6.38%✅ +49.1%-13.9%-121.5%
Brotli_Q627,10417.983
29.2 MB/s		1.107
473.7 MB/s		5.17%✅ +37.2%✅ +44.4%-57.6%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_default27,01112.765
41.1 MB/s		1.607
326.1 MB/s		5.15%———
Zstd_L332,2911.193
439.5 MB/s		0.620
845.2 MB/s		6.16%✅ +16.4%-970.2%-159.2%
Zstd_L3_disjoint_window_dict48,8361.407
372.5 MB/s		0.641
817.6 MB/s		9.32%✅ +44.7%-807.0%-150.7%
Gzip_L627,5826.956
75.4 MB/s		0.873
600.2 MB/s		5.26%✅ +2.1%-83.5%-84.1%
Brotli_Q625,46414.585
35.9 MB/s		1.281
409.2 MB/s		4.86%-6.1%✅ +12.5%-25.5%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_default8011.229
2.6 MB/s		0.026
121.5 MB/s		25.21%———
Zstd_L36680.072
44.2 MB/s		0.014
224.1 MB/s		21.03%-19.9%-1611.5%-84.4%
Zstd_L3_disjoint_window_dict17,0070.121
26.2 MB/s		0.023
137.0 MB/s		535.32%✅ +95.3%-913.5%-12.7%
Gzip_L66340.071
44.9 MB/s		0.022
146.7 MB/s		19.96%-26.3%-1636.5%-20.7%
Brotli_Q65920.265
12.0 MB/s		0.038
84.1 MB/s		18.63%-35.3%-363.5%✅ +30.8%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_default6780.656
2.5 MB/s		0.019
84.7 MB/s		42.06%———
Zstd_L35450.064
25.4 MB/s		0.009
171.2 MB/s		33.81%-24.4%-932.5%-102.0%
Zstd_L3_disjoint_window_dict16,9080.124
13.0 MB/s		0.020
80.3 MB/s		1048.88%✅ +96.0%-428.4%✅ +5.3%
Gzip_L65410.058
27.9 MB/s		0.018
88.7 MB/s		33.56%-25.3%-1032.8%-4.6%
Brotli_Q64740.233
6.9 MB/s		0.032
50.7 MB/s		29.40%-43.0%-180.8%✅ +40.2%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_default3,1004.580
5.1 MB/s		0.138
169.5 MB/s		13.30%———
Zstd_L32,7540.136
171.7 MB/s		0.044
535.0 MB/s		11.81%-12.6%-3272.8%-215.7%
Zstd_L3_disjoint_window_dict19,1390.208
111.8 MB/s		0.061
379.6 MB/s		82.10%✅ +83.8%-2097.2%-124.0%
Gzip_L62,6600.374
62.3 MB/s		0.069
335.9 MB/s		11.41%-16.5%-1123.2%-98.3%
Brotli_Q62,3950.766
30.4 MB/s		0.112
207.9 MB/s		10.27%-29.4%-497.5%-22.7%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_default2,9461.593
5.2 MB/s		0.076
108.0 MB/s		35.88%———
Zstd_L32,4550.105
78.1 MB/s		0.023
358.4 MB/s		29.90%-20.0%-1414.7%-231.7%
Zstd_L3_disjoint_window_dict18,8520.189
43.4 MB/s		0.037
219.9 MB/s		229.62%✅ +84.4%-742.9%-103.5%
Gzip_L62,3400.194
42.4 MB/s		0.052
159.2 MB/s		28.50%-25.9%-723.1%-47.4%
Brotli_Q62,1580.542
15.1 MB/s		0.092
89.5 MB/s		26.29%-36.5%-193.7%✅ +17.2%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_default1,8842.927
1.5 MB/s		0.048
93.9 MB/s		41.85%———
Zstd_L31,5650.121
37.1 MB/s		0.018
246.4 MB/s		34.76%-20.4%-2312.1%-162.3%
Zstd_L3_disjoint_window_dict17,8960.209
21.5 MB/s		0.034
133.7 MB/s		397.51%✅ +89.5%-1298.3%-42.4%
Gzip_L61,4800.145
31.0 MB/s		0.036
125.5 MB/s		32.87%-27.3%-1915.2%-33.6%
Brotli_Q61,3780.606
7.4 MB/s		0.094
47.9 MB/s		30.61%-36.7%-383.2%✅ +49.0%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_default1,7577.536
69.6 MB/s		1.406
372.7 MB/s		0.34%———
Zstd_L38,1480.834
628.4 MB/s		0.522
1003.8 MB/s		1.55%✅ +78.4%-803.3%-169.3%
Zstd_L3_disjoint_window_dict24,5650.952
550.7 MB/s		0.542
968.2 MB/s		4.69%✅ +92.8%-691.5%-159.7%
Gzip_L615,4593.457
151.6 MB/s		0.559
937.8 MB/s		2.95%✅ +88.6%-118.0%-151.6%
Brotli_Q68,12515.196
34.5 MB/s		0.817
641.9 MB/s		1.55%✅ +78.4%✅ +50.4%-72.2%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_default1,6571.399
3.5 MB/s		0.060
83.0 MB/s		33.51%———
Zstd_L31,3850.092
54.0 MB/s		0.018
269.2 MB/s		28.01%-19.6%-1428.4%-224.5%
Zstd_L3_disjoint_window_dict17,7430.163
30.4 MB/s		0.032
156.8 MB/s		358.81%✅ +90.7%-759.5%-89.0%
Gzip_L61,3050.128
38.6 MB/s		0.033
151.2 MB/s		26.39%-27.0%-992.8%-82.2%
Brotli_Q61,2080.392
12.6 MB/s		0.057
86.4 MB/s		24.43%-37.2%-256.7%-4.2%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_default1,0640.602
2.8 MB/s		0.025
66.7 MB/s		63.90%———
Zstd_L39010.076
22.0 MB/s		0.011
147.8 MB/s		54.11%-18.1%-695.8%-121.6%
Zstd_L3_disjoint_window_dict17,2820.143
11.7 MB/s		0.024
70.7 MB/s		1037.96%✅ +93.8%-321.5%-5.9%
Gzip_L69050.074
22.4 MB/s		0.022
76.4 MB/s		54.35%-17.6%-710.3%-14.5%
Brotli_Q68510.300
5.5 MB/s		0.042
39.5 MB/s		51.11%-25.0%-100.6%✅ +40.9%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_default35,17520.045
26.2 MB/s		2.556
205.1 MB/s		6.71%———
Zstd_L356,1011.896
276.4 MB/s		0.961
545.8 MB/s		10.70%✅ +37.3%-957.0%-166.1%
Zstd_L3_disjoint_window_dict72,7152.203
238.0 MB/s		0.893
586.9 MB/s		13.87%✅ +51.6%-809.9%-186.1%
Gzip_L651,21110.122
51.8 MB/s		1.161
451.6 MB/s		9.77%✅ +31.3%-98.0%-120.2%
Brotli_Q645,27620.126
26.0 MB/s		1.494
350.9 MB/s		8.64%✅ +22.3%✅ +0.4%-71.1%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_default36,16917.469
30.0 MB/s		2.441
214.7 MB/s		6.90%———
Zstd_L356,5001.789
293.0 MB/s		0.819
639.7 MB/s		10.78%✅ +36.0%-876.3%-197.9%
Zstd_L3_disjoint_window_dict73,0852.303
227.7 MB/s		0.905
579.2 MB/s		13.94%✅ +50.5%-658.6%-169.7%
Gzip_L651,76010.383
50.5 MB/s		1.177
445.4 MB/s		9.87%✅ +30.1%-68.2%-107.4%
Brotli_Q645,75419.981
26.2 MB/s		1.514
346.2 MB/s		8.73%✅ +20.9%✅ +12.6%-61.2%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_default74,87524.132
21.7 MB/s		3.809
137.5 MB/s		14.30%———
Zstd_L374,9782.362
221.8 MB/s		0.770
679.8 MB/s		14.32%✅ +0.1%-921.8%-394.3%
Zstd_L3_disjoint_window_dict91,4943.189
164.3 MB/s		0.808
648.4 MB/s		17.47%✅ +18.2%-656.8%-371.5%
Gzip_L682,92713.463
38.9 MB/s		1.642
319.0 MB/s		15.83%✅ +9.7%-79.3%-131.9%
Brotli_Q668,87324.056
21.8 MB/s		2.100
249.5 MB/s		13.15%-8.7%-0.3%-81.4%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_default68,85321.346
24.5 MB/s		3.691
141.9 MB/s		13.15%———
Zstd_L370,8422.104
249.0 MB/s		0.755
693.6 MB/s		13.53%✅ +2.8%-914.7%-388.8%
Zstd_L3_disjoint_window_dict86,9873.032
172.8 MB/s		0.785
667.0 MB/s		16.61%✅ +20.8%-604.1%-370.0%
Gzip_L677,74112.436
42.1 MB/s		1.550
337.9 MB/s		14.84%✅ +11.4%-71.6%-138.1%
Brotli_Q665,43123.104
22.7 MB/s		2.075
252.4 MB/s		12.49%-5.2%✅ +7.6%-77.9%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_default66,88722.330
23.3 MB/s		3.166
164.4 MB/s		12.85%———
Zstd_L368,0861.912
272.2 MB/s		0.723
719.7 MB/s		13.08%✅ +1.8%-1067.6%-337.8%
Zstd_L3_disjoint_window_dict84,5222.779
187.3 MB/s		0.745
698.9 MB/s		16.24%✅ +20.9%-703.7%-325.1%
Gzip_L675,87311.871
43.8 MB/s		1.470
354.0 MB/s		14.58%✅ +11.8%-88.1%-115.3%
Brotli_Q662,02821.787
23.9 MB/s		1.937
268.8 MB/s		11.92%-7.8%-2.5%-63.5%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_default72,22421.843
24.0 MB/s		3.449
151.9 MB/s		13.79%———
Zstd_L371,2241.930
271.4 MB/s		0.702
746.2 MB/s		13.60%-1.4%-1031.6%-391.2%
Zstd_L3_disjoint_window_dict87,6842.871
182.4 MB/s		0.754
695.0 MB/s		16.74%✅ +17.6%-660.8%-357.6%
Gzip_L680,48312.262
42.7 MB/s		1.490
351.5 MB/s		15.36%✅ +10.3%-78.1%-131.4%
Brotli_Q665,63621.811
24.0 MB/s		1.974
265.3 MB/s		12.53%-10.0%-0.1%-74.7%

Hybrid / default

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_default42,9375.034
104.1 MB/s		0.838
625.3 MB/s		8.19%———
Zstd_L350,1551.577
332.4 MB/s		0.563
931.2 MB/s		9.57%✅ +14.4%-219.2%-48.9%
Zstd_L3_disjoint_window_dict66,8671.547
338.8 MB/s		0.620
845.5 MB/s		12.76%✅ +35.8%-225.3%-35.2%
Gzip_L650,1747.564
69.3 MB/s		0.901
581.6 MB/s		9.57%✅ +14.4%✅ +33.5%✅ +7.0%
Brotli_Q643,32115.106
34.7 MB/s		1.122
467.3 MB/s		8.26%✅ +0.9%✅ +66.7%✅ +25.3%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_default17,9582.493
96.2 MB/s		0.396
604.9 MB/s		7.49%———
Zstd_L318,6500.476
503.2 MB/s		0.231
1037.7 MB/s		7.78%✅ +3.7%-423.2%-71.5%
Zstd_L3_disjoint_window_dict34,9320.617
388.5 MB/s		0.261
920.0 MB/s		14.57%✅ +48.6%-304.0%-52.1%
Gzip_L618,4622.785
86.1 MB/s		0.362
661.8 MB/s		7.70%✅ +2.7%✅ +10.5%-9.4%
Brotli_Q615,2705.008
47.9 MB/s		0.502
478.1 MB/s		6.37%-17.6%✅ +50.2%✅ +21.0%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_default24,2324.960
105.7 MB/s		1.068
490.6 MB/s		4.62%———
Zstd_L323,4370.767
683.8 MB/s		0.454
1154.5 MB/s		4.47%-3.4%-547.0%-135.3%
Zstd_L3_disjoint_window_dict39,7450.934
561.3 MB/s		0.461
1136.8 MB/s		7.58%✅ +39.0%-431.1%-131.7%
Gzip_L625,7064.335
120.9 MB/s		0.602
870.3 MB/s		4.90%✅ +5.7%-14.4%-77.4%
Brotli_Q618,88811.114
47.2 MB/s		0.770
680.5 MB/s		3.60%-28.3%✅ +55.4%-38.7%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_default9,2573.475
150.9 MB/s		0.610
859.0 MB/s		1.77%———
Zstd_L321,8080.728
719.9 MB/s		0.424
1236.8 MB/s		4.16%✅ +57.6%-377.1%-44.0%
Zstd_L3_disjoint_window_dict38,0140.884
593.3 MB/s		0.461
1136.5 MB/s		7.25%✅ +75.6%-293.2%-32.3%
Gzip_L619,5024.068
128.9 MB/s		0.514
1019.6 MB/s		3.72%✅ +52.5%✅ +14.6%-18.7%
Brotli_Q615,75711.699
44.8 MB/s		0.693
756.9 MB/s		3.01%✅ +41.3%✅ +70.3%✅ +11.9%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_default42,6813.761
139.4 MB/s		0.597
878.0 MB/s		8.14%———
Zstd_L345,5571.141
459.5 MB/s		0.474
1106.2 MB/s		8.69%✅ +6.3%-229.6%-26.0%
Zstd_L3_disjoint_window_dict61,8701.746
300.2 MB/s		0.507
1034.0 MB/s		11.80%✅ +31.0%-115.3%-17.8%
Gzip_L648,1956.061
86.5 MB/s		0.837
626.2 MB/s		9.19%✅ +11.4%✅ +38.0%✅ +28.7%
Brotli_Q640,69513.503
38.8 MB/s		1.162
451.2 MB/s		7.76%-4.9%✅ +72.2%✅ +48.6%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_default19,4683.078
170.3 MB/s		0.590
887.8 MB/s		3.71%———
Zstd_L325,2790.732
716.1 MB/s		0.386
1358.1 MB/s		4.82%✅ +23.0%-320.5%-53.0%
Zstd_L3_disjoint_window_dict41,5960.996
526.1 MB/s		0.401
1306.4 MB/s		7.93%✅ +53.2%-208.9%-47.1%
Gzip_L625,6724.381
119.7 MB/s		0.563
931.4 MB/s		4.90%✅ +24.2%✅ +29.7%-4.9%
Brotli_Q623,19911.025
47.6 MB/s		0.793
660.9 MB/s		4.43%✅ +16.1%✅ +72.1%✅ +25.6%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_default22,8384.874
107.6 MB/s		0.945
554.9 MB/s		4.36%———
Zstd_L336,7510.960
546.4 MB/s		0.489
1071.7 MB/s		7.01%✅ +37.9%-408.0%-93.1%
Zstd_L3_disjoint_window_dict53,5571.176
445.6 MB/s		0.516
1015.8 MB/s		10.22%✅ +57.4%-314.3%-83.1%
Gzip_L635,5225.856
89.5 MB/s		0.667
786.3 MB/s		6.78%✅ +35.7%✅ +16.8%-41.7%
Brotli_Q630,68613.943
37.6 MB/s		0.958
547.5 MB/s		5.85%✅ +25.6%✅ +65.0%✅ +1.3%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_default41,4864.567
114.8 MB/s		0.751
698.1 MB/s		7.91%———
Zstd_L347,7101.135
462.0 MB/s		0.513
1021.2 MB/s		9.10%✅ +13.0%-302.6%-46.3%
Zstd_L3_disjoint_window_dict64,1811.466
357.5 MB/s		0.551
950.7 MB/s		12.24%✅ +35.4%-211.5%-36.2%
Gzip_L650,6287.175
73.1 MB/s		0.852
615.4 MB/s		9.66%✅ +18.1%✅ +36.3%✅ +11.8%
Brotli_Q640,47214.202
36.9 MB/s		1.134
462.4 MB/s		7.72%-2.5%✅ +67.8%✅ +33.8%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_default17,5723.439
152.5 MB/s		0.688
761.9 MB/s		3.35%———
Zstd_L320,3400.638
821.4 MB/s		0.377
1391.2 MB/s		3.88%✅ +13.6%-438.8%-82.6%
Zstd_L3_disjoint_window_dict36,8540.842
622.7 MB/s		0.399
1313.7 MB/s		7.03%✅ +52.3%-308.4%-72.4%
Gzip_L622,8163.822
137.2 MB/s		0.517
1014.3 MB/s		4.35%✅ +23.0%✅ +10.0%-33.1%
Brotli_Q615,23110.006
52.4 MB/s		0.887
591.2 MB/s		2.91%-15.4%✅ +65.6%✅ +22.4%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_default33,6393.992
131.3 MB/s		0.890
588.9 MB/s		6.42%———
Zstd_L337,1130.983
533.2 MB/s		0.492
1066.0 MB/s		7.08%✅ +9.4%-306.1%-81.0%
Zstd_L3_disjoint_window_dict53,6681.275
411.0 MB/s		0.527
995.4 MB/s		10.24%✅ +37.3%-213.0%-69.0%
Gzip_L642,1146.635
79.0 MB/s		0.746
702.4 MB/s		8.03%✅ +20.1%✅ +39.8%-19.3%
Brotli_Q631,18213.169
39.8 MB/s		0.982
533.8 MB/s		5.95%-7.9%✅ +69.7%✅ +9.4%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_default22,9993.994
131.2 MB/s		0.546
959.5 MB/s		4.39%———
Zstd_L333,1020.866
605.2 MB/s		0.510
1026.9 MB/s		6.31%✅ +30.5%-361.1%-7.0%
Zstd_L3_disjoint_window_dict49,2731.079
485.6 MB/s		0.543
966.0 MB/s		9.40%✅ +53.3%-270.0%-0.7%
Gzip_L637,0154.441
118.0 MB/s		0.690
760.0 MB/s		7.06%✅ +37.9%✅ +10.1%✅ +20.8%
Brotli_Q626,06211.182
46.9 MB/s		0.875
599.4 MB/s		4.97%✅ +11.8%✅ +64.3%✅ +37.5%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_default44,2074.102
127.8 MB/s		1.047
500.9 MB/s		8.43%———
Zstd_L354,8241.342
390.6 MB/s		0.589
890.5 MB/s		10.46%✅ +19.4%-205.6%-77.8%
Zstd_L3_disjoint_window_dict71,0402.082
251.9 MB/s		0.599
875.9 MB/s		13.55%✅ +37.8%-97.1%-74.9%
Gzip_L699,45711.769
44.5 MB/s		1.485
353.0 MB/s		18.97%✅ +55.6%✅ +65.1%✅ +29.5%
Brotli_Q645,18914.281
36.7 MB/s		1.184
442.7 MB/s		8.62%✅ +2.2%✅ +71.3%✅ +11.6%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_default36,63716.661
31.5 MB/s		1.127
465.3 MB/s		6.99%———
Zstd_L347,0751.327
395.1 MB/s		0.644
814.5 MB/s		8.98%✅ +22.2%-1155.7%-75.1%
Zstd_L3_disjoint_window_dict63,5301.591
329.6 MB/s		0.676
776.0 MB/s		12.12%✅ +42.3%-947.5%-66.8%
Gzip_L642,9957.825
67.0 MB/s		0.901
581.6 MB/s		8.20%✅ +14.8%-112.9%-25.0%
Brotli_Q636,90816.088
32.6 MB/s		1.231
426.0 MB/s		7.04%✅ +0.7%-3.6%✅ +8.4%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_default27,6196.419
81.7 MB/s		1.702
308.0 MB/s		5.27%———
Zstd_L335,0451.458
359.6 MB/s		0.580
903.8 MB/s		6.69%✅ +21.2%-340.3%-193.5%
Zstd_L3_disjoint_window_dict51,4511.397
375.2 MB/s		0.601
872.0 MB/s		9.81%✅ +46.3%-359.4%-183.2%
Gzip_L634,3096.645
78.9 MB/s		0.910
576.3 MB/s		6.54%✅ +19.5%✅ +3.4%-87.1%
Brotli_Q628,93315.501
33.8 MB/s		1.397
375.4 MB/s		5.52%✅ +4.5%✅ +58.6%-21.9%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_default18,2505.412
96.9 MB/s		1.003
522.8 MB/s		3.48%———
Zstd_L335,5411.199
437.3 MB/s		0.618
847.8 MB/s		6.78%✅ +48.7%-351.5%-62.2%
Zstd_L3_disjoint_window_dict52,1231.460
359.1 MB/s		0.655
799.9 MB/s		9.94%✅ +65.0%-270.8%-53.0%
Gzip_L633,4508.778
59.7 MB/s		0.787
665.7 MB/s		6.38%✅ +45.4%✅ +38.3%-27.4%
Brotli_Q627,10417.983
29.2 MB/s		1.107
473.7 MB/s		5.17%✅ +32.7%✅ +69.9%✅ +9.4%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_default27,8056.410
81.8 MB/s		0.875
599.0 MB/s		5.30%———
Zstd_L332,2911.193
439.5 MB/s		0.620
845.2 MB/s		6.16%✅ +13.9%-437.4%-41.1%
Zstd_L3_disjoint_window_dict48,8361.407
372.5 MB/s		0.641
817.6 MB/s		9.32%✅ +43.1%-355.4%-36.5%
Gzip_L627,5826.956
75.4 MB/s		0.873
600.2 MB/s		5.26%-0.8%✅ +7.9%-0.2%
Brotli_Q625,46414.585
35.9 MB/s		1.281
409.2 MB/s		4.86%-9.2%✅ +56.1%✅ +31.7%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_default6560.279
11.4 MB/s		0.011
287.3 MB/s		20.65%———
Zstd_L36680.072
44.2 MB/s		0.014
224.1 MB/s		21.03%✅ +1.8%-288.4%✅ +22.0%
Zstd_L3_disjoint_window_dict17,0070.121
26.2 MB/s		0.023
137.0 MB/s		535.32%✅ +96.1%-130.0%✅ +52.3%
Gzip_L66340.071
44.9 MB/s		0.022
146.7 MB/s		19.96%-3.5%-294.0%✅ +48.9%
Brotli_Q65920.265
12.0 MB/s		0.038
84.1 MB/s		18.63%-10.8%-5.2%✅ +70.7%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_default5440.078
20.7 MB/s		0.007
215.5 MB/s		33.75%———
Zstd_L35450.064
25.4 MB/s		0.009
171.2 MB/s		33.81%✅ +0.2%-22.4%✅ +20.6%
Zstd_L3_disjoint_window_dict16,9080.124
13.0 MB/s		0.020
80.3 MB/s		1048.88%✅ +96.8%✅ +37.3%✅ +62.7%
Gzip_L65410.058
27.9 MB/s		0.018
88.7 MB/s		33.56%-0.6%-34.3%✅ +58.8%
Brotli_Q64740.233
6.9 MB/s		0.032
50.7 MB/s		29.40%-14.8%✅ +66.7%✅ +76.5%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_default2,8291.856
12.6 MB/s		0.040
583.9 MB/s		12.14%———
Zstd_L32,7540.136
171.7 MB/s		0.044
535.0 MB/s		11.81%-2.7%-1266.7%✅ +8.4%
Zstd_L3_disjoint_window_dict19,1390.208
111.8 MB/s		0.061
379.6 MB/s		82.10%✅ +85.2%-790.3%✅ +35.0%
Gzip_L62,6600.374
62.3 MB/s		0.069
335.9 MB/s		11.41%-6.4%-395.7%✅ +42.5%
Brotli_Q62,3950.766
30.4 MB/s		0.112
207.9 MB/s		10.27%-18.1%-142.1%✅ +64.4%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_default2,6630.412
19.9 MB/s		0.019
433.8 MB/s		32.44%———
Zstd_L32,4550.105
78.1 MB/s		0.023
358.4 MB/s		29.90%-8.5%-291.7%✅ +17.4%
Zstd_L3_disjoint_window_dict18,8520.189
43.4 MB/s		0.037
219.9 MB/s		229.62%✅ +85.9%-118.0%✅ +49.3%
Gzip_L62,3400.194
42.4 MB/s		0.052
159.2 MB/s		28.50%-13.8%-112.9%✅ +63.3%
Brotli_Q62,1580.542
15.1 MB/s		0.092
89.5 MB/s		26.29%-23.4%✅ +24.0%✅ +79.4%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_default1,6170.496
9.1 MB/s		0.016
278.7 MB/s		35.92%———
Zstd_L31,5650.121
37.1 MB/s		0.018
246.4 MB/s		34.76%-3.3%-309.1%✅ +11.6%
Zstd_L3_disjoint_window_dict17,8960.209
21.5 MB/s		0.034
133.7 MB/s		397.51%✅ +91.0%-137.1%✅ +52.0%
Gzip_L61,4800.145
31.0 MB/s		0.036
125.5 MB/s		32.87%-9.3%-241.8%✅ +55.0%
Brotli_Q61,3780.606
7.4 MB/s		0.094
47.9 MB/s		30.61%-17.3%✅ +18.1%✅ +82.8%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_default1,4585.573
94.1 MB/s		1.357
386.2 MB/s		0.28%———
Zstd_L38,1480.834
628.4 MB/s		0.522
1003.8 MB/s		1.55%✅ +82.1%-568.0%-159.9%
Zstd_L3_disjoint_window_dict24,5650.952
550.7 MB/s		0.542
968.2 MB/s		4.69%✅ +94.1%-485.4%-150.7%
Gzip_L615,4593.457
151.6 MB/s		0.559
937.8 MB/s		2.95%✅ +90.6%-61.2%-142.8%
Brotli_Q68,12515.196
34.5 MB/s		0.817
641.9 MB/s		1.55%✅ +82.1%✅ +63.3%-66.2%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_default1,4390.321
15.4 MB/s		0.017
292.6 MB/s		29.10%———
Zstd_L31,3850.092
54.0 MB/s		0.018
269.2 MB/s		28.01%-3.9%-250.8%✅ +8.0%
Zstd_L3_disjoint_window_dict17,7430.163
30.4 MB/s		0.032
156.8 MB/s		358.81%✅ +91.9%-97.3%✅ +46.4%
Gzip_L61,3050.128
38.6 MB/s		0.033
151.2 MB/s		26.39%-10.3%-150.8%✅ +48.3%
Brotli_Q61,2080.392
12.6 MB/s		0.057
86.4 MB/s		24.43%-19.1%✅ +18.1%✅ +70.5%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_default9100.096
17.3 MB/s		0.010
171.6 MB/s		54.65%———
Zstd_L39010.076
22.0 MB/s		0.011
147.8 MB/s		54.11%-1.0%-27.0%✅ +13.8%
Zstd_L3_disjoint_window_dict17,2820.143
11.7 MB/s		0.024
70.7 MB/s		1037.96%✅ +94.7%✅ +32.7%✅ +58.8%
Gzip_L69050.074
22.4 MB/s		0.022
76.4 MB/s		54.35%-0.6%-29.3%✅ +55.5%
Brotli_Q68510.300
5.5 MB/s		0.042
39.5 MB/s		51.11%-6.9%✅ +68.0%✅ +77.0%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_default37,75712.386
42.3 MB/s		1.696
309.1 MB/s		7.20%———
Zstd_L356,1011.896
276.4 MB/s		0.961
545.8 MB/s		10.70%✅ +32.7%-553.2%-76.6%
Zstd_L3_disjoint_window_dict72,7152.203
238.0 MB/s		0.893
586.9 MB/s		13.87%✅ +48.1%-462.3%-89.9%
Gzip_L651,21110.122
51.8 MB/s		1.161
451.6 MB/s		9.77%✅ +26.3%-22.4%-46.1%
Brotli_Q645,27620.126
26.0 MB/s		1.494
350.9 MB/s		8.64%✅ +16.6%✅ +38.5%-13.5%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_default39,0809.544
54.9 MB/s		1.538
340.9 MB/s		7.45%———
Zstd_L356,5001.789
293.0 MB/s		0.819
639.7 MB/s		10.78%✅ +30.8%-433.4%-87.7%
Zstd_L3_disjoint_window_dict73,0852.303
227.7 MB/s		0.905
579.2 MB/s		13.94%✅ +46.5%-314.4%-69.9%
Gzip_L651,76010.383
50.5 MB/s		1.177
445.4 MB/s		9.87%✅ +24.5%✅ +8.1%-30.7%
Brotli_Q645,75419.981
26.2 MB/s		1.514
346.2 MB/s		8.73%✅ +14.6%✅ +52.2%-1.6%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_default78,72610.290
50.9 MB/s		1.497
349.9 MB/s		15.03%———
Zstd_L374,9782.362
221.8 MB/s		0.770
679.8 MB/s		14.32%-5.0%-335.7%-94.3%
Zstd_L3_disjoint_window_dict91,4943.189
164.3 MB/s		0.808
648.4 MB/s		17.47%✅ +14.0%-222.7%-85.3%
Gzip_L682,92713.463
38.9 MB/s		1.642
319.0 MB/s		15.83%✅ +5.1%✅ +23.6%✅ +8.9%
Brotli_Q668,87324.056
21.8 MB/s		2.100
249.5 MB/s		13.15%-14.3%✅ +57.2%✅ +28.7%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_default72,67511.535
45.4 MB/s		0.612
855.4 MB/s		13.88%———
Zstd_L370,8422.104
249.0 MB/s		0.755
693.6 MB/s		13.53%-2.6%-448.3%✅ +18.9%
Zstd_L3_disjoint_window_dict86,9873.032
172.8 MB/s		0.785
667.0 MB/s		16.61%✅ +16.5%-280.5%✅ +22.0%
Gzip_L677,74112.436
42.1 MB/s		1.550
337.9 MB/s		14.84%✅ +6.5%✅ +7.2%✅ +60.5%
Brotli_Q665,43123.104
22.7 MB/s		2.075
252.4 MB/s		12.49%-11.1%✅ +50.1%✅ +70.5%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_default71,1079.544
54.5 MB/s		0.613
849.4 MB/s		13.66%———
Zstd_L368,0861.912
272.2 MB/s		0.723
719.7 MB/s		13.08%-4.4%-399.0%✅ +15.3%
Zstd_L3_disjoint_window_dict84,5222.779
187.3 MB/s		0.745
698.9 MB/s		16.24%✅ +15.9%-243.5%✅ +17.7%
Gzip_L675,87311.871
43.8 MB/s		1.470
354.0 MB/s		14.58%✅ +6.3%✅ +19.6%✅ +58.3%
Brotli_Q662,02821.787
23.9 MB/s		1.937
268.8 MB/s		11.92%-14.6%✅ +56.2%✅ +68.4%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_default74,14310.487
49.9 MB/s		0.691
757.9 MB/s		14.15%———
Zstd_L371,2241.930
271.4 MB/s		0.702
746.2 MB/s		13.60%-4.1%-443.3%✅ +1.5%
Zstd_L3_disjoint_window_dict87,6842.871
182.4 MB/s		0.754
695.0 MB/s		16.74%✅ +15.4%-265.3%✅ +8.3%
Gzip_L680,48312.262
42.7 MB/s		1.490
351.5 MB/s		15.36%✅ +7.9%✅ +14.5%✅ +53.6%
Brotli_Q665,63621.811
24.0 MB/s		1.974
265.3 MB/s		12.53%-13.0%✅ +51.9%✅ +65.0%

Native / fast

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_fast72,4225.378
97.5 MB/s		1.098
477.6 MB/s		13.82%———
Zstd_L149,6811.371
382.5 MB/s		0.573
915.5 MB/s		9.48%-45.8%-292.4%-91.7%
Zstd_L1_disjoint_window_dict66,8701.301
403.0 MB/s		0.598
876.8 MB/s		12.76%-8.3%-313.5%-83.6%
Gzip_L177,3061.804
290.6 MB/s		1.224
428.2 MB/s		14.75%✅ +6.3%-198.1%✅ +10.4%
Brotli_Q154,2511.818
288.3 MB/s		1.466
357.5 MB/s		10.35%-33.5%-195.8%✅ +25.2%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_fast27,6172.363
101.5 MB/s		0.419
572.2 MB/s		11.52%———
Zstd_L118,4570.614
390.6 MB/s		0.238
1007.1 MB/s		7.70%-49.6%-284.9%-76.0%
Zstd_L1_disjoint_window_dict35,0650.650
369.0 MB/s		0.259
924.6 MB/s		14.62%✅ +21.2%-263.7%-61.6%
Gzip_L125,7020.676
354.8 MB/s		0.447
536.3 MB/s		10.72%-7.5%-249.6%✅ +6.3%
Brotli_Q120,2861.147
209.1 MB/s		0.703
340.9 MB/s		8.46%-36.1%-106.1%✅ +40.4%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_fast35,9643.130
167.5 MB/s		0.650
806.1 MB/s		6.86%———
Zstd_L123,6460.986
531.8 MB/s		0.565
927.1 MB/s		4.51%-52.1%-217.5%-15.0%
Zstd_L1_disjoint_window_dict40,2770.869
603.3 MB/s		0.460
1140.8 MB/s		7.68%✅ +10.7%-260.2%-41.5%
Gzip_L145,1911.316
398.3 MB/s		0.835
627.8 MB/s		8.62%✅ +20.4%-137.8%✅ +22.1%
Brotli_Q126,7491.433
365.9 MB/s		1.121
467.8 MB/s		5.10%-34.4%-118.5%✅ +42.0%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_fast34,7743.478
150.7 MB/s		0.670
781.9 MB/s		6.63%———
Zstd_L122,1480.958
547.2 MB/s		0.536
977.8 MB/s		4.22%-57.0%-263.1%-25.0%
Zstd_L1_disjoint_window_dict37,8220.847
619.1 MB/s		0.478
1096.8 MB/s		7.21%✅ +8.1%-310.8%-40.3%
Gzip_L130,8100.895
585.8 MB/s		0.659
795.1 MB/s		5.88%-12.9%-288.6%-1.7%
Brotli_Q124,9431.186
442.2 MB/s		0.940
557.8 MB/s		4.76%-39.4%-193.4%✅ +28.7%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_fast59,8554.521
115.9 MB/s		0.856
612.6 MB/s		11.42%———
Zstd_L143,0811.183
443.0 MB/s		0.442
1185.7 MB/s		8.22%-38.9%-282.0%-93.6%
Zstd_L1_disjoint_window_dict61,0311.078
486.3 MB/s		0.555
945.0 MB/s		11.64%✅ +1.9%-319.4%-54.3%
Gzip_L169,6071.751
299.4 MB/s		1.030
508.8 MB/s		13.28%✅ +14.0%-158.3%✅ +16.9%
Brotli_Q149,7291.814
289.1 MB/s		1.400
374.6 MB/s		9.49%-20.4%-149.3%✅ +38.9%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_fast35,0203.436
152.6 MB/s		0.600
874.1 MB/s		6.68%———
Zstd_L123,5730.928
564.8 MB/s		0.386
1356.9 MB/s		4.50%-48.6%-270.2%-55.2%
Zstd_L1_disjoint_window_dict41,0740.734
714.5 MB/s		0.391
1339.3 MB/s		7.84%✅ +14.7%-368.2%-53.2%
Gzip_L131,5050.922
568.6 MB/s		0.585
896.5 MB/s		6.01%-11.2%-272.7%-2.6%
Brotli_Q125,8901.291
406.2 MB/s		0.973
538.7 MB/s		4.94%-35.3%-166.2%✅ +38.4%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_fast58,5563.995
131.2 MB/s		0.905
579.2 MB/s		11.17%———
Zstd_L132,8801.119
468.7 MB/s		0.477
1098.5 MB/s		6.27%-78.1%-257.1%-89.7%
Zstd_L1_disjoint_window_dict52,2871.039
504.4 MB/s		0.512
1023.4 MB/s		9.97%-12.0%-284.3%-76.7%
Gzip_L148,5381.161
451.7 MB/s		0.849
617.8 MB/s		9.26%-20.6%-244.2%-6.7%
Brotli_Q140,2101.787
293.3 MB/s		1.296
404.7 MB/s		7.67%-45.6%-123.5%✅ +30.1%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_fast71,6904.526
115.8 MB/s		1.044
501.9 MB/s		13.68%———
Zstd_L147,5671.242
422.1 MB/s		0.528
992.3 MB/s		9.07%-50.7%-264.4%-97.7%
Zstd_L1_disjoint_window_dict65,0401.193
439.6 MB/s		0.547
959.1 MB/s		12.41%-10.2%-279.5%-91.1%
Gzip_L169,1661.631
321.5 MB/s		1.041
503.5 MB/s		13.19%-3.6%-177.5%-0.3%
Brotli_Q151,5961.782
294.3 MB/s		1.500
349.4 MB/s		9.84%-38.9%-154.0%✅ +30.4%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_fast33,9192.820
185.9 MB/s		0.552
950.0 MB/s		6.47%———
Zstd_L119,7290.874
599.5 MB/s		0.367
1428.0 MB/s		3.76%-71.9%-222.5%-50.3%
Zstd_L1_disjoint_window_dict37,1130.749
700.0 MB/s		0.397
1319.2 MB/s		7.08%✅ +8.6%-276.5%-38.9%
Gzip_L132,8170.964
544.0 MB/s		0.614
853.6 MB/s		6.26%-3.4%-192.6%✅ +10.2%
Brotli_Q121,5461.255
417.8 MB/s		1.050
499.2 MB/s		4.11%-57.4%-124.7%✅ +47.5%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_fast41,5248.429
62.2 MB/s		2.243
233.7 MB/s		7.92%———
Zstd_L134,7881.094
479.0 MB/s		0.475
1104.5 MB/s		6.64%-19.4%-670.2%-372.7%
Zstd_L1_disjoint_window_dict53,2491.130
463.7 MB/s		0.525
997.9 MB/s		10.16%✅ +22.0%-645.7%-327.1%
Gzip_L161,0881.418
369.6 MB/s		0.976
536.9 MB/s		11.65%✅ +32.0%-494.4%-129.8%
Brotli_Q145,5341.758
298.1 MB/s		1.389
377.3 MB/s		8.69%✅ +8.8%-379.4%-61.5%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_fast51,4723.712
141.2 MB/s		0.766
684.3 MB/s		9.82%———
Zstd_L132,8671.049
499.8 MB/s		0.467
1123.6 MB/s		6.27%-56.6%-253.9%-64.2%
Zstd_L1_disjoint_window_dict49,5290.978
536.2 MB/s		0.505
1037.7 MB/s		9.45%-3.9%-279.6%-51.6%
Gzip_L173,3721.711
306.4 MB/s		1.053
498.0 MB/s		14.00%✅ +29.8%-117.0%✅ +27.2%
Brotli_Q139,4141.338
391.9 MB/s		1.083
484.2 MB/s		7.52%-30.6%-177.5%✅ +29.2%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_fast122,1726.333
82.8 MB/s		1.653
317.2 MB/s		23.30%———
Zstd_L158,0801.412
371.4 MB/s		0.594
883.3 MB/s		11.08%-110.4%-348.6%-178.5%
Zstd_L1_disjoint_window_dict80,3661.486
352.7 MB/s		0.657
798.2 MB/s		15.33%-52.0%-326.0%-151.6%
Gzip_L1142,8792.966
176.7 MB/s		1.971
266.0 MB/s		27.25%✅ +14.5%-113.5%✅ +16.1%
Brotli_Q171,6482.134
245.7 MB/s		1.676
312.9 MB/s		13.67%-70.5%-196.8%✅ +1.4%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_fast44,20615.848
33.1 MB/s		2.309
227.1 MB/s		8.43%———
Zstd_L145,4071.384
378.9 MB/s		0.618
848.6 MB/s		8.66%✅ +2.6%-1045.4%-273.7%
Zstd_L1_disjoint_window_dict62,7921.332
393.5 MB/s		0.668
784.8 MB/s		11.98%✅ +29.6%-1089.5%-245.6%
Gzip_L166,2831.687
310.7 MB/s		1.235
424.4 MB/s		12.64%✅ +33.3%-839.4%-86.9%
Brotli_Q152,6742.130
246.1 MB/s		1.757
298.5 MB/s		10.05%✅ +16.1%-644.1%-31.4%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_fast48,6286.031
86.9 MB/s		0.973
539.0 MB/s		9.28%———
Zstd_L135,2611.333
393.2 MB/s		0.561
935.1 MB/s		6.73%-37.9%-352.4%-73.5%
Zstd_L1_disjoint_window_dict50,9391.255
417.9 MB/s		0.587
892.6 MB/s		9.72%✅ +4.5%-380.7%-65.6%
Gzip_L149,8211.676
312.9 MB/s		1.109
472.7 MB/s		9.50%✅ +2.4%-259.9%✅ +12.3%
Brotli_Q137,4851.774
295.6 MB/s		1.720
304.7 MB/s		7.15%-29.7%-240.0%✅ +43.5%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_fast24,9898.515
61.6 MB/s		1.855
282.6 MB/s		4.77%———
Zstd_L132,3261.383
379.1 MB/s		0.599
874.7 MB/s		6.17%✅ +22.7%-515.8%-209.5%
Zstd_L1_disjoint_window_dict50,6441.302
402.6 MB/s		0.662
791.6 MB/s		9.66%✅ +50.7%-554.0%-180.1%
Gzip_L145,2901.356
386.6 MB/s		1.014
517.1 MB/s		8.64%✅ +44.8%-528.0%-83.0%
Brotli_Q135,4511.762
297.5 MB/s		1.513
346.4 MB/s		6.76%✅ +29.5%-383.3%-22.6%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_fast45,0725.015
104.5 MB/s		1.021
513.3 MB/s		8.60%———
Zstd_L132,0851.442
363.6 MB/s		0.778
673.7 MB/s		6.12%-40.5%-247.8%-31.3%
Zstd_L1_disjoint_window_dict49,6601.226
427.7 MB/s		0.654
801.2 MB/s		9.47%✅ +9.2%-309.2%-56.1%
Gzip_L143,4141.531
342.4 MB/s		1.113
471.1 MB/s		8.28%-3.8%-227.5%✅ +8.2%
Brotli_Q134,8562.078
252.3 MB/s		1.769
296.3 MB/s		6.65%-29.3%-141.3%✅ +42.3%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_fast1,9090.170
18.7 MB/s		0.022
143.2 MB/s		60.09%———
Zstd_L16610.032
100.6 MB/s		0.013
246.3 MB/s		20.81%-188.8%-439.5%-72.0%
Zstd_L1_disjoint_window_dict17,0170.100
31.8 MB/s		0.023
135.7 MB/s		535.63%✅ +88.8%-70.5%✅ +5.2%
Gzip_L16860.049
64.4 MB/s		0.023
137.3 MB/s		21.59%-178.3%-245.4%✅ +4.1%
Brotli_Q16960.051
62.4 MB/s		0.732
4.3 MB/s		21.91%-174.3%-234.7%✅ +97.0%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_fast7120.108
14.9 MB/s		0.017
95.9 MB/s		44.17%———
Zstd_L15490.026
61.1 MB/s		0.010
164.4 MB/s		34.06%-29.7%-310.2%-71.5%
Zstd_L1_disjoint_window_dict16,9090.085
19.0 MB/s		0.020
81.2 MB/s		1048.95%✅ +95.8%-27.6%✅ +15.3%
Gzip_L15600.045
35.9 MB/s		0.019
84.9 MB/s		34.74%-27.1%-141.2%✅ +11.4%
Brotli_Q15670.041
39.0 MB/s		0.641
2.5 MB/s		35.17%-25.6%-161.9%✅ +97.4%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_fast5,3780.836
27.9 MB/s		0.096
243.6 MB/s		23.07%———
Zstd_L12,8060.089
261.8 MB/s		0.044
531.8 MB/s		12.04%-91.7%-838.8%-118.3%
Zstd_L1_disjoint_window_dict19,2330.165
141.5 MB/s		0.063
369.8 MB/s		82.50%✅ +72.0%-407.5%-51.8%
Gzip_L13,4590.138
169.5 MB/s		0.084
278.3 MB/s		14.84%-55.5%-507.9%-14.3%
Brotli_Q13,1370.178
131.3 MB/s		0.250
93.4 MB/s		13.46%-71.4%-370.8%✅ +61.6%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_fast3,7050.408
20.1 MB/s		0.057
144.6 MB/s		45.13%———
Zstd_L12,6400.054
153.3 MB/s		0.022
374.1 MB/s		32.16%-40.3%-661.5%-158.8%
Zstd_L1_disjoint_window_dict18,8810.132
62.4 MB/s		0.036
228.8 MB/s		229.98%✅ +80.4%-209.9%-58.3%
Gzip_L12,8190.111
74.2 MB/s		0.059
139.5 MB/s		34.34%-31.4%-268.3%✅ +3.5%
Brotli_Q12,6430.123
67.0 MB/s		0.845
9.7 MB/s		32.19%-40.2%-232.7%✅ +93.3%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_fast2,1990.392
11.5 MB/s		0.048
94.7 MB/s		48.84%———
Zstd_L11,6220.051
87.5 MB/s		0.018
255.7 MB/s		36.03%-35.6%-661.6%-170.1%
Zstd_L1_disjoint_window_dict17,9410.130
34.6 MB/s		0.030
150.9 MB/s		398.51%✅ +87.7%-201.3%-59.4%
Gzip_L11,6600.086
52.2 MB/s		0.038
117.0 MB/s		36.87%-32.5%-354.4%-23.6%
Brotli_Q11,6360.188
23.9 MB/s		1.340
3.4 MB/s		36.34%-34.4%-108.4%✅ +96.5%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_fast26,3554.208
124.6 MB/s		0.721
727.5 MB/s		5.03%———
Zstd_L18,5131.050
499.3 MB/s		0.544
963.2 MB/s		1.62%-209.6%-300.8%-32.4%
Zstd_L1_disjoint_window_dict24,0840.865
606.4 MB/s		0.531
986.5 MB/s		4.59%-9.4%-386.8%-35.6%
Gzip_L119,9641.049
500.0 MB/s		0.677
773.9 MB/s		3.81%-32.0%-301.3%-6.4%
Brotli_Q112,5141.443
363.3 MB/s		1.206
434.7 MB/s		2.39%-110.6%-191.6%✅ +40.2%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_fast1,6571.178
4.2 MB/s		0.059
83.8 MB/s		33.51%———
Zstd_L11,4440.131
37.8 MB/s		0.019
266.3 MB/s		29.20%-14.8%-801.3%-217.9%
Zstd_L1_disjoint_window_dict17,7770.127
39.0 MB/s		0.033
149.0 MB/s		359.49%✅ +90.7%-829.5%-77.9%
Gzip_L11,5490.074
66.4 MB/s		0.038
128.8 MB/s		31.32%-7.0%-1481.9%-53.7%
Brotli_Q11,4970.083
59.3 MB/s		0.207
23.9 MB/s		30.27%-10.7%-1313.4%✅ +71.4%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_fast1,0640.594
2.8 MB/s		0.025
67.2 MB/s		63.90%———
Zstd_L19150.032
52.0 MB/s		0.012
140.7 MB/s		54.95%-16.3%-1755.8%-109.4%
Zstd_L1_disjoint_window_dict17,2940.097
17.2 MB/s		0.024
70.0 MB/s		1038.68%✅ +93.8%-514.6%-4.1%
Gzip_L19390.053
31.7 MB/s		0.023
73.3 MB/s		56.40%-13.3%-1030.3%-9.1%
Brotli_Q19510.051
32.5 MB/s		0.716
2.3 MB/s		57.12%-11.9%-1059.9%✅ +96.5%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_fast58,64019.378
27.1 MB/s		3.137
167.1 MB/s		11.19%———
Zstd_L158,7942.002
261.9 MB/s		1.091
480.4 MB/s		11.22%✅ +0.3%-868.0%-187.4%
Zstd_L1_disjoint_window_dict76,7652.065
253.9 MB/s		0.899
583.2 MB/s		14.64%✅ +23.6%-838.3%-248.9%
Gzip_L185,1502.710
193.5 MB/s		1.790
292.9 MB/s		16.24%✅ +31.1%-615.1%-75.2%
Brotli_Q165,8822.813
186.4 MB/s		2.289
229.1 MB/s		12.57%✅ +11.0%-588.9%-37.1%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_fast57,85217.923
29.2 MB/s		3.109
168.6 MB/s		11.04%———
Zstd_L158,8601.985
264.2 MB/s		0.844
620.8 MB/s		11.23%✅ +1.7%-803.1%-268.1%
Zstd_L1_disjoint_window_dict77,4162.066
253.7 MB/s		0.889
589.5 MB/s		14.77%✅ +25.3%-767.4%-249.6%
Gzip_L182,3792.634
199.0 MB/s		1.792
292.5 MB/s		15.71%✅ +29.8%-580.5%-73.5%
Brotli_Q165,4072.749
190.7 MB/s		2.245
233.5 MB/s		12.48%✅ +11.6%-551.9%-38.5%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_fast74,87523.475
22.3 MB/s		3.566
146.9 MB/s		14.30%———
Zstd_L178,8741.918
273.1 MB/s		0.882
593.7 MB/s		15.06%✅ +5.1%-1124.0%-304.2%
Zstd_L1_disjoint_window_dict96,9902.422
216.3 MB/s		0.818
640.5 MB/s		18.52%✅ +22.8%-869.3%-336.1%
Gzip_L1117,7493.427
152.8 MB/s		2.187
239.5 MB/s		22.48%✅ +36.4%-585.1%-63.1%
Brotli_Q182,1713.249
161.2 MB/s		2.570
203.8 MB/s		15.69%✅ +8.9%-622.6%-38.8%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_fast68,85320.900
25.1 MB/s		3.741
140.0 MB/s		13.15%———
Zstd_L172,6522.014
260.1 MB/s		0.727
720.7 MB/s		13.87%✅ +5.2%-937.8%-414.7%
Zstd_L1_disjoint_window_dict90,7552.014
260.0 MB/s		0.775
676.0 MB/s		17.33%✅ +24.1%-937.6%-382.8%
Gzip_L1106,7163.103
168.8 MB/s		1.954
268.0 MB/s		20.38%✅ +35.5%-573.5%-91.5%
Brotli_Q176,6563.011
173.9 MB/s		2.426
215.8 MB/s		14.64%✅ +10.2%-594.1%-54.2%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_fast66,88720.827
25.0 MB/s		3.168
164.3 MB/s		12.85%———
Zstd_L171,0841.744
298.5 MB/s		0.721
722.3 MB/s		13.66%✅ +5.9%-1094.4%-339.5%
Zstd_L1_disjoint_window_dict88,4421.916
271.7 MB/s		0.747
696.5 MB/s		16.99%✅ +24.4%-987.2%-323.8%
Gzip_L1111,2803.195
162.9 MB/s		2.150
242.1 MB/s		21.38%✅ +39.9%-551.9%-47.4%
Brotli_Q174,7352.860
182.0 MB/s		2.267
229.6 MB/s		14.36%✅ +10.5%-628.3%-39.7%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_fast72,22420.403
25.7 MB/s		3.246
161.4 MB/s		13.79%———
Zstd_L174,1201.849
283.3 MB/s		0.726
721.3 MB/s		14.15%✅ +2.6%-1003.4%-347.0%
Zstd_L1_disjoint_window_dict92,4391.983
264.2 MB/s		0.826
634.4 MB/s		17.65%✅ +21.9%-928.9%-293.1%
Gzip_L1114,7003.138
166.9 MB/s		2.003
261.5 MB/s		21.90%✅ +37.0%-550.2%-62.0%
Brotli_Q178,9402.843
184.3 MB/s		2.279
229.9 MB/s		15.07%✅ +8.5%-617.7%-42.4%

Hybrid / fast

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_fast49,7043.165
165.6 MB/s		0.489
1071.6 MB/s		9.48%———
Zstd_L149,6811.371
382.5 MB/s		0.573
915.5 MB/s		9.48%-0.0%-130.9%✅ +14.6%
Zstd_L1_disjoint_window_dict66,8701.301
403.0 MB/s		0.598
876.8 MB/s		12.76%✅ +25.7%-143.3%✅ +18.2%
Gzip_L177,3061.804
290.6 MB/s		1.224
428.2 MB/s		14.75%✅ +35.7%-75.4%✅ +60.0%
Brotli_Q154,2511.818
288.3 MB/s		1.466
357.5 MB/s		10.35%✅ +8.4%-74.1%✅ +66.6%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_fast18,4801.273
188.4 MB/s		0.202
1187.8 MB/s		7.71%———
Zstd_L118,4570.614
390.6 MB/s		0.238
1007.1 MB/s		7.70%-0.1%-107.3%✅ +15.2%
Zstd_L1_disjoint_window_dict35,0650.650
369.0 MB/s		0.259
924.6 MB/s		14.62%✅ +47.3%-95.9%✅ +22.2%
Gzip_L125,7020.676
354.8 MB/s		0.447
536.3 MB/s		10.72%✅ +28.1%-88.3%✅ +54.8%
Brotli_Q120,2861.147
209.1 MB/s		0.703
340.9 MB/s		8.46%✅ +8.9%-11.0%✅ +71.3%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_fast23,6692.987
175.5 MB/s		0.371
1412.2 MB/s		4.52%———
Zstd_L123,6460.986
531.8 MB/s		0.565
927.1 MB/s		4.51%-0.1%-203.0%✅ +34.3%
Zstd_L1_disjoint_window_dict40,2770.869
603.3 MB/s		0.460
1140.8 MB/s		7.68%✅ +41.2%-243.8%✅ +19.2%
Gzip_L145,1911.316
398.3 MB/s		0.835
627.8 MB/s		8.62%✅ +47.6%-127.0%✅ +55.5%
Brotli_Q126,7491.433
365.9 MB/s		1.121
467.8 MB/s		5.10%✅ +11.5%-108.5%✅ +66.9%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_fast11,2032.256
232.4 MB/s		0.792
662.2 MB/s		2.14%———
Zstd_L122,1480.958
547.2 MB/s		0.536
977.8 MB/s		4.22%✅ +49.4%-135.4%-47.7%
Zstd_L1_disjoint_window_dict37,8220.847
619.1 MB/s		0.478
1096.8 MB/s		7.21%✅ +70.4%-166.3%-65.6%
Gzip_L130,8100.895
585.8 MB/s		0.659
795.1 MB/s		5.88%✅ +63.6%-152.0%-20.1%
Brotli_Q124,9431.186
442.2 MB/s		0.940
557.8 MB/s		4.76%✅ +55.1%-90.2%✅ +15.8%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_fast43,1042.598
201.8 MB/s		0.378
1385.4 MB/s		8.22%———
Zstd_L143,0811.183
443.0 MB/s		0.442
1185.7 MB/s		8.22%-0.1%-119.5%✅ +14.4%
Zstd_L1_disjoint_window_dict61,0311.078
486.3 MB/s		0.555
945.0 MB/s		11.64%✅ +29.4%-141.0%✅ +31.8%
Gzip_L169,6071.751
299.4 MB/s		1.030
508.8 MB/s		13.28%✅ +38.1%-48.4%✅ +63.3%
Brotli_Q149,7291.814
289.1 MB/s		1.400
374.6 MB/s		9.49%✅ +13.3%-43.2%✅ +73.0%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_fast23,5962.654
197.5 MB/s		0.311
1683.3 MB/s		4.50%———
Zstd_L123,5730.928
564.8 MB/s		0.386
1356.9 MB/s		4.50%-0.1%-186.0%✅ +19.4%
Zstd_L1_disjoint_window_dict41,0740.734
714.5 MB/s		0.391
1339.3 MB/s		7.84%✅ +42.6%-261.8%✅ +20.4%
Gzip_L131,5050.922
568.6 MB/s		0.585
896.5 MB/s		6.01%✅ +25.1%-187.9%✅ +46.7%
Brotli_Q125,8901.291
406.2 MB/s		0.973
538.7 MB/s		4.94%✅ +8.9%-105.7%✅ +68.0%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_fast32,9033.276
160.0 MB/s		0.411
1276.7 MB/s		6.28%———
Zstd_L132,8801.119
468.7 MB/s		0.477
1098.5 MB/s		6.27%-0.1%-192.9%✅ +14.0%
Zstd_L1_disjoint_window_dict52,2871.039
504.4 MB/s		0.512
1023.4 MB/s		9.97%✅ +37.1%-215.2%✅ +19.8%
Gzip_L148,5381.161
451.7 MB/s		0.849
617.8 MB/s		9.26%✅ +32.2%-182.3%✅ +51.6%
Brotli_Q140,2101.787
293.3 MB/s		1.296
404.7 MB/s		7.67%✅ +18.2%-83.3%✅ +68.3%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_fast47,5903.153
166.3 MB/s		0.438
1197.2 MB/s		9.08%———
Zstd_L147,5671.242
422.1 MB/s		0.528
992.3 MB/s		9.07%-0.0%-153.9%✅ +17.1%
Zstd_L1_disjoint_window_dict65,0401.193
439.6 MB/s		0.547
959.1 MB/s		12.41%✅ +26.8%-164.4%✅ +19.9%
Gzip_L169,1661.631
321.5 MB/s		1.041
503.5 MB/s		13.19%✅ +31.2%-93.4%✅ +57.9%
Brotli_Q151,5961.782
294.3 MB/s		1.500
349.4 MB/s		9.84%✅ +7.8%-77.0%✅ +70.8%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_fast19,7522.164
242.2 MB/s		0.305
1719.1 MB/s		3.77%———
Zstd_L119,7290.874
599.5 MB/s		0.367
1428.0 MB/s		3.76%-0.1%-147.5%✅ +16.9%
Zstd_L1_disjoint_window_dict37,1130.749
700.0 MB/s		0.397
1319.2 MB/s		7.08%✅ +46.8%-189.0%✅ +23.3%
Gzip_L132,8170.964
544.0 MB/s		0.614
853.6 MB/s		6.26%✅ +39.8%-124.6%✅ +50.3%
Brotli_Q121,5461.255
417.8 MB/s		1.050
499.2 MB/s		4.11%✅ +8.3%-72.5%✅ +71.0%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_fast34,8111.784
293.8 MB/s		0.400
1311.3 MB/s		6.64%———
Zstd_L134,7881.094
479.0 MB/s		0.475
1104.5 MB/s		6.64%-0.1%-63.0%✅ +15.8%
Zstd_L1_disjoint_window_dict53,2491.130
463.7 MB/s		0.525
997.9 MB/s		10.16%✅ +34.6%-57.8%✅ +23.9%
Gzip_L161,0881.418
369.6 MB/s		0.976
536.9 MB/s		11.65%✅ +43.0%-25.8%✅ +59.1%
Brotli_Q145,5341.758
298.1 MB/s		1.389
377.3 MB/s		8.69%✅ +23.5%-1.5%✅ +71.2%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_fast32,8902.766
189.5 MB/s		0.416
1261.5 MB/s		6.27%———
Zstd_L132,8671.049
499.8 MB/s		0.467
1123.6 MB/s		6.27%-0.1%-163.7%✅ +10.9%
Zstd_L1_disjoint_window_dict49,5290.978
536.2 MB/s		0.505
1037.7 MB/s		9.45%✅ +33.6%-182.9%✅ +17.7%
Gzip_L173,3721.711
306.4 MB/s		1.053
498.0 MB/s		14.00%✅ +55.2%-61.7%✅ +60.5%
Brotli_Q139,4141.338
391.9 MB/s		1.083
484.2 MB/s		7.52%✅ +16.6%-106.8%✅ +61.6%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_fast58,1033.567
147.0 MB/s		0.489
1072.0 MB/s		11.08%———
Zstd_L158,0801.412
371.4 MB/s		0.594
883.3 MB/s		11.08%-0.0%-152.7%✅ +17.6%
Zstd_L1_disjoint_window_dict80,3661.486
352.7 MB/s		0.657
798.2 MB/s		15.33%✅ +27.7%-140.0%✅ +25.5%
Gzip_L1142,8792.966
176.7 MB/s		1.971
266.0 MB/s		27.25%✅ +59.3%-20.2%✅ +75.2%
Brotli_Q171,6482.134
245.7 MB/s		1.676
312.9 MB/s		13.67%✅ +18.9%-67.2%✅ +70.8%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_fast45,4301.767
296.7 MB/s		0.548
956.5 MB/s		8.67%———
Zstd_L145,4071.384
378.9 MB/s		0.618
848.6 MB/s		8.66%-0.1%-27.7%✅ +11.3%
Zstd_L1_disjoint_window_dict62,7921.332
393.5 MB/s		0.668
784.8 MB/s		11.98%✅ +27.7%-32.6%✅ +18.0%
Gzip_L166,2831.687
310.7 MB/s		1.235
424.4 MB/s		12.64%✅ +31.5%-4.7%✅ +55.6%
Brotli_Q152,6742.130
246.1 MB/s		1.757
298.5 MB/s		10.05%✅ +13.8%✅ +17.0%✅ +68.8%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_fast35,2843.928
133.5 MB/s		0.478
1096.0 MB/s		6.73%———
Zstd_L135,2611.333
393.2 MB/s		0.561
935.1 MB/s		6.73%-0.1%-194.6%✅ +14.7%
Zstd_L1_disjoint_window_dict50,9391.255
417.9 MB/s		0.587
892.6 MB/s		9.72%✅ +30.7%-213.1%✅ +18.6%
Gzip_L149,8211.676
312.9 MB/s		1.109
472.7 MB/s		9.50%✅ +29.2%-134.4%✅ +56.9%
Brotli_Q137,4851.774
295.6 MB/s		1.720
304.7 MB/s		7.15%✅ +5.9%-121.5%✅ +72.2%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_fast17,4241.949
268.9 MB/s		0.885
592.5 MB/s		3.32%———
Zstd_L132,3261.383
379.1 MB/s		0.599
874.7 MB/s		6.17%✅ +46.1%-41.0%-47.6%
Zstd_L1_disjoint_window_dict50,6441.302
402.6 MB/s		0.662
791.6 MB/s		9.66%✅ +65.6%-49.7%-33.6%
Gzip_L145,2901.356
386.6 MB/s		1.014
517.1 MB/s		8.64%✅ +61.5%-43.8%✅ +12.7%
Brotli_Q135,4511.762
297.5 MB/s		1.513
346.4 MB/s		6.76%✅ +50.9%-10.6%✅ +41.5%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_fast32,1083.657
143.3 MB/s		0.534
982.6 MB/s		6.12%———
Zstd_L132,0851.442
363.6 MB/s		0.778
673.7 MB/s		6.12%-0.1%-153.7%✅ +31.4%
Zstd_L1_disjoint_window_dict49,6601.226
427.7 MB/s		0.654
801.2 MB/s		9.47%✅ +35.3%-198.4%✅ +18.5%
Gzip_L143,4141.531
342.4 MB/s		1.113
471.1 MB/s		8.28%✅ +26.0%-138.9%✅ +52.1%
Brotli_Q134,8562.078
252.3 MB/s		1.769
296.3 MB/s		6.65%✅ +7.9%-76.0%✅ +69.8%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_fast6560.094
33.8 MB/s		0.011
288.3 MB/s		20.65%———
Zstd_L16610.032
100.6 MB/s		0.013
246.3 MB/s		20.81%✅ +0.8%-197.7%✅ +14.6%
Zstd_L1_disjoint_window_dict17,0170.100
31.8 MB/s		0.023
135.7 MB/s		535.63%✅ +96.1%✅ +5.9%✅ +52.9%
Gzip_L16860.049
64.4 MB/s		0.023
137.3 MB/s		21.59%✅ +4.4%-90.6%✅ +52.4%
Brotli_Q16960.051
62.4 MB/s		0.732
4.3 MB/s		21.91%✅ +5.7%-84.7%✅ +98.5%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_fast5440.035
45.8 MB/s		0.008
202.7 MB/s		33.75%———
Zstd_L15490.026
61.1 MB/s		0.010
164.4 MB/s		34.06%✅ +0.9%-33.4%✅ +18.9%
Zstd_L1_disjoint_window_dict16,9090.085
19.0 MB/s		0.020
81.2 MB/s		1048.95%✅ +96.8%✅ +58.5%✅ +59.9%
Gzip_L15600.045
35.9 MB/s		0.019
84.9 MB/s		34.74%✅ +2.9%✅ +21.5%✅ +58.1%
Brotli_Q15670.041
39.0 MB/s		0.641
2.5 MB/s		35.17%✅ +4.1%✅ +14.8%✅ +98.8%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_fast2,8290.296
78.8 MB/s		0.039
595.3 MB/s		12.14%———
Zstd_L12,8060.089
261.8 MB/s		0.044
531.8 MB/s		12.04%-0.8%-232.0%✅ +10.7%
Zstd_L1_disjoint_window_dict19,2330.165
141.5 MB/s		0.063
369.8 MB/s		82.50%✅ +85.3%-79.5%✅ +37.9%
Gzip_L13,4590.138
169.5 MB/s		0.084
278.3 MB/s		14.84%✅ +18.2%-115.0%✅ +53.3%
Brotli_Q13,1370.178
131.3 MB/s		0.250
93.4 MB/s		13.46%✅ +9.8%-66.5%✅ +84.3%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_fast2,6630.113
73.0 MB/s		0.019
429.4 MB/s		32.44%———
Zstd_L12,6400.054
153.3 MB/s		0.022
374.1 MB/s		32.16%-0.9%-110.1%✅ +12.9%
Zstd_L1_disjoint_window_dict18,8810.132
62.4 MB/s		0.036
228.8 MB/s		229.98%✅ +85.9%✅ +14.5%✅ +46.7%
Gzip_L12,8190.111
74.2 MB/s		0.059
139.5 MB/s		34.34%✅ +5.5%-1.6%✅ +67.5%
Brotli_Q12,6430.123
67.0 MB/s		0.845
9.7 MB/s		32.19%-0.8%✅ +8.2%✅ +97.7%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_fast1,6170.155
29.1 MB/s		0.017
268.9 MB/s		35.92%———
Zstd_L11,6220.051
87.5 MB/s		0.018
255.7 MB/s		36.03%✅ +0.3%-200.6%✅ +4.9%
Zstd_L1_disjoint_window_dict17,9410.130
34.6 MB/s		0.030
150.9 MB/s		398.51%✅ +91.0%-18.9%✅ +43.9%
Gzip_L11,6600.086
52.2 MB/s		0.038
117.0 MB/s		36.87%✅ +2.6%-79.3%✅ +56.5%
Brotli_Q11,6360.188
23.9 MB/s		1.340
3.4 MB/s		36.34%✅ +1.2%✅ +17.8%✅ +98.8%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_fast6,0593.268
160.4 MB/s		1.299
403.5 MB/s		1.16%———
Zstd_L18,5131.050
499.3 MB/s		0.544
963.2 MB/s		1.62%✅ +28.8%-211.2%-138.7%
Zstd_L1_disjoint_window_dict24,0840.865
606.4 MB/s		0.531
986.5 MB/s		4.59%✅ +74.8%-278.0%-144.5%
Gzip_L119,9641.049
500.0 MB/s		0.677
773.9 MB/s		3.81%✅ +69.7%-211.6%-91.8%
Brotli_Q112,5141.443
363.3 MB/s		1.206
434.7 MB/s		2.39%✅ +51.6%-126.4%-7.8%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_fast1,4390.279
17.7 MB/s		0.017
293.8 MB/s		29.10%———
Zstd_L11,4440.131
37.8 MB/s		0.019
266.3 MB/s		29.20%✅ +0.3%-113.8%✅ +9.4%
Zstd_L1_disjoint_window_dict17,7770.127
39.0 MB/s		0.033
149.0 MB/s		359.49%✅ +91.9%-120.4%✅ +49.3%
Gzip_L11,5490.074
66.4 MB/s		0.038
128.8 MB/s		31.32%✅ +7.1%-275.2%✅ +56.2%
Brotli_Q11,4970.083
59.3 MB/s		0.207
23.9 MB/s		30.27%✅ +3.9%-235.2%✅ +91.9%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_fast9100.040
41.5 MB/s		0.010
170.1 MB/s		54.65%———
Zstd_L19150.032
52.0 MB/s		0.012
140.7 MB/s		54.95%✅ +0.5%-25.6%✅ +17.3%
Zstd_L1_disjoint_window_dict17,2940.097
17.2 MB/s		0.024
70.0 MB/s		1038.68%✅ +94.7%✅ +58.4%✅ +58.9%
Gzip_L19390.053
31.7 MB/s		0.023
73.3 MB/s		56.40%✅ +3.1%✅ +23.5%✅ +56.9%
Brotli_Q19510.051
32.5 MB/s		0.716
2.3 MB/s		57.12%✅ +4.3%✅ +21.5%✅ +98.6%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_fast58,8176.452
81.3 MB/s		0.730
718.1 MB/s		11.22%———
Zstd_L158,7942.002
261.9 MB/s		1.091
480.4 MB/s		11.22%-0.0%-222.3%✅ +33.1%
Zstd_L1_disjoint_window_dict76,7652.065
253.9 MB/s		0.899
583.2 MB/s		14.64%✅ +23.4%-212.4%✅ +18.8%
Gzip_L185,1502.710
193.5 MB/s		1.790
292.9 MB/s		16.24%✅ +30.9%-138.1%✅ +59.2%
Brotli_Q165,8822.813
186.4 MB/s		2.289
229.1 MB/s		12.57%✅ +10.7%-129.4%✅ +68.1%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_fast58,8836.242
84.0 MB/s		0.722
725.7 MB/s		11.23%———
Zstd_L158,8601.985
264.2 MB/s		0.844
620.8 MB/s		11.23%-0.0%-214.5%✅ +14.5%
Zstd_L1_disjoint_window_dict77,4162.066
253.7 MB/s		0.889
589.5 MB/s		14.77%✅ +23.9%-202.1%✅ +18.8%
Gzip_L182,3792.634
199.0 MB/s		1.792
292.5 MB/s		15.71%✅ +28.5%-137.0%✅ +59.7%
Brotli_Q165,4072.749
190.7 MB/s		2.245
233.5 MB/s		12.48%✅ +10.0%-127.0%✅ +67.8%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_fast78,7264.263
122.9 MB/s		1.491
351.2 MB/s		15.03%———
Zstd_L178,8741.918
273.1 MB/s		0.882
593.7 MB/s		15.06%✅ +0.2%-122.2%-69.0%
Zstd_L1_disjoint_window_dict96,9902.422
216.3 MB/s		0.818
640.5 MB/s		18.52%✅ +18.8%-76.0%-82.4%
Gzip_L1117,7493.427
152.8 MB/s		2.187
239.5 MB/s		22.48%✅ +33.1%-24.4%✅ +31.8%
Brotli_Q182,1713.249
161.2 MB/s		2.570
203.8 MB/s		15.69%✅ +4.2%-31.2%✅ +42.0%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_fast72,6754.225
124.0 MB/s		0.712
736.1 MB/s		13.88%———
Zstd_L172,6522.014
260.1 MB/s		0.727
720.7 MB/s		13.87%-0.0%-109.8%✅ +2.1%
Zstd_L1_disjoint_window_dict90,7552.014
260.0 MB/s		0.775
676.0 MB/s		17.33%✅ +19.9%-109.8%✅ +8.2%
Gzip_L1106,7163.103
168.8 MB/s		1.954
268.0 MB/s		20.38%✅ +31.9%-36.1%✅ +63.6%
Brotli_Q176,6563.011
173.9 MB/s		2.426
215.8 MB/s		14.64%✅ +5.2%-40.3%✅ +70.7%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_fast71,1074.161
125.1 MB/s		0.825
630.6 MB/s		13.66%———
Zstd_L171,0841.744
298.5 MB/s		0.721
722.3 MB/s		13.66%-0.0%-138.6%-14.5%
Zstd_L1_disjoint_window_dict88,4421.916
271.7 MB/s		0.747
696.5 MB/s		16.99%✅ +19.6%-117.2%-10.5%
Gzip_L1111,2803.195
162.9 MB/s		2.150
242.1 MB/s		21.38%✅ +36.1%-30.2%✅ +61.6%
Brotli_Q174,7352.860
182.0 MB/s		2.267
229.6 MB/s		14.36%✅ +4.9%-45.5%✅ +63.6%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_fast74,1433.876
135.2 MB/s		0.611
856.6 MB/s		14.15%———
Zstd_L174,1201.849
283.3 MB/s		0.726
721.3 MB/s		14.15%-0.0%-109.6%✅ +15.8%
Zstd_L1_disjoint_window_dict92,4391.983
264.2 MB/s		0.826
634.4 MB/s		17.65%✅ +19.8%-95.5%✅ +25.9%
Gzip_L1114,7003.138
166.9 MB/s		2.003
261.5 MB/s		21.90%✅ +35.4%-23.5%✅ +69.5%
Brotli_Q178,9402.843
184.3 MB/s		2.279
229.9 MB/s		15.07%✅ +6.1%-36.3%✅ +73.2%

Native / thin

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_native_thin_L040,698488.930
1.1 MB/s		2.599
201.7 MB/s		7.76%———
Zstd_L942,49111.465
45.7 MB/s		0.579
906.0 MB/s		8.11%✅ +4.2%-4164.5%-349.2%
Zstd_L9_disjoint_window_dict60,3057.378
71.0 MB/s		0.599
874.8 MB/s		11.50%✅ +32.5%-6527.0%-333.7%
Gzip_L949,60010.855
48.3 MB/s		0.891
588.1 MB/s		9.46%✅ +17.9%-4404.1%-191.6%
Brotli_Q942,01439.759
13.2 MB/s		1.116
469.7 MB/s		8.01%✅ +3.1%-1129.7%-132.9%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_native_thin_L013,599211.987
1.1 MB/s		1.348
177.8 MB/s		5.67%———
Zstd_L915,6778.185
29.3 MB/s		0.254
942.7 MB/s		6.54%✅ +13.3%-2489.8%-430.1%
Zstd_L9_disjoint_window_dict31,9603.010
79.7 MB/s		0.271
883.9 MB/s		13.33%✅ +57.4%-6943.0%-397.0%
Gzip_L918,3884.600
52.1 MB/s		0.363
661.3 MB/s		7.67%✅ +26.0%-4508.5%-271.8%
Brotli_Q915,12220.793
11.5 MB/s		0.494
485.0 MB/s		6.31%✅ +10.1%-919.5%-172.7%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_native_thin_L015,615393.268
1.3 MB/s		2.442
214.6 MB/s		2.98%———
Zstd_L919,4169.540
54.9 MB/s		0.429
1221.7 MB/s		3.70%✅ +19.6%-4022.3%-469.2%
Zstd_L9_disjoint_window_dict35,5794.400
119.1 MB/s		0.457
1148.3 MB/s		6.79%✅ +56.1%-8837.0%-435.0%
Gzip_L925,7095.696
92.0 MB/s		0.664
788.9 MB/s		4.90%✅ +39.3%-6804.4%-267.6%
Brotli_Q918,52527.139
19.3 MB/s		0.888
590.5 MB/s		3.53%✅ +15.7%-1349.1%-175.1%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_native_thin_L06,190345.346
1.5 MB/s		2.935
178.6 MB/s		1.18%———
Zstd_L916,10510.177
51.5 MB/s		0.399
1313.0 MB/s		3.07%✅ +61.6%-3293.4%-635.0%
Zstd_L9_disjoint_window_dict32,1465.004
104.8 MB/s		0.393
1333.5 MB/s		6.13%✅ +80.7%-6801.0%-646.4%
Gzip_L919,3767.933
66.1 MB/s		0.512
1023.4 MB/s		3.70%✅ +68.1%-4253.1%-472.8%
Brotli_Q915,77235.254
14.9 MB/s		0.692
757.1 MB/s		3.01%✅ +60.8%-879.6%-323.8%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_native_thin_L039,272502.690
1.0 MB/s		1.599
327.8 MB/s		7.49%———
Zstd_L939,93610.791
48.6 MB/s		0.434
1208.5 MB/s		7.62%✅ +1.7%-4558.5%-268.7%
Zstd_L9_disjoint_window_dict58,9326.065
86.4 MB/s		0.495
1059.6 MB/s		11.24%✅ +33.4%-8188.2%-223.3%
Gzip_L947,9996.821
76.9 MB/s		0.854
614.1 MB/s		9.16%✅ +18.2%-7269.6%-87.3%
Brotli_Q940,40938.648
13.6 MB/s		1.170
448.2 MB/s		7.71%✅ +2.8%-1200.7%-36.8%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_native_thin_L013,763432.562
1.2 MB/s		4.318
121.4 MB/s		2.63%———
Zstd_L920,6619.245
56.7 MB/s		0.560
936.2 MB/s		3.94%✅ +33.4%-4578.8%-671.2%
Zstd_L9_disjoint_window_dict39,3244.746
110.5 MB/s		0.404
1297.4 MB/s		7.50%✅ +65.0%-9014.6%-968.7%
Gzip_L925,7018.044
65.2 MB/s		0.551
952.1 MB/s		4.90%✅ +46.4%-5277.2%-684.2%
Brotli_Q923,23531.946
16.4 MB/s		0.773
678.4 MB/s		4.43%✅ +40.8%-1254.0%-458.8%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_native_thin_L016,574385.580
1.4 MB/s		2.326
225.4 MB/s		3.16%———
Zstd_L928,73910.631
49.3 MB/s		0.457
1147.8 MB/s		5.48%✅ +42.3%-3527.0%-409.3%
Zstd_L9_disjoint_window_dict44,9526.499
80.7 MB/s		0.461
1136.2 MB/s		8.57%✅ +63.1%-5832.8%-404.2%
Gzip_L935,3509.977
52.5 MB/s		0.664
788.9 MB/s		6.74%✅ +53.1%-3764.7%-250.1%
Brotli_Q930,37039.930
13.1 MB/s		0.973
539.1 MB/s		5.79%✅ +45.4%-865.6%-139.2%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_native_thin_L036,773465.041
1.1 MB/s		1.712
306.2 MB/s		7.01%———
Zstd_L940,21810.924
48.0 MB/s		0.494
1060.7 MB/s		7.67%✅ +8.6%-4157.3%-246.4%
Zstd_L9_disjoint_window_dict56,5076.908
75.9 MB/s		0.512
1023.0 MB/s		10.78%✅ +34.9%-6631.4%-234.1%
Gzip_L950,43911.879
44.1 MB/s		0.853
614.9 MB/s		9.62%✅ +27.1%-3814.7%-100.8%
Brotli_Q940,03338.888
13.5 MB/s		1.151
455.3 MB/s		7.64%✅ +8.1%-1095.8%-48.7%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_native_thin_L010,770327.964
1.6 MB/s		2.566
204.3 MB/s		2.05%———
Zstd_L914,9928.339
62.9 MB/s		0.359
1461.9 MB/s		2.86%✅ +28.2%-3832.7%-615.7%
Zstd_L9_disjoint_window_dict32,8323.590
146.0 MB/s		0.367
1428.1 MB/s		6.26%✅ +67.2%-9036.4%-599.2%
Gzip_L922,7065.607
93.5 MB/s		0.521
1005.7 MB/s		4.33%✅ +52.6%-5749.6%-392.3%
Brotli_Q915,13927.661
19.0 MB/s		0.896
584.8 MB/s		2.89%✅ +28.9%-1085.6%-186.3%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_native_thin_L029,612418.873
1.3 MB/s		1.546
339.1 MB/s		5.65%———
Zstd_L930,21210.279
51.0 MB/s		0.461
1135.8 MB/s		5.76%✅ +2.0%-3975.1%-235.0%
Zstd_L9_disjoint_window_dict46,5596.088
86.1 MB/s		0.478
1096.8 MB/s		8.88%✅ +36.4%-6780.0%-223.5%
Gzip_L941,97511.881
44.1 MB/s		0.747
701.3 MB/s		8.01%✅ +29.5%-3425.4%-106.8%
Brotli_Q930,78838.110
13.8 MB/s		0.981
534.0 MB/s		5.87%✅ +3.8%-999.1%-57.5%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_native_thin_L020,460402.379
1.3 MB/s		0.976
537.3 MB/s		3.90%———
Zstd_L927,2739.991
52.5 MB/s		0.424
1235.7 MB/s		5.20%✅ +25.0%-3927.3%-130.0%
Zstd_L9_disjoint_window_dict43,2315.026
104.3 MB/s		0.528
993.0 MB/s		8.25%✅ +52.7%-7905.6%-84.8%
Gzip_L936,6955.416
96.8 MB/s		0.673
778.6 MB/s		7.00%✅ +44.2%-7329.6%-44.9%
Brotli_Q925,47827.272
19.2 MB/s		1.029
509.5 MB/s		4.86%✅ +19.7%-1375.4%✅ +5.2%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_native_thin_L038,457561.645
0.9 MB/s		1.747
300.1 MB/s		7.34%———
Zstd_L945,69211.174
46.9 MB/s		0.538
973.9 MB/s		8.72%✅ +15.8%-4926.4%-224.6%
Zstd_L9_disjoint_window_dict65,2126.791
77.2 MB/s		0.616
850.9 MB/s		12.44%✅ +41.0%-8169.9%-183.6%
Gzip_L999,26715.096
34.7 MB/s		1.533
341.9 MB/s		18.93%✅ +61.3%-3620.4%-13.9%
Brotli_Q942,92834.390
15.2 MB/s		1.131
463.7 MB/s		8.19%✅ +10.4%-1533.2%-54.5%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_native_thin_L020,526510.725
1.0 MB/s		4.056
129.3 MB/s		3.92%———
Zstd_L937,09012.545
41.8 MB/s		0.547
957.8 MB/s		7.07%✅ +44.7%-3971.2%-641.0%
Zstd_L9_disjoint_window_dict53,3258.215
63.8 MB/s		0.570
919.7 MB/s		10.17%✅ +61.5%-6116.9%-611.5%
Gzip_L942,86513.779
38.0 MB/s		0.917
571.9 MB/s		8.18%✅ +52.1%-3606.5%-342.4%
Brotli_Q936,40943.958
11.9 MB/s		1.361
385.2 MB/s		6.94%✅ +43.6%-1061.9%-198.0%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_native_thin_L024,453491.320
1.1 MB/s		2.191
239.3 MB/s		4.66%———
Zstd_L928,56612.514
41.9 MB/s		0.532
985.4 MB/s		5.45%✅ +14.4%-3826.1%-311.9%
Zstd_L9_disjoint_window_dict44,9216.827
76.8 MB/s		0.543
966.0 MB/s		8.57%✅ +45.6%-7096.2%-303.8%
Gzip_L934,13110.350
50.6 MB/s		0.894
586.1 MB/s		6.51%✅ +28.4%-4646.9%-145.0%
Brotli_Q928,57436.958
14.2 MB/s		1.330
394.0 MB/s		5.45%✅ +14.4%-1229.4%-64.7%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_native_thin_L013,218476.378
1.1 MB/s		4.073
128.7 MB/s		2.52%———
Zstd_L925,78713.290
39.4 MB/s		0.567
924.8 MB/s		4.92%✅ +48.7%-3484.5%-618.5%
Zstd_L9_disjoint_window_dict42,0177.778
67.4 MB/s		0.588
891.4 MB/s		8.02%✅ +68.5%-6024.6%-592.6%
Gzip_L933,41914.785
35.5 MB/s		0.790
663.9 MB/s		6.37%✅ +60.4%-3122.1%-415.9%
Brotli_Q926,83163.873
8.2 MB/s		1.107
473.4 MB/s		5.12%✅ +50.7%-645.8%-267.8%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_native_thin_L024,320483.427
1.1 MB/s		3.648
143.7 MB/s		4.64%———
Zstd_L924,92813.179
39.8 MB/s		0.557
941.7 MB/s		4.76%✅ +2.4%-3568.1%-555.4%
Zstd_L9_disjoint_window_dict40,8537.270
72.1 MB/s		0.571
917.5 MB/s		7.79%✅ +40.5%-6549.8%-538.5%
Gzip_L927,33912.707
41.3 MB/s		0.883
594.0 MB/s		5.22%✅ +11.0%-3704.4%-313.4%
Brotli_Q925,01636.496
14.4 MB/s		1.558
336.5 MB/s		4.77%✅ +2.8%-1224.6%-134.2%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_native_thin_L07749.533
0.3 MB/s		0.026
120.4 MB/s		24.36%———
Zstd_L96212.164
1.5 MB/s		0.146
21.7 MB/s		19.55%-24.6%-340.6%✅ +82.0%
Zstd_L9_disjoint_window_dict16,9830.356
8.9 MB/s		0.151
21.1 MB/s		534.56%✅ +95.4%-2581.3%✅ +82.5%
Gzip_L96340.082
38.9 MB/s		0.024
133.3 MB/s		19.96%-22.1%-11578.3%-10.7%
Brotli_Q95876.766
0.5 MB/s		0.039
81.3 MB/s		18.48%-31.9%-40.9%✅ +32.4%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_native_thin_L06633.822
0.4 MB/s		0.019
85.7 MB/s		41.13%———
Zstd_L95382.142
0.8 MB/s		0.129
12.5 MB/s		33.37%-23.2%-78.4%✅ +85.5%
Zstd_L9_disjoint_window_dict16,8930.295
5.5 MB/s		0.135
11.9 MB/s		1047.95%✅ +96.1%-1194.8%✅ +86.1%
Gzip_L95410.071
22.6 MB/s		0.020
81.0 MB/s		33.56%-22.6%-5253.0%✅ +5.4%
Brotli_Q94706.671
0.2 MB/s		0.034
47.4 MB/s		29.16%-41.1%✅ +42.7%✅ +44.7%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_native_thin_L02,53129.448
0.8 MB/s		0.206
113.4 MB/s		10.86%———
Zstd_L92,4652.539
9.2 MB/s		0.044
535.8 MB/s		10.57%-2.7%-1059.7%-372.4%
Zstd_L9_disjoint_window_dict18,8240.704
33.1 MB/s		0.063
367.9 MB/s		80.75%✅ +86.6%-4084.3%-224.4%
Gzip_L92,6570.446
52.3 MB/s		0.071
328.4 MB/s		11.40%✅ +4.7%-6502.3%-189.5%
Brotli_Q92,3768.002
2.9 MB/s		0.117
199.2 MB/s		10.19%-6.5%-268.0%-75.6%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_native_thin_L02,49410.343
0.8 MB/s		0.091
89.8 MB/s		30.38%———
Zstd_L92,3422.752
3.0 MB/s		0.436
18.8 MB/s		28.53%-6.5%-275.8%✅ +79.0%
Zstd_L9_disjoint_window_dict18,6610.540
15.2 MB/s		0.187
43.9 MB/s		227.30%✅ +86.6%-1815.5%✅ +51.1%
Gzip_L92,3400.209
39.3 MB/s		0.052
158.8 MB/s		28.50%-6.6%-4846.7%-76.8%
Brotli_Q92,1517.389
1.1 MB/s		0.096
85.7 MB/s		26.20%-15.9%-40.0%✅ +4.5%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_native_thin_L01,78423.844
0.2 MB/s		0.044
101.9 MB/s		39.63%———
Zstd_L91,4963.186
1.4 MB/s		0.292
15.4 MB/s		33.23%-19.3%-648.5%✅ +84.9%
Zstd_L9_disjoint_window_dict17,7930.517
8.7 MB/s		0.413
10.9 MB/s		395.22%✅ +90.0%-4507.9%✅ +89.3%
Gzip_L91,4800.144
31.2 MB/s		0.072
62.5 MB/s		32.87%-20.5%-16405.4%✅ +38.7%
Brotli_Q91,3799.421
0.5 MB/s		0.064
70.1 MB/s		30.63%-29.4%-153.1%✅ +31.2%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_native_thin_L01,505407.741
1.3 MB/s		1.663
315.2 MB/s		0.29%———
Zstd_L98,79211.597
45.2 MB/s		0.620
845.0 MB/s		1.68%✅ +82.9%-3416.0%-168.1%
Zstd_L9_disjoint_window_dict24,9754.511
116.2 MB/s		0.549
955.6 MB/s		4.76%✅ +94.0%-8938.7%-203.2%
Gzip_L915,4595.193
101.0 MB/s		0.565
927.2 MB/s		2.95%✅ +90.3%-7751.2%-194.2%
Brotli_Q98,07329.406
17.8 MB/s		0.817
641.6 MB/s		1.54%✅ +81.4%-1286.6%-103.5%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_native_thin_L01,63310.229
0.5 MB/s		0.042
116.8 MB/s		33.02%———
Zstd_L91,3132.335
2.1 MB/s		0.019
257.7 MB/s		26.55%-24.4%-338.0%-120.7%
Zstd_L9_disjoint_window_dict17,6530.409
12.1 MB/s		0.039
127.9 MB/s		356.99%✅ +90.7%-2398.6%-9.5%
Gzip_L91,3050.141
35.0 MB/s		0.036
136.3 MB/s		26.39%-25.1%-7137.5%-16.7%
Brotli_Q91,2077.391
0.7 MB/s		0.061
81.7 MB/s		24.41%-35.3%-38.4%✅ +30.0%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_native_thin_L01,0584.635
0.4 MB/s		0.026
65.2 MB/s		63.54%———
Zstd_L99012.261
0.7 MB/s		0.137
12.2 MB/s		54.11%-17.4%-105.0%✅ +81.3%
Zstd_L9_disjoint_window_dict17,2560.292
5.7 MB/s		0.159
10.5 MB/s		1036.40%✅ +93.9%-1489.7%✅ +83.9%
Gzip_L99050.089
18.8 MB/s		0.024
68.2 MB/s		54.35%-16.9%-5128.6%-4.6%
Brotli_Q98417.297
0.2 MB/s		0.045
37.3 MB/s		50.51%-25.8%✅ +36.5%✅ +42.8%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_native_thin_L034,247640.077
0.8 MB/s		2.175
241.0 MB/s		6.53%———
Zstd_L946,31016.587
31.6 MB/s		0.874
599.9 MB/s		8.83%✅ +26.0%-3759.0%-149.0%
Zstd_L9_disjoint_window_dict61,82111.034
47.5 MB/s		0.785
667.4 MB/s		11.79%✅ +44.6%-5701.1%-177.0%
Gzip_L950,29615.299
34.3 MB/s		1.145
458.0 MB/s		9.59%✅ +31.9%-4083.7%-90.0%
Brotli_Q942,96448.301
10.9 MB/s		1.464
358.0 MB/s		8.20%✅ +20.3%-1225.2%-48.6%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_native_thin_L035,306642.370
0.8 MB/s		2.357
222.4 MB/s		6.73%———
Zstd_L946,81216.472
31.8 MB/s		0.739
709.6 MB/s		8.93%✅ +24.6%-3799.9%-219.1%
Zstd_L9_disjoint_window_dict62,52610.846
48.3 MB/s		0.796
658.2 MB/s		11.93%✅ +43.5%-5822.4%-196.0%
Gzip_L950,96515.319
34.2 MB/s		1.151
455.6 MB/s		9.72%✅ +30.7%-4093.3%-104.9%
Brotli_Q943,11150.593
10.4 MB/s		1.458
359.6 MB/s		8.22%✅ +18.1%-1169.7%-61.7%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_native_thin_L070,150419.326
1.2 MB/s		3.627
144.4 MB/s		13.39%———
Zstd_L969,89616.076
32.6 MB/s		0.923
567.6 MB/s		13.35%-0.4%-2508.4%-293.1%
Zstd_L9_disjoint_window_dict88,04710.402
50.4 MB/s		0.851
615.1 MB/s		16.81%✅ +20.3%-3931.2%-326.0%
Gzip_L982,59221.204
24.7 MB/s		1.660
315.6 MB/s		15.77%✅ +15.1%-1877.6%-118.6%
Brotli_Q967,04556.819
9.2 MB/s		2.346
223.2 MB/s		12.80%-4.6%-638.0%-54.6%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_native_thin_L065,668409.317
1.3 MB/s		3.630
144.3 MB/s		12.54%———
Zstd_L966,28115.764
33.2 MB/s		0.717
730.2 MB/s		12.66%✅ +0.9%-2496.6%-406.0%
Zstd_L9_disjoint_window_dict85,1549.863
53.1 MB/s		0.834
628.1 MB/s		16.26%✅ +22.9%-4049.8%-335.3%
Gzip_L977,52317.689
29.6 MB/s		1.545
338.9 MB/s		14.80%✅ +15.3%-2214.0%-134.9%
Brotli_Q963,95658.063
9.0 MB/s		2.040
256.7 MB/s		12.21%-2.7%-605.0%-77.9%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_native_thin_L063,328378.314
1.4 MB/s		3.305
157.5 MB/s		12.17%———
Zstd_L963,05814.720
35.4 MB/s		0.728
714.7 MB/s		12.11%-0.4%-2470.1%-353.8%
Zstd_L9_disjoint_window_dict80,8969.096
57.2 MB/s		0.767
679.0 MB/s		15.54%✅ +21.7%-4059.3%-331.1%
Gzip_L975,46517.325
30.0 MB/s		1.456
357.4 MB/s		14.50%✅ +16.1%-2083.6%-127.0%
Brotli_Q960,74352.666
9.9 MB/s		2.021
257.6 MB/s		11.67%-4.3%-618.3%-63.6%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_native_thin_L066,394389.035
1.3 MB/s		3.315
158.0 MB/s		12.67%———
Zstd_L966,46314.737
35.5 MB/s		0.678
772.9 MB/s		12.69%✅ +0.1%-2539.8%-389.1%
Zstd_L9_disjoint_window_dict84,8869.115
57.5 MB/s		0.827
633.3 MB/s		16.20%✅ +21.8%-4168.0%-300.8%
Gzip_L980,13416.804
31.2 MB/s		1.486
352.5 MB/s		15.30%✅ +17.1%-2215.2%-123.1%
Brotli_Q964,20753.570
9.8 MB/s		2.150
243.7 MB/s		12.26%-3.4%-626.2%-54.2%

Hybrid / thin

CodecTotal bytesEncode msVerified decode msSource %PIZD size advantagePIZD encode advantagePIZD decode advantage
01_loghub_hdfs.log — 524,198 bytes — public-system-log
PIZD_hybrid_thin_L937,69746.535
11.3 MB/s		0.909
576.5 MB/s		7.19%———
Zstd_L942,49111.465
45.7 MB/s		0.579
906.0 MB/s		8.11%✅ +11.3%-305.9%-57.1%
Zstd_L9_disjoint_window_dict60,3057.378
71.0 MB/s		0.599
874.8 MB/s		11.50%✅ +37.5%-530.7%-51.7%
Gzip_L949,60010.855
48.3 MB/s		0.891
588.1 MB/s		9.46%✅ +24.0%-328.7%-2.0%
Brotli_Q942,01439.759
13.2 MB/s		1.116
469.7 MB/s		8.01%✅ +10.3%-17.0%✅ +18.5%
02_loghub_hadoop.log — 239,767 bytes — public-system-log
PIZD_hybrid_thin_L912,88517.990
13.3 MB/s		1.001
239.5 MB/s		5.37%———
Zstd_L915,6778.185
29.3 MB/s		0.254
942.7 MB/s		6.54%✅ +17.8%-119.8%-293.6%
Zstd_L9_disjoint_window_dict31,9603.010
79.7 MB/s		0.271
883.9 MB/s		13.33%✅ +59.7%-497.7%-269.1%
Gzip_L918,3884.600
52.1 MB/s		0.363
661.3 MB/s		7.67%✅ +29.9%-291.1%-176.1%
Brotli_Q915,12220.793
11.5 MB/s		0.494
485.0 MB/s		6.31%✅ +14.8%✅ +13.5%-102.5%
03_loghub_spark.log — 524,190 bytes — public-system-log
PIZD_hybrid_thin_L914,50746.675
11.2 MB/s		1.964
266.9 MB/s		2.77%———
Zstd_L919,4169.540
54.9 MB/s		0.429
1221.7 MB/s		3.70%✅ +25.3%-389.3%-357.7%
Zstd_L9_disjoint_window_dict35,5794.400
119.1 MB/s		0.457
1148.3 MB/s		6.79%✅ +59.2%-960.7%-330.2%
Gzip_L925,7095.696
92.0 MB/s		0.664
788.9 MB/s		4.90%✅ +43.6%-719.5%-195.6%
Brotli_Q918,52527.139
19.3 MB/s		0.888
590.5 MB/s		3.53%✅ +21.7%-72.0%-121.2%
04_loghub_zookeeper.log — 524,285 bytes — public-system-log
PIZD_hybrid_thin_L95,44728.986
18.1 MB/s		2.362
222.0 MB/s		1.04%———
Zstd_L916,10510.177
51.5 MB/s		0.399
1313.0 MB/s		3.07%✅ +66.2%-184.8%-491.5%
Zstd_L9_disjoint_window_dict32,1465.004
104.8 MB/s		0.393
1333.5 MB/s		6.13%✅ +83.1%-479.2%-500.7%
Gzip_L919,3767.933
66.1 MB/s		0.512
1023.4 MB/s		3.70%✅ +71.9%-265.4%-361.0%
Brotli_Q915,77235.254
14.9 MB/s		0.692
757.1 MB/s		3.01%✅ +65.5%✅ +17.8%-241.1%
05_loghub_openstack.log — 524,234 bytes — public-system-log
PIZD_hybrid_thin_L937,77262.038
8.5 MB/s		0.635
825.6 MB/s		7.21%———
Zstd_L939,93610.791
48.6 MB/s		0.434
1208.5 MB/s		7.62%✅ +5.4%-474.9%-46.4%
Zstd_L9_disjoint_window_dict58,9326.065
86.4 MB/s		0.495
1059.6 MB/s		11.24%✅ +35.9%-922.9%-28.3%
Gzip_L947,9996.821
76.9 MB/s		0.854
614.1 MB/s		9.16%✅ +21.3%-809.5%✅ +25.6%
Brotli_Q940,40938.648
13.6 MB/s		1.170
448.2 MB/s		7.71%✅ +6.5%-60.5%✅ +45.7%
06_loghub_bgl.log — 524,227 bytes — public-system-log
PIZD_hybrid_thin_L912,93635.904
14.6 MB/s		3.669
142.9 MB/s		2.47%———
Zstd_L920,6619.245
56.7 MB/s		0.560
936.2 MB/s		3.94%✅ +37.4%-288.4%-555.2%
Zstd_L9_disjoint_window_dict39,3244.746
110.5 MB/s		0.404
1297.4 MB/s		7.50%✅ +67.1%-656.5%-808.0%
Gzip_L925,7018.044
65.2 MB/s		0.551
952.1 MB/s		4.90%✅ +49.7%-346.3%-566.3%
Brotli_Q923,23531.946
16.4 MB/s		0.773
678.4 MB/s		4.43%✅ +44.3%-12.4%-374.8%
07_loghub_hpc.log — 524,244 bytes — public-system-log
PIZD_hybrid_thin_L916,09435.209
14.9 MB/s		2.063
254.1 MB/s		3.07%———
Zstd_L928,73910.631
49.3 MB/s		0.457
1147.8 MB/s		5.48%✅ +44.0%-231.2%-351.8%
Zstd_L9_disjoint_window_dict44,9526.499
80.7 MB/s		0.461
1136.2 MB/s		8.57%✅ +64.2%-441.7%-347.2%
Gzip_L935,3509.977
52.5 MB/s		0.664
788.9 MB/s		6.74%✅ +54.5%-252.9%-210.5%
Brotli_Q930,37039.930
13.1 MB/s		0.973
539.1 MB/s		5.79%✅ +47.0%✅ +11.8%-112.2%
08_loghub_thunderbird.log — 524,221 bytes — public-system-log
PIZD_hybrid_thin_L935,14447.244
11.1 MB/s		2.857
183.5 MB/s		6.70%———
Zstd_L940,21810.924
48.0 MB/s		0.494
1060.7 MB/s		7.67%✅ +12.6%-332.5%-478.1%
Zstd_L9_disjoint_window_dict56,5076.908
75.9 MB/s		0.512
1023.0 MB/s		10.78%✅ +37.8%-583.9%-457.5%
Gzip_L950,43911.879
44.1 MB/s		0.853
614.9 MB/s		9.62%✅ +30.3%-297.7%-235.1%
Brotli_Q940,03338.888
13.5 MB/s		1.151
455.3 MB/s		7.64%✅ +12.2%-21.5%-148.1%
09_loghub_windows.log — 524,220 bytes — public-system-log
PIZD_hybrid_thin_L99,65038.839
13.5 MB/s		2.358
222.4 MB/s		1.84%———
Zstd_L914,9928.339
62.9 MB/s		0.359
1461.9 MB/s		2.86%✅ +35.6%-365.7%-557.5%
Zstd_L9_disjoint_window_dict32,8323.590
146.0 MB/s		0.367
1428.1 MB/s		6.26%✅ +70.6%-982.0%-542.3%
Gzip_L922,7065.607
93.5 MB/s		0.521
1005.7 MB/s		4.33%✅ +57.5%-592.7%-352.3%
Brotli_Q915,13927.661
19.0 MB/s		0.896
584.8 MB/s		2.89%✅ +36.3%-40.4%-163.0%
10_loghub_linux.log — 524,150 bytes — public-system-log
PIZD_hybrid_thin_L926,07139.984
13.1 MB/s		0.755
694.7 MB/s		4.97%———
Zstd_L930,21210.279
51.0 MB/s		0.461
1135.8 MB/s		5.76%✅ +13.7%-289.0%-63.5%
Zstd_L9_disjoint_window_dict46,5596.088
86.1 MB/s		0.478
1096.8 MB/s		8.88%✅ +44.0%-556.7%-57.9%
Gzip_L941,97511.881
44.1 MB/s		0.747
701.3 MB/s		8.01%✅ +37.9%-236.5%-1.0%
Brotli_Q930,78838.110
13.8 MB/s		0.981
534.0 MB/s		5.87%✅ +15.3%-4.9%✅ +23.1%
11_loghub_mac.log — 524,234 bytes — public-system-log
PIZD_hybrid_thin_L920,02135.485
14.8 MB/s		2.145
244.4 MB/s		3.82%———
Zstd_L927,2739.991
52.5 MB/s		0.424
1235.7 MB/s		5.20%✅ +26.6%-255.2%-405.6%
Zstd_L9_disjoint_window_dict43,2315.026
104.3 MB/s		0.528
993.0 MB/s		8.25%✅ +53.7%-606.0%-306.3%
Gzip_L936,6955.416
96.8 MB/s		0.673
778.6 MB/s		7.00%✅ +45.4%-555.2%-218.6%
Brotli_Q925,47827.272
19.2 MB/s		1.029
509.5 MB/s		4.86%✅ +21.4%-30.1%-108.5%
12_loghub_android.log — 524,276 bytes — public-system-log
PIZD_hybrid_thin_L938,97449.785
10.5 MB/s		1.215
431.6 MB/s		7.43%———
Zstd_L945,69211.174
46.9 MB/s		0.538
973.9 MB/s		8.72%✅ +14.7%-345.6%-125.6%
Zstd_L9_disjoint_window_dict65,2126.791
77.2 MB/s		0.616
850.9 MB/s		12.44%✅ +40.2%-633.1%-97.1%
Gzip_L999,26715.096
34.7 MB/s		1.533
341.9 MB/s		18.93%✅ +60.7%-229.8%✅ +20.8%
Brotli_Q942,92834.390
15.2 MB/s		1.131
463.7 MB/s		8.19%✅ +9.2%-44.8%-7.4%
13_loghub_healthapp.log — 524,254 bytes — public-system-log
PIZD_hybrid_thin_L918,13460.283
8.7 MB/s		3.105
168.8 MB/s		3.46%———
Zstd_L937,09012.545
41.8 MB/s		0.547
957.8 MB/s		7.07%✅ +51.1%-380.5%-467.3%
Zstd_L9_disjoint_window_dict53,3258.215
63.8 MB/s		0.570
919.7 MB/s		10.17%✅ +66.0%-633.8%-444.7%
Gzip_L942,86513.779
38.0 MB/s		0.917
571.9 MB/s		8.18%✅ +57.7%-337.5%-238.7%
Brotli_Q936,40943.958
11.9 MB/s		1.361
385.2 MB/s		6.94%✅ +50.2%-37.1%-128.2%
14_loghub_apache.log — 524,233 bytes — public-system-log
PIZD_hybrid_thin_L923,97349.192
10.7 MB/s		1.480
354.1 MB/s		4.57%———
Zstd_L928,56612.514
41.9 MB/s		0.532
985.4 MB/s		5.45%✅ +16.1%-293.1%-178.3%
Zstd_L9_disjoint_window_dict44,9216.827
76.8 MB/s		0.543
966.0 MB/s		8.57%✅ +46.6%-620.5%-172.8%
Gzip_L934,13110.350
50.6 MB/s		0.894
586.1 MB/s		6.51%✅ +29.8%-375.3%-65.5%
Brotli_Q928,57436.958
14.2 MB/s		1.330
394.0 MB/s		5.45%✅ +16.1%-33.1%-11.3%
15_loghub_openssh.log — 524,222 bytes — public-system-log
PIZD_hybrid_thin_L911,94543.810
12.0 MB/s		3.246
161.5 MB/s		2.28%———
Zstd_L925,78713.290
39.4 MB/s		0.567
924.8 MB/s		4.92%✅ +53.7%-229.6%-472.7%
Zstd_L9_disjoint_window_dict42,0177.778
67.4 MB/s		0.588
891.4 MB/s		8.02%✅ +71.6%-463.3%-452.0%
Gzip_L933,41914.785
35.5 MB/s		0.790
663.9 MB/s		6.37%✅ +64.3%-196.3%-311.2%
Brotli_Q926,83163.873
8.2 MB/s		1.107
473.4 MB/s		5.12%✅ +55.5%✅ +31.4%-193.2%
16_loghub_proxifier.log — 524,224 bytes — public-system-log
PIZD_hybrid_thin_L922,74349.034
10.7 MB/s		2.952
177.6 MB/s		4.34%———
Zstd_L924,92813.179
39.8 MB/s		0.557
941.7 MB/s		4.76%✅ +8.8%-272.1%-430.3%
Zstd_L9_disjoint_window_dict40,8537.270
72.1 MB/s		0.571
917.5 MB/s		7.79%✅ +44.3%-574.5%-416.7%
Gzip_L927,33912.707
41.3 MB/s		0.883
594.0 MB/s		5.22%✅ +16.8%-285.9%-234.5%
Brotli_Q925,01636.496
14.4 MB/s		1.558
336.5 MB/s		4.77%✅ +9.1%-34.4%-89.5%
17_beats_nginx_access.log — 3,177 bytes — public-parser-fixture
PIZD_hybrid_thin_L96162.340
1.4 MB/s		0.011
279.8 MB/s		19.39%———
Zstd_L96212.164
1.5 MB/s		0.146
21.7 MB/s		19.55%✅ +0.8%-8.1%✅ +92.2%
Zstd_L9_disjoint_window_dict16,9830.356
8.9 MB/s		0.151
21.1 MB/s		534.56%✅ +96.4%-558.1%✅ +92.5%
Gzip_L96340.082
38.9 MB/s		0.024
133.3 MB/s		19.96%✅ +2.8%-2766.4%✅ +52.4%
Brotli_Q95876.766
0.5 MB/s		0.039
81.3 MB/s		18.48%-4.9%✅ +65.4%✅ +70.9%
18_beats_nginx_error.log — 1,612 bytes — public-parser-fixture
PIZD_hybrid_thin_L95331.378
1.2 MB/s		0.008
198.4 MB/s		33.06%———
Zstd_L95382.142
0.8 MB/s		0.129
12.5 MB/s		33.37%✅ +0.9%✅ +35.7%✅ +93.7%
Zstd_L9_disjoint_window_dict16,8930.295
5.5 MB/s		0.135
11.9 MB/s		1047.95%✅ +96.8%-366.8%✅ +94.0%
Gzip_L95410.071
22.6 MB/s		0.020
81.0 MB/s		33.56%✅ +1.5%-1830.0%✅ +59.2%
Brotli_Q94706.671
0.2 MB/s		0.034
47.4 MB/s		29.16%-13.4%✅ +79.3%✅ +76.1%
19_beats_postgresql_log.log — 23,312 bytes — public-parser-fixture
PIZD_hybrid_thin_L92,2644.994
4.7 MB/s		0.079
294.2 MB/s		9.71%———
Zstd_L92,4652.539
9.2 MB/s		0.044
535.8 MB/s		10.57%✅ +8.2%-96.7%-82.2%
Zstd_L9_disjoint_window_dict18,8240.704
33.1 MB/s		0.063
367.9 MB/s		80.75%✅ +88.0%-609.6%-25.1%
Gzip_L92,6570.446
52.3 MB/s		0.071
328.4 MB/s		11.40%✅ +14.8%-1019.7%-11.6%
Brotli_Q92,3768.002
2.9 MB/s		0.117
199.2 MB/s		10.19%✅ +4.7%✅ +37.6%✅ +32.3%
20_beats_mysql_slowlog.log — 8,210 bytes — public-parser-fixture
PIZD_hybrid_thin_L92,1993.323
2.5 MB/s		0.056
145.8 MB/s		26.78%———
Zstd_L92,3422.752
3.0 MB/s		0.436
18.8 MB/s		28.53%✅ +6.1%-20.8%✅ +87.1%
Zstd_L9_disjoint_window_dict18,6610.540
15.2 MB/s		0.187
43.9 MB/s		227.30%✅ +88.2%-515.5%✅ +69.9%
Gzip_L92,3400.209
39.3 MB/s		0.052
158.8 MB/s		28.50%✅ +6.0%-1489.5%-8.9%
Brotli_Q92,1517.389
1.1 MB/s		0.096
85.7 MB/s		26.20%-2.2%✅ +55.0%✅ +41.2%
21_beats_mongodb_log.log — 4,502 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,4915.341
0.8 MB/s		0.019
239.0 MB/s		33.12%———
Zstd_L91,4963.186
1.4 MB/s		0.292
15.4 MB/s		33.23%✅ +0.3%-67.7%✅ +93.5%
Zstd_L9_disjoint_window_dict17,7930.517
8.7 MB/s		0.413
10.9 MB/s		395.22%✅ +91.6%-932.2%✅ +95.4%
Gzip_L91,4800.144
31.2 MB/s		0.072
62.5 MB/s		32.87%-0.7%-3597.2%✅ +73.9%
Brotli_Q91,3799.421
0.5 MB/s		0.064
70.1 MB/s		30.63%-8.1%✅ +43.3%✅ +70.7%
22_beats_redis_log.log — 524,271 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,16339.464
13.3 MB/s		1.380
379.9 MB/s		0.22%———
Zstd_L98,79211.597
45.2 MB/s		0.620
845.0 MB/s		1.68%✅ +86.8%-240.3%-122.4%
Zstd_L9_disjoint_window_dict24,9754.511
116.2 MB/s		0.549
955.6 MB/s		4.76%✅ +95.3%-774.8%-151.5%
Gzip_L915,4595.193
101.0 MB/s		0.565
927.2 MB/s		2.95%✅ +92.5%-659.9%-144.1%
Brotli_Q98,07329.406
17.8 MB/s		0.817
641.6 MB/s		1.54%✅ +85.6%-34.2%-68.9%
23_beats_elasticsearch_audit.log — 4,945 bytes — public-parser-fixture
PIZD_hybrid_thin_L91,3084.620
1.1 MB/s		0.016
306.1 MB/s		26.45%———
Zstd_L91,3132.335
2.1 MB/s		0.019
257.7 MB/s		26.55%✅ +0.4%-97.8%✅ +15.8%
Zstd_L9_disjoint_window_dict17,6530.409
12.1 MB/s		0.039
127.9 MB/s		356.99%✅ +92.6%-1028.6%✅ +58.2%
Gzip_L91,3050.141
35.0 MB/s		0.036
136.3 MB/s		26.39%-0.2%-3169.1%✅ +55.5%
Brotli_Q91,2077.391
0.7 MB/s		0.061
81.7 MB/s		24.41%-8.4%✅ +37.5%✅ +73.3%
24_beats_traefik_access.log — 1,665 bytes — public-parser-fixture
PIZD_hybrid_thin_L98961.871
0.9 MB/s		0.011
158.2 MB/s		53.81%———
Zstd_L99012.261
0.7 MB/s		0.137
12.2 MB/s		54.11%✅ +0.6%✅ +17.3%✅ +92.3%
Zstd_L9_disjoint_window_dict17,2560.292
5.7 MB/s		0.159
10.5 MB/s		1036.40%✅ +94.8%-541.6%✅ +93.4%
Gzip_L99050.089
18.8 MB/s		0.024
68.2 MB/s		54.35%✅ +1.0%-2010.3%✅ +56.9%
Brotli_Q98417.297
0.2 MB/s		0.045
37.3 MB/s		50.51%-6.5%✅ +74.4%✅ +76.4%
25_nasa_http_jul95.log — 524,244 bytes — historical-http
PIZD_hybrid_thin_L935,05780.714
6.5 MB/s		1.391
376.8 MB/s		6.69%———
Zstd_L946,31016.587
31.6 MB/s		0.874
599.9 MB/s		8.83%✅ +24.3%-386.6%-59.2%
Zstd_L9_disjoint_window_dict61,82111.034
47.5 MB/s		0.785
667.4 MB/s		11.79%✅ +43.3%-631.5%-77.1%
Gzip_L950,29615.299
34.3 MB/s		1.145
458.0 MB/s		9.59%✅ +30.3%-427.6%-21.6%
Brotli_Q942,96448.301
10.9 MB/s		1.464
358.0 MB/s		8.20%✅ +18.4%-67.1%✅ +5.0%
26_nasa_http_aug95.log — 524,228 bytes — historical-http
PIZD_hybrid_thin_L935,95675.843
6.9 MB/s		1.254
418.2 MB/s		6.86%———
Zstd_L946,81216.472
31.8 MB/s		0.739
709.6 MB/s		8.93%✅ +23.2%-360.4%-69.7%
Zstd_L9_disjoint_window_dict62,52610.846
48.3 MB/s		0.796
658.2 MB/s		11.93%✅ +42.5%-599.2%-57.4%
Gzip_L950,96515.319
34.2 MB/s		1.151
455.6 MB/s		9.72%✅ +29.4%-395.1%-9.0%
Brotli_Q943,11150.593
10.4 MB/s		1.458
359.6 MB/s		8.22%✅ +16.6%-49.9%✅ +14.0%
27_github_events_20150101_00.jsonl — 523,760 bytes — public-json-events
PIZD_hybrid_thin_L968,69321.966
23.8 MB/s		1.492
351.0 MB/s		13.12%———
Zstd_L969,89616.076
32.6 MB/s		0.923
567.6 MB/s		13.35%✅ +1.7%-36.6%-61.7%
Zstd_L9_disjoint_window_dict88,04710.402
50.4 MB/s		0.851
615.1 MB/s		16.81%✅ +22.0%-111.2%-75.2%
Gzip_L982,59221.204
24.7 MB/s		1.660
315.6 MB/s		15.77%✅ +16.8%-3.6%✅ +10.1%
Brotli_Q967,04556.819
9.2 MB/s		2.346
223.2 MB/s		12.80%-2.5%✅ +61.3%✅ +36.4%
28_github_events_20150101_06.jsonl — 523,728 bytes — public-json-events
PIZD_hybrid_thin_L965,12623.598
22.2 MB/s		1.527
342.9 MB/s		12.44%———
Zstd_L966,28115.764
33.2 MB/s		0.717
730.2 MB/s		12.66%✅ +1.7%-49.7%-112.9%
Zstd_L9_disjoint_window_dict85,1549.863
53.1 MB/s		0.834
628.1 MB/s		16.26%✅ +23.5%-139.2%-83.2%
Gzip_L977,52317.689
29.6 MB/s		1.545
338.9 MB/s		14.80%✅ +16.0%-33.4%✅ +1.2%
Brotli_Q963,95658.063
9.0 MB/s		2.040
256.7 MB/s		12.21%-1.8%✅ +59.4%✅ +25.1%
29_github_events_20150101_12.jsonl — 520,527 bytes — public-json-events
PIZD_hybrid_thin_L962,30520.376
25.5 MB/s		1.399
372.1 MB/s		11.97%———
Zstd_L963,05814.720
35.4 MB/s		0.728
714.7 MB/s		12.11%✅ +1.2%-38.4%-92.1%
Zstd_L9_disjoint_window_dict80,8969.096
57.2 MB/s		0.767
679.0 MB/s		15.54%✅ +23.0%-124.0%-82.5%
Gzip_L975,46517.325
30.0 MB/s		1.456
357.4 MB/s		14.50%✅ +17.4%-17.6%✅ +3.9%
Brotli_Q960,74352.666
9.9 MB/s		2.021
257.6 MB/s		11.67%-2.6%✅ +61.3%✅ +30.8%
30_github_events_20150101_18.jsonl — 523,830 bytes — public-json-events
PIZD_hybrid_thin_L965,60622.150
23.6 MB/s		1.360
385.1 MB/s		12.52%———
Zstd_L966,46314.737
35.5 MB/s		0.678
772.9 MB/s		12.69%✅ +1.3%-50.3%-100.7%
Zstd_L9_disjoint_window_dict84,8869.115
57.5 MB/s		0.827
633.3 MB/s		16.20%✅ +22.7%-143.0%-64.4%
Gzip_L980,13416.804
31.2 MB/s		1.486
352.5 MB/s		15.30%✅ +18.1%-31.8%✅ +8.5%
Brotli_Q964,20753.570
9.8 MB/s		2.150
243.7 MB/s		12.26%-2.2%✅ +58.7%✅ +36.7%