Views
No views yet
====== Perplexity statistics ======
Mean PPL(Q) : 9.998305 ± 0.071790
Mean PPL(base) : 9.943929 ± 0.071459
Cor(ln(PPL(Q)), ln(PPL(base))): 99.73%
Mean ln(PPL(Q)/PPL(base)) : 0.005453 ± 0.000528
Mean PPL(Q)/PPL(base) : 1.005468 ± 0.000531
Mean PPL(Q)-PPL(base) : 0.054377 ± 0.005275
====== KL divergence statistics ======
Mean KLD: 0.015374 ± 0.000300
Maximum KLD: 19.809378
99.9% KLD: 0.629969
99.0% KLD: 0.094831
95.0% KLD: 0.037901
90.0% KLD: 0.026535
Median KLD: 0.008529
10.0% KLD: 0.000474
5.0% KLD: 0.000135
1.0% KLD: 0.000017
0.1% KLD: 0.000001
Minimum KLD: -0.000077
====== Token probability statistics ======
Mean Δp: -0.174 ± 0.009 %
Maximum Δp: 94.303%
99.9% Δp: 20.150%
99.0% Δp: 8.865%
95.0% Δp: 4.176%
90.0% Δp: 2.423%
75.0% Δp: 0.462%
Median Δp: -0.003%
25.0% Δp: -0.753%
10.0% Δp: -3.020%
5.0% Δp: -4.931%
1.0% Δp: -9.745%
0.1% Δp: -24.106%
Minimum Δp: -99.902%
RMS Δp : 3.437 ± 0.044 %
Same top p: 93.487 ± 0.064 %