Views
No views yet
====== Perplexity statistics ======
Mean PPL(Q) : 8.252679 ± 0.055494
Mean PPL(base) : 8.184061 ± 0.055382
Cor(ln(PPL(Q)), ln(PPL(base))): 98.68%
Mean ln(PPL(Q)/PPL(base)) : 0.008349 ± 0.001098
Mean PPL(Q)/PPL(base) : 1.008384 ± 0.001108
Mean PPL(Q)-PPL(base) : 0.068618 ± 0.009021
====== KL divergence statistics ======
Mean KLD: 0.061969 ± 0.000836
Maximum KLD: 25.706320
99.9% KLD: 3.060981
99.0% KLD: 0.504558
95.0% KLD: 0.178821
90.0% KLD: 0.113534
Median KLD: 0.027535
10.0% KLD: 0.001330
5.0% KLD: 0.000385
1.0% KLD: 0.000052
0.1% KLD: 0.000007
Minimum KLD: -0.000136
====== Token probability statistics ======
Mean Δp: -0.496 ± 0.017 %
Maximum Δp: 99.953%
99.9% Δp: 49.024%
99.0% Δp: 16.581%
95.0% Δp: 7.308%
90.0% Δp: 4.173%
75.0% Δp: 0.814%
Median Δp: -0.013%
25.0% Δp: -1.507%
10.0% Δp: -5.672%
5.0% Δp: -9.537%
1.0% Δp: -21.667%
0.1% Δp: -51.141%
Minimum Δp: -99.820%
RMS Δp : 6.656 ± 0.056 %
Same top p: 89.216 ± 0.081 %
Top flip weight: 0.009668
Top prob RMSE : 0.080021
Entropy RMSE : 0.272950====== Perplexity statistics ======
Mean PPL(Q) : 8.511450 ± 0.057807
Mean PPL(base) : 8.184061 ± 0.055382
Cor(ln(PPL(Q)), ln(PPL(base))): 98.30%
Mean ln(PPL(Q)/PPL(base)) : 0.039224 ± 0.001251
Mean PPL(Q)/PPL(base) : 1.040003 ± 0.001301
Mean PPL(Q)-PPL(base) : 0.327389 ± 0.010714
====== KL divergence statistics ======
Mean KLD: 0.082267 ± 0.000935
Maximum KLD: 26.195276
99.9% KLD: 3.699525
99.0% KLD: 0.655555
95.0% KLD: 0.239608
90.0% KLD: 0.155213
Median KLD: 0.038994
10.0% KLD: 0.001889
5.0% KLD: 0.000544
1.0% KLD: 0.000079
0.1% KLD: 0.000011
Minimum KLD: -0.000016
====== Token probability statistics ======
Mean Δp: -0.911 ± 0.020 %
Maximum Δp: 99.991%
99.9% Δp: 50.329%
99.0% Δp: 17.867%
95.0% Δp: 8.117%
90.0% Δp: 4.473%
75.0% Δp: 0.746%
Median Δp: -0.044%
25.0% Δp: -2.061%
10.0% Δp: -7.160%
5.0% Δp: -11.774%
1.0% Δp: -27.189%
0.1% Δp: -62.353%
Minimum Δp: -99.881%
RMS Δp : 7.690 ± 0.057 %
Same top p: 87.429 ± 0.086 %====== Perplexity statistics ======
Mean PPL(Q) : 8.676226 ± 0.059423
Mean PPL(base) : 8.184061 ± 0.055382
Cor(ln(PPL(Q)), ln(PPL(base))): 98.30%
Mean ln(PPL(Q)/PPL(base)) : 0.058398 ± 0.001259
Mean PPL(Q)/PPL(base) : 1.060137 ± 0.001334
Mean PPL(Q)-PPL(base) : 0.492165 ± 0.011330
====== KL divergence statistics ======
Mean KLD: 0.085222 ± 0.000895
Maximum KLD: 27.925140
99.9% KLD: 3.518223
99.0% KLD: 0.672682
95.0% KLD: 0.250890
90.0% KLD: 0.164238
Median KLD: 0.042011
10.0% KLD: 0.001942
5.0% KLD: 0.000554
1.0% KLD: 0.000077
0.1% KLD: 0.000011
Minimum KLD: -0.000043
====== Token probability statistics ======
Mean Δp: -0.996 ± 0.020 %
Maximum Δp: 99.998%
99.9% Δp: 48.766%
99.0% Δp: 18.332%
95.0% Δp: 8.174%
90.0% Δp: 4.538%
75.0% Δp: 0.727%
Median Δp: -0.053%
25.0% Δp: -2.165%
10.0% Δp: -7.505%
5.0% Δp: -12.305%
1.0% Δp: -27.862%
0.1% Δp: -63.063%
Minimum Δp: -99.966%
RMS Δp : 7.856 ± 0.056 %
Same top p: 87.312 ± 0.087 %