Views
No views yet

1#Fixed
2def lerp(a, b, t):
3 return a * (1 - t) + b * t
4
5def nearswap(v0, v1, t):
6 lweight = np.abs(v0 - v1)
7 with np.errstate(divide='ignore', invalid='ignore'):
8 lweight = np.where(lweight != 0, t / lweight, 1.0)
9 lweight = np.nan_to_num(lweight, nan=1.0, posinf=1.0, neginf=1.0)
10 np.clip(lweight, a_min=0.0, a_max=1.0, out=lweight)
11 return lerp(v0, v1, lweight)I found success with:
temperature 0.9-1.2
min_p 0.08
tfs 0.97
smoothing_factor 0.3
smoothing_curve 1.1
Nymeria preset (more coherent):
temp 0.9
top_k 30
top_p 0.75
min_p 0.2
rep_pen 1.1
smooth_factor 0.25
smooth_curve 1
1<|begin_of_text|><|start_header_id|>system<|end_header_id|>
2
3{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
4
5{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
6
7{output}<|eot_id|>
8