Views
No views yet
<|user|> corresponds to the human's role and <|assistant|> corresponds to the LLM's role.
The human should speak first:<|user|>
Hi! I'm looking for a cake recipe.
<|assistant|>
What kind of cake?
<|user|>
Chocolate cake.
<|assistant|><|good|> and <|bad|> included in the embeddings.
To generate with these control tokens in the context, postpend either to the prompt.@techreport{ethayarajh2023halos,
author = {Ethayarajh, Kawin and Xu, Winnie, and Jurafsky, Dan and Kiela, Douwe},
title = {Human-Centered Loss Functions (HALOs)},
institution = {Contextual AI},
note = {https://github.com/ContextualAI/HALOs/blob/main/assets/report.pdf},
year = {2023},
}