CALAME-PT
Context-Aware LAnguage Modeling Evaluation for Portuguese
CALAME-PT is a PT benchmark composed of small texts (contexts) and their respective last words.
These contexts should, in theory, contain enough information so that a human or a model is capable of guessing its last word - without being too specific and/or too ambiguous.
Composition
CALAME-PT is composed of 2 "sets" of data - handwritten and generated.