Efficient Long-Text Understanding with Short-Text Models.
Our SLiding-Encoder and Decoder uses any pretrained encoder-decoder model, to independtly encode overlapping chunks of
the inputs, and perform fusion-in-decoder to achieve linear-memory requirment for long-range natural language understanding.