Syon-Li/

LoCoMoSeg

The segmented version of the LoCoMo dataset, with the usage of the segmenter proposed in the paper Towards Generalization of Block Attention via Automatic Segmentation and Block Distillation.

	Dataset Details




	


	Dataset Description

The newly introduced columns are:

chunks: The segmented chunks. cut_prob: The segmentation probabilities for each candidate cut point. parallel_degree: The number of chunks.

If you find this… See the full description on the dataset page: https://huggingface.co/datasets/Syon-Li/LoCoMoSeg.