Is this your dataset? Claim it with the Hugging Face account that owns it.

enguyen/
smollm-chunked

Name: smollm-chunked
Creator: enguyen
License: https://spdx.org/licenses/ODC-By-1.0.html

Views

No views yet

FAISS Indices and Chunked Datasets for SmolLM and SmolLM2 corpora

This repository contains part of the FAISS indices and chunked datasets used for novelty detection for SmolLM and SmolLM2, as presented in the paper LLM generation novelty through the lens of semantic similarity.

Full Documentation

For complete usage instructions, installation guide, and tutorial, please refer to: Main Tutorial README

Data Distribution

Due to Hugging Face storage quota… See the full description on the dataset page: https://huggingface.co/datasets/enguyen/smollm-chunked.