This dataset contains a large collection of embeddings from popular models on benchmark datasets. In addition to this, the passage data also includes the local intrinsic dimensionality (LID) for every vector considering its exact nearest 100 neighbours, LID is calculated using a Maximum Likelihood Estimation based approach.
Below is a list of the datasets and the models, every datasets queries and passages are embedded with every model.… See the full description on the dataset page:
https://huggingface.co/datasets/Marqo/benchmark-embeddings.
