The original weights for Mixtral 8x22B.
These weights are unconverted. For converted weights, see
mistral-community/Mixtral-8x22B-v0.1.
(Untested) script to join the files back together (run this where you downloaded the files):
1import os
2from tqdm import tqdm
3print('Opening files...')
4files = os.listdir('.')
5files = [file for file in files if file.startswith('consolidated.safetensors.')]
6files_sorted = sorted(files, key=lambda x: int(x.split('.')[-1]))
7output_file = 'consolidated.safetensors'
8progress_bar = tqdm(total=len(files_sorted), desc='Joining Files')
9with open(os.path.join(directory, output_file), 'wb') as output:
10 for file in files_sorted:
11 with open(os.path.join(directory, file), 'rb') as input_file:
12 output.write(input_file.read())
13 progress_bar.update(1)
14progress_bar.close()
15print('Done!')
It may take a while.
It's in the Transformers repo.
