Views
No views yet
python ~/code/sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py NousResearch/Nous-Hermes-llama-2-7b open_platypus --recipe ~/code/sparseml/src/sparseml/transformers/sparsification/obcq/llama-hermes-skip5-50p.yaml --eval wikitext2 --save True
2023-10-25 09:52:15 sparseml.modifiers.obcq.utils.helpers INFO Evaluating perplexity...
2023-10-25 09:52:43 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.5703, device='cuda:0')
2023-10-25 09:53:17 sparseml.modifiers.obcq.utils.helpers INFO tensor(8.2167, device='cuda:0')
2023-10-25 09:53:49 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.5748, device='cuda:0')
2023-10-25 09:54:21 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7005, device='cuda:0')
2023-10-25 09:54:53 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.5876, device='cuda:0')
2023-10-25 09:55:25 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.5569, device='cuda:0')
2023-10-25 09:55:56 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7773, device='cuda:0')
2023-10-25 09:56:27 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7879, device='cuda:0')
2023-10-25 09:56:59 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7593, device='cuda:0')
2023-10-25 09:57:31 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.6666, device='cuda:0')
2023-10-25 09:57:55 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7227, device='cuda:0')
2023-10-25 09:57:55 sparseml.modifiers.obcq.utils.helpers INFO Perplexity: 7.722705