Views
No views yet
1model = AutoModelForSequenceClassification.from_pretrained( 2 'T3LS/stella-mrl-large-zh-v3.5-1792d-1024-gptq-4bit', 3 device_map='cuda' # Exllamav2 backend requires all the modules to be on GPU 4)