Views
No views yet
.safetensors shard files (e.g. model-00001-of-00004.safetensors)model.safetensors.index.json (index for shards)tokenizer.json, tokenizer_config.json, special_tokens_map.jsonconfig.json and generation_config.jsonpip install huggingface-hub1python scripts/push_to_hf.py --repo-id YOUR_USERNAME/YOUR_MODEL_NAME
2# or with env token:
3HF_TOKEN=xxx python scripts/push_to_hf.py --repo-id YOUR_USERNAME/YOUR_MODEL_NAME --private1from vllm import Model
2model = Model.from_pretrained("YOUR_USERNAME/YOUR_MODEL_NAME")
3# then use vLLM APIs to run inference1from transformers import AutoTokenizer, AutoModelForCausalLM
2tokenizer = AutoTokenizer.from_pretrained("YOUR_USERNAME/YOUR_MODEL_NAME")
3model = AutoModelForCausalLM.from_pretrained("YOUR_USERNAME/YOUR_MODEL_NAME", trust_remote_code=True).safetensors shards, ensure you have sufficient bandwidth and storage.HF_TOKEN or --token.git lfs (instead of API uploads), say so and I can add an alternative script.