Views
No views yet
1from vllm import LLM
2
3llm = LLM(model="alfazick/llama-3.1-8b-function-calling")1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("alfazick/llama-3.1-8b-function-calling")
4tokenizer = AutoTokenizer.from_pretrained("alfazick/llama-3.1-8b-function-calling")<|begin_of_text|><|start_header_id|>system<|end_header_id|>
You are a helpful assistant with access to the following tools or function calls. Your task is to produce a sequence of tools or function calls necessary to generate response to the user utterance. Use the following tools or function calls as required:
[{"name": "func_name", "description": "...", "parameters": {...}}]<|eot_id|><|start_header_id|>user<|end_header_id|>
{query}<|eot_id|><|start_header_id|>assistant<|end_header_id|>[{"name": "function_name", "arguments": {"arg": "value"}}]