You can deploy this model and start earning money today!

ataberkd/
llama-2-13b-SQL_FINETUNED_1K

Name: llama-2-13b-SQL_FINETUNED_1K
Availability: InStock

kaxap/llama2-sql-instruct-sys-prompt

apache-2.0

autotrain_compatible

text-generation-inference

endpoints_compatible

Views

No views yet

💻 Usage

python

!pip install -q accelerate==0.21.0 transformers==4.31.0

import os
import torch
from transformers import (
    AutoModelForCausalLM,
    AutoTokenizer,
    pipeline,
    logging,
)

model = "ataberkd/llama-2-13b-SQL_FINETUNED_1K"
prompt = 'You are an expert in SQL and data analysis. Given the table structure described by the CREATE TABLE statement, write an SQL query that provides the solution to the question and give the explanation of result your giving. CREATE TABLE statement: CREATE TABLE "user" ( "name" text, "surname" text, "tel" text, "address" text, "performanceScore" text,"Age" text, "Language" text );. Question: "Can you bring users who speak French and are greater than 20 years old?"'

tokenizer = AutoTokenizer.from_pretrained(model)
pipeline = pipeline(
    "text-generation",
    model=model,
    torch_dtype=torch.float16,
    device_map="auto",
)

sequences = pipeline(
    f'<s>[INST] {prompt} [/INST]',
    do_sample=True,
    top_k=10,
    num_return_sequences=1,
    eos_token_id=tokenizer.eos_token_id,
    max_length=200,
)
for seq in sequences:
    print(f"Result: {seq['generated_text']}")