You can deploy this model and start earning money today!

abhishekpawar7218/
mistral-7b-lora-adapter

Name: mistral-7b-lora-adapter
Availability: InStock

safetensors

Views

No views yet

Mistral 7B with LoRA Adapter

This is a LoRA adapter for Mistral 7B, fine-tuned for Clinical Trial Study.

Model Details

Base Model: Mistral 7B
Training Method: LoRA fine-tuning
Training Data: Clinical Trial Data

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

# Load the base model
base_model_id = "mistralai/Mistral-7B-v0.1"
tokenizer = AutoTokenizer.from_pretrained(base_model_id)
model = AutoModelForCausalLM.from_pretrained(
    base_model_id, 
    device_map="auto",
    load_in_8bit=True  # Adjust based on your hardware
)

# Load the LoRA adapter
adapter_model_id = "abhishekpawar7218/mistral-7b-lora-adapter"
model = PeftModel.from_pretrained(model, adapter_model_id)

# Generate text
input_text = "Your prompt here"
inputs = tokenizer(input_text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_length=100)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))