Views
No views yet
Part of the Echo Omega Prime AI engine collection — domain-specialized LoRA adapters built on Qwen2.5-7B-Instruct.
| Parameter | Value |
|---|---|
| Base Model | Qwen/Qwen2.5-7B-Instruct |
| Method | QLoRA (4-bit NF4 quantization + LoRA) |
| LoRA Rank (r) | 16 |
| LoRA Alpha | 32 |
| Target Modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| Training Data | Curated landman case studies covering deed analysis, lease interpretation, and title opinion drafting |
| Epochs | 3 |
| Loss | converged |
| Adapter Size | ~38 MB |
| Framework | PEFT + Transformers + bitsandbytes |
| Precision | bf16 (adapter) / 4-bit NF4 (base during training) |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2from peft import PeftModel
3import torch
4
5# Load base model
6base_model = AutoModelForCausalLM.from_pretrained(
7 "Qwen/Qwen2.5-7B-Instruct",
8 torch_dtype=torch.bfloat16,
9 device_map="auto",
10)
11tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-7B-Instruct")
12
13# Load LoRA adapter
14model = PeftModel.from_pretrained(base_model, "Bmcbob76/echo-landman-adapter")
15
16# Generate
17messages = [
18 {"role": "system", "content": "You are a domain expert in Oil & Gas Landman Operations."},
19 {"role": "user", "content": "Analyze this mineral deed and identify all reservations, exceptions, and potential title defects in the conveyance chain."},
20]
21text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
22inputs = tokenizer(text, return_tensors="pt").to(model.device)
23
24with torch.no_grad():
25 outputs = model.generate(**inputs, max_new_tokens=1024, temperature=0.3)
26
27print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))1python -m vllm.entrypoints.openai.api_server \
2 --model Qwen/Qwen2.5-7B-Instruct \
3 --enable-lora \
4 --lora-modules 'echo-landman-adapter=Bmcbob76/echo-landman-adapter'1from openai import OpenAI
2
3client = OpenAI(base_url="http://localhost:8000/v1", api_key="token")
4response = client.chat.completions.create(
5 model="echo-landman-adapter",
6 messages=[
7 {"role": "system", "content": "You are a domain expert in Oil & Gas Landman Operations."},
8 {"role": "user", "content": "Analyze this mineral deed and identify all reservations, exceptions, and potential title defects in the conveyance chain."},
9 ],
10 temperature=0.3,
11 max_tokens=1024,
12)
13print(response.choices[0].message.content)| Adapter | Domain |
|---|---|
| echo-titlehound-lora | Oil & Gas Title Examination |
| echo-doctrine-generator-qlora | AI Doctrine Generation |
| echo-landman-adapter | Landman Operations |
| echo-taxlaw-adapter | Tax Law & IRC |
| echo-legal-adapter | Legal Analysis |
| echo-realestate-adapter | Real Estate Law |
| echo-cyber-adapter | Cybersecurity |
| echo-engineering-adapter | Engineering Analysis |
| echo-medical-adapter | Medical & Clinical |
| echo-software-adapter | Software & DevOps |