Views
No views yet
1from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
2
3repo_id = "Ispatialtechnosolutions/BraeinAi-Geospatial"
4
5tok = AutoTokenizer.from_pretrained(repo_id)
6model = AutoModelForCausalLM.from_pretrained(repo_id)
7
8pipe = pipeline("text-generation", model=model, tokenizer=tok)
9
10print(pipe("How do I publish a WMS in GeoServer?", max_new_tokens=200)[0]["generated_text"])
11
12
13## Training Details
14
15### Training Data
16
17This model was fine-tuned on a curated GIS domain dataset including:
18
19Spatial standards (OGC WMS/WFS/WMTS/WCS docs)
20
21GIS tutorials & training manuals
22
23QGIS/ArcGIS user documentation
24
25Geospatial developer blogs
26
27### Training Procedure
28
29Base Model: LLaMA-2
30
31Method: LoRA fine-tuning
32
33Precision: bf16 mixed precision
34
35Batch size per device: 1–2
36
37Gradient accumulation steps: 8–16
38
39Effective batch size: 4
40
41Epochs: 2
42LR = 2e-4
43
44
45
46## Evaluation
47
48Metrics
49
50Perplexity: Lower than base LLaMA-2 on GIS test set
51
52Qualitative evaluation: Produces domain-specific and contextually relevant answers
53
54Example Query & Response
55
56Input: "What is the difference between WMS and WFS?"
57Output: "WMS (Web Map Service) delivers rendered images of maps, while WFS (Web Feature Service) delivers vector features in formats like GML/GeoJSON for analysis."
58
59## Environmental Impact
60
61Training hardware: A100 128GB RAM GPUs
6224gb Graphic Card
63
64
65## Technical Specifications [optional]
66
67### Model Architecture and Objective
68
69Architecture: LLaMA-2 (Causal Decoder-only Transformer)
70
71Parameter count: Same as LLaMA-2 base used
72
73Library: Transformers
74
75## Citation [optional]
76
77@misc{llama2gis2024,
78 title = {BraeinAi-Geospatial: A Domain-Specialized GIS Language Model},
79 author = {Ispatialtechnosolutions},
80 year = {2024},
81 publisher = {Hugging Face},
82 howpublished = {\url{https://huggingface.co/Ispatialtechnosolutions/BraeinAi-Geospatial}},
83}
84
85
86## Model Card Contact
87Maintainer: Ispatialtechnosolutions
88Email: connectus@ispatialtec.com