Views
No views yet
This is a quantized version of the original model, found at "msaad02/llama2_7b_brockportgpt"
Are SAT scores required?SAT scores are not required for admission, but test scores are used as part of Brockport's holistic review process to make admissions decisions.
Who can I contact for help with financial aid?You can contact the financial aid office at SUNY Brockport for assistance with financial aid. They are available to answer any questions and help you navigate the financial aid process.
Below is an inquiry related to SUNY Brockport - from academics, admissions, and faculty support to student life. Prioritize accuracy and brevity.### Instruction:
{question}### Response:
{response}
pip install ctransformers[gptq] for exllama support. Originally this library only had support for GGML models using llama.cpp as a backend. However, they updated it not long ago at all to have support for exllama, which is an incredibly fast loader for gptq models. ctransformers is the interface to use exllama, which is the current SoTA loader.1from ctransformers import AutoModelForCausalLM
2import textwrap
3
4llm = AutoModelForCausalLM.from_pretrained("msaad02/llama2_brockportgpt_gptq", model_type="gptq")
5
6def qa(text: str, full = False):
7 # textwrap.dedent gets rid of indenting at the start of each newline
8 text = textwrap.dedent(f"""\
9 Below is an inquiry related to SUNY Brockport - from academics, admissions, and faculty support to student life. Prioritize accuracy and brevity.
10
11 ### Instruction:
12 {text}
13
14 ### Response:
15 """)
16
17 response = llm(text, max_new_tokens=256)
18 response = (text + response) if full else response
19
20 return response
21
22qa("How do I apply?")
23> You can apply to SUNY Brockport by following the application process outlined on their website.
24
25qa("How do I apply?", full=True)
26> Below is an inquiry related to SUNY Brockport - from academics, admissions, and faculty support to student life. Prioritize accuracy and brevity.
27>
28> ### Instruction:
29> How do I apply?
30>
31> ### Response:
32> You can apply online via the Common Application or Brockport's own Apply Now!