Views
No views yet
| Name | Quant method | Size |
|---|---|---|
| Llama-3-8B-RAG-v1.Q2_K.gguf | Q2_K | 2.96GB |
| Llama-3-8B-RAG-v1.IQ3_XS.gguf | IQ3_XS | 3.28GB |
| Llama-3-8B-RAG-v1.IQ3_S.gguf | IQ3_S | 3.43GB |
| Llama-3-8B-RAG-v1.Q3_K_S.gguf | Q3_K_S | 3.41GB |
| Llama-3-8B-RAG-v1.IQ3_M.gguf | IQ3_M | 3.52GB |
| Llama-3-8B-RAG-v1.Q3_K.gguf | Q3_K | 3.74GB |
| Llama-3-8B-RAG-v1.Q3_K_M.gguf | Q3_K_M | 3.74GB |
| Llama-3-8B-RAG-v1.Q3_K_L.gguf | Q3_K_L | 4.03GB |
| Llama-3-8B-RAG-v1.IQ4_XS.gguf | IQ4_XS | 4.18GB |
| Llama-3-8B-RAG-v1.Q4_0.gguf | Q4_0 | 4.34GB |
| Llama-3-8B-RAG-v1.IQ4_NL.gguf | IQ4_NL | 4.38GB |
| Llama-3-8B-RAG-v1.Q4_K_S.gguf | Q4_K_S | 4.37GB |
| Llama-3-8B-RAG-v1.Q4_K.gguf | Q4_K | 4.58GB |
| Llama-3-8B-RAG-v1.Q4_K_M.gguf | Q4_K_M | 4.58GB |
| Llama-3-8B-RAG-v1.Q4_1.gguf | Q4_1 | 4.78GB |
| Llama-3-8B-RAG-v1.Q5_0.gguf | Q5_0 | 5.21GB |
| Llama-3-8B-RAG-v1.Q5_K_S.gguf | Q5_K_S | 5.21GB |
| Llama-3-8B-RAG-v1.Q5_K.gguf | Q5_K | 5.34GB |
| Llama-3-8B-RAG-v1.Q5_K_M.gguf | Q5_K_M | 5.34GB |
| Llama-3-8B-RAG-v1.Q5_1.gguf | Q5_1 | 5.65GB |
| Llama-3-8B-RAG-v1.Q6_K.gguf | Q6_K | 6.14GB |
| Llama-3-8B-RAG-v1.Q8_0.gguf | Q8_0 | 7.95GB |
1from transformers import AutoTokenizer, pipeline
2
3model_name = "glaiveai/Llama-3-8B-RAG-v1"
4tokenizer = AutoTokenizer.from_pretrained(model_name)
5
6# Example user query
7user_query = """Document:0
8
9Title: Financial Compliance and Company Statements
10
11Text: This document provides a detailed overview of the financial compliance measures and statements issued by corporations. It discusses various aspects of financial reporting, the importance of accurate financial disclosures, and the role of chief executive officers in certifying financial documents. The document elaborates on the legal frameworks that govern corporate financial disclosures, including the Securities Exchange Act of 1934, which mandates that public companies must provide periodic reports detailing their financial status. These reports are crucial for investors, regulators, and other stakeholders who rely on them to make informed decisions. The document also highlights the penalties for non-compliance with financial reporting requirements, which can include fines and criminal charges for executives who misreport financial information.
12
13Document:1
14
15Title: Certification of Financial Reports by CEO of Black Knight, Inc.
16
17Text: Pursuant to 18 U.S.C. §1350, the Chief Executive Officer of Black Knight, Inc., a corporation registered in Delaware, has officially certified the periodic financial report containing the company's financial statements. The certification confirms that these reports comply fully with the requirements of Section 13(a) or 15(d) of the Securities Exchange Act of 1934. The CEO, Anthony M. Jabbour, asserts that the information contained within these reports fairly presents, in all material respects, the financial condition and results of operations of Black Knight, Inc. The certification is part of the official documents filed with the Securities and Exchange Commission and serves as a testament to the accuracy and fairness of the financial disclosures made by the company. This certification is crucial as it assures stakeholders of the reliability of the financial statements provided by Black Knight, Inc.
18
19Answer Mode: Grounded
20
21Question: How does the CEO of Black Knight, Inc. ensure compliance with the Securities Exchange Act of 1934, and what are the implications of the certification provided?"""
22
23# Prepare chat template
24chat = [
25 {"role": "system", "content": "You are a conversational AI assistant that is provided a list of documents and a user query to answer based on information from the documents. The user also provides an answer mode which can be 'Grounded' or 'Mixed'. For answer mode Grounded only respond with exact facts from documents, for answer mode Mixed answer using facts from documents and your own knowledge. Cite all facts from the documents using <co: doc_id></co> tags."},
26 {"role": "user", "content": user_query}
27]
28
29prompt = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
30
31# Set up pipeline and generate response
32pipe = pipeline('text-generation', model=model_name, tokenizer=model_name, device=0)
33output = pipe(
34 prompt,
35 max_length=1000,
36 num_return_sequences=1,
37 top_k=50,
38 top_p=0.95,
39 temperature=0.5,
40 do_sample=True,
41 return_full_text=False
42)
43
44print(output[0]['generated_text'])Cited Documents: 1
Answer: <co:1>The CEO of Black Knight, Inc., Anthony M. Jabbour, ensures compliance with the Securities Exchange Act of 1934 by certifying that the periodic financial report and financial statements comply fully with the requirements of Section 13(a) or 15(d) of the Act. This certification confirms that the information in the reports fairly presents, in all material respects, the financial condition and results of operations of Black Knight, Inc.</co> This certification is crucial as it assures stakeholders of the reliability of the financial statements provided by the company, thereby maintaining investor confidence and adherence to legal financial reporting standards.
In this output:
The model cites Document 1 as the source of its information.
It provides a grounded answer based on the content of Document 1, as requested in the "Answer Mode: Grounded" instruction.
The answer explains how the CEO ensures compliance and the implications of the certification.
The citation is marked with <co:1></co> tags, indicating that this information comes directly from Document 1.