You can deploy this model and start earning money today!

RichardErkhov/
Trendyol_-_Trendyol-LLM-7b-base-v1.0-gguf

Name: Trendyol_-_Trendyol-LLM-7b-base-v1.0-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Trendyol-LLM-7b-base-v1.0 - GGUF

Model creator: https://huggingface.co/Trendyol/
Original model: https://huggingface.co/Trendyol/Trendyol-LLM-7b-base-v1.0/

Name	Quant method	Size
Trendyol-LLM-7b-base-v1.0.Q2_K.gguf	Q2_K	2.59GB
Trendyol-LLM-7b-base-v1.0.IQ3_XS.gguf	IQ3_XS	2.87GB
Trendyol-LLM-7b-base-v1.0.IQ3_S.gguf	IQ3_S	3.02GB
Trendyol-LLM-7b-base-v1.0.Q3_K_S.gguf	Q3_K_S	3.01GB
Trendyol-LLM-7b-base-v1.0.IQ3_M.gguf	IQ3_M	3.12GB
Trendyol-LLM-7b-base-v1.0.Q3_K.gguf	Q3_K	3.34GB
Trendyol-LLM-7b-base-v1.0.Q3_K_M.gguf	Q3_K_M	3.34GB
Trendyol-LLM-7b-base-v1.0.Q3_K_L.gguf	Q3_K_L	3.62GB
Trendyol-LLM-7b-base-v1.0.IQ4_XS.gguf	IQ4_XS	3.74GB
Trendyol-LLM-7b-base-v1.0.Q4_0.gguf	Q4_0	3.89GB
Trendyol-LLM-7b-base-v1.0.IQ4_NL.gguf	IQ4_NL	3.93GB
Trendyol-LLM-7b-base-v1.0.Q4_K_S.gguf	Q4_K_S	3.92GB
Trendyol-LLM-7b-base-v1.0.Q4_K.gguf	Q4_K	4.13GB
Trendyol-LLM-7b-base-v1.0.Q4_K_M.gguf	Q4_K_M	4.13GB
Trendyol-LLM-7b-base-v1.0.Q4_1.gguf	Q4_1	4.31GB
Trendyol-LLM-7b-base-v1.0.Q5_0.gguf	Q5_0	4.73GB
Trendyol-LLM-7b-base-v1.0.Q5_K_S.gguf	Q5_K_S	4.73GB
Trendyol-LLM-7b-base-v1.0.Q5_K.gguf	Q5_K	4.85GB
Trendyol-LLM-7b-base-v1.0.Q5_K_M.gguf	Q5_K_M	4.85GB
Trendyol-LLM-7b-base-v1.0.Q5_1.gguf	Q5_1	5.14GB
Trendyol-LLM-7b-base-v1.0.Q6_K.gguf	Q6_K	5.61GB
Trendyol-LLM-7b-base-v1.0.Q8_0.gguf	Q8_0	7.27GB

Original model description:

language:

tr
en pipeline_tag: text-generation license: apache-2.0 base_model: mistralai/Mistral-7B-v0.1

Trendyol LLM v1.0

Trendyol LLM v1.0 is a generative model that is based on Mistral 7B model. This is the repository for the base model.

Model Details

Model Developers Trendyol

Variations base, chat, and dpo variations.

Input Models input text only.

Output Models generate text only.

Model Architecture Trendyol LLM v1.0 is an auto-regressive language model (based on Mistral 7b) that uses an optimized transformer architecture. The base version is fine-tuned on 10 billion tokens with the following trainables by using LoRA:

lr=2e-4
lora_rank=64
lora_alpha=128
lora_trainable=q_proj,v_proj,k_proj,o_proj,gate_proj,down_proj,up_proj
modules_to_save=embed_tokens,lm_head
lora_dropout=0.05
bf16=True
max_seq_length=1024
drawing

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
model_id = "Trendyol/Trendyol-LLM-7b-base-v1.0"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, 
                                             device_map='auto', 
                                             load_in_8bit=True)
sampling_params = dict(do_sample=True, temperature=0.3, top_k=50, top_p=0.9)
pipe = pipeline("text-generation", 
                model=model, 
                tokenizer=tokenizer,
                device_map="auto",
                max_new_tokens=1024, 
                return_full_text=True,
                repetition_penalty=1.1
               )
def generate_output(user_query):
    outputs = pipe(user_query,
               **sampling_params
              )
    return outputs[0]["generated_text"]
user_query = "Ders çalışmanın en iyi 5 yolu:"
response = generate_output(user_query)

Limitations, Risks, Bias, and Ethical Considerations

Limitations and Known Biases

Primary Function and Application: Trendyol LLM, an autoregressive language model, is primarily designed to predict the next token in a text string. While often used for various applications, it is important to note that it has not undergone extensive real-world application testing. Its effectiveness and reliability across diverse scenarios remain largely unverified.
Language Comprehension and Generation: The model is primarily trained in standard English and Turkish. Its performance in understanding and generating slang, informal language, or other languages may be limited, leading to potential errors or misinterpretations.
Generation of False Information: Users should be aware that Trendyol LLM may produce inaccurate or misleading information. Outputs should be considered as starting points or suggestions rather than definitive answers.

Risks and Ethical Considerations

Potential for Harmful Use: There is a risk that Trendyol LLM could be used to generate offensive or harmful language. We strongly discourage its use for any such purposes and emphasize the need for application-specific safety and fairness evaluations before deployment.
Unintended Content and Bias: The model was trained on a large corpus of text data, which was not explicitly checked for offensive content or existing biases. Consequently, it may inadvertently produce content that reflects these biases or inaccuracies.
Toxicity: Despite efforts to select appropriate training data, the model is capable of generating harmful content, especially when prompted explicitly. We encourage the open-source community to engage in developing strategies to minimize such risks.

Recommendations for Safe and Ethical Usage

Human Oversight: We recommend incorporating a human curation layer or using filters to manage and improve the quality of outputs, especially in public-facing applications. This approach can help mitigate the risk of generating objectionable content unexpectedly.
Application-Specific Testing: Developers intending to use Trendyol LLM should conduct thorough safety testing and optimization tailored to their specific applications. This is crucial, as the model’s responses can be unpredictable and may occasionally be biased, inaccurate, or offensive.
Responsible Development and Deployment: It is the responsibility of developers and users of Trendyol LLM to ensure its ethical and safe application. We urge users to be mindful of the model's limitations and to employ appropriate safeguards to prevent misuse or harmful consequences.

RichardErkhov/Trendyol_-_Trendyol-LLM-7b-base-v1.0-gguf