You can deploy this model and start earning money today!

marlonsousa/
luna-4k-mini-ollama

Name: luna-4k-mini-ollama
Availability: InStock

Views

No views yet

Luna Model

This document describes the use and functionalities of the personal model named Luna, which was trained based on the Phi-3 model. This model was developed for specific tasks as detailed below.

Introduction
Requirements
Installation
Usage
Features
Contribution
License

Introduction

The Luna Model is a customized version of the Phi-3 model tailored for specific tasks such as text generation. This model leverages the capabilities of the Phi-3 architecture to provide efficient and accurate results for various natural language processing tasks.

Requirements

Ollama

Installation

Install Ollama

curl -fsSL https://ollama.com/install.sh | sh

Usage

Create Modelfile

touch Modelfile

Modelfile content

FROM ./models/luna-4b-v0.5.gguf

PARAMETER temperature 1
"""

Load the model

ollama create luna -f ./Modelfile

Run Model

ollama run luna

Usage Python

python

import ollama

stream = ollama.chat(
    model='llama3',
    messages=[{'role': 'user', 'content': 'Who are you?'}],
    stream=True,
)

for chunk in stream:
  print(chunk['message']['content'], end='', flush=True)

marlonsousa/luna-4k-mini-ollama