Laika-1-3B is a 3 billion parameter language model specialized for space science, astronomy, satellite operations, and aerospace engineering. Named after Laika, the first animal to orbit Earth, this model is designed to assist with space-related tasks and knowledge.

Model Details

Parameter	Value
Architecture	LlamaForCausalLM
Parameters	3B
Hidden Size	3072
Intermediate Size	8192
Attention Heads	24
Hidden Layers	28
Vocab Size	32,000
Context Length	4,096
Precision	bfloat16

Intended Use

Laika-1-3B is designed for:

Space Science Q&A - Answering questions about astronomy, astrophysics, cosmology, and planetary science
Satellite Operations - Assisting with satellite communication, orbit mechanics, and mission planning
Aerospace Engineering - Supporting aerospace design concepts and technical discussions
Space Education - Explaining space-related concepts for educational purposes
Research Assistance - Helping with space science research and literature review

How to Use

Using Transformers

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "albertic-ai/Laika-1-3B"

tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype="auto", device_map="auto")

messages = [
    {"role": "system", "content": "You are Laika, an AI assistant specialized in space science, astronomy, satellite operations, and aerospace engineering."},
    {"role": "user", "content": "Explain the concept of Lagrange points and their significance for space missions."}
]

input_ids = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)

outputs = model.generate(
    input_ids,
    max_new_tokens=512,
    temperature=0.7,
    top_p=0.9,
    do_sample=True,
)

response = tokenizer.decode(outputs[0][input_ids.shape[-1]:], skip_special_tokens=True)
print(response)

Using Pipeline

python

from transformers import pipeline

pipe = pipeline(
    "text-generation",
    model="albertic-ai/Laika-1-3B",
    torch_dtype="auto",
    device_map="auto",
)

messages = [
    {"role": "user", "content": "What are the main challenges of interplanetary travel?"}
]

output = pipe(messages, max_new_tokens=512)
print(output[0]["generated_text"][-1]["content"])

Chat Template

Laika-1-3B uses the following chat format:

<s>### System:
You are Laika, an AI assistant specialized in space science, astronomy, satellite operations, and aerospace engineering.

### User:
{user_message}

### Assistant:
{assistant_response}</s>

Training

Laika-1-3B was trained on a curated dataset of space science literature, including:

Astronomical research papers and publications
Satellite operations documentation
Aerospace engineering textbooks and materials
Space mission reports and technical documents
Educational astronomy content

Limitations

The model may generate plausible-sounding but incorrect information about specific space missions or technical details
It should not be used as a sole source for mission-critical decisions
Knowledge is limited to training data cutoff
May struggle with highly specialized or niche topics outside its training distribution
Not suitable for real-time satellite operations without human oversight

License

This model is released under the Apache 2.0 License.

Citation

bibtex

@misc{laika-1-3b,
  title={Laika-1-3B: A Language Model for Space Science},
  author={Albertic AI},
  year={2024},
  url={https://huggingface.co/albertic-ai/Laika-1-3B}
}

albertic-ai/Laika-1-3B

Laika-1-3B