Original model weights quantized in initial BF16 quantization only, as released by company.

Uses: Information Retrieval: answer questions about news, history, technology, science, and more.
Problem-Solving: Help with math problems, technical issues, or logical reasoning.
Writing Assistance: Draft essays, write stories, or create content based on prompts.
Language Support: Translate between languages like English, Spanish, French, etc.
Communication: Engage in conversations to share ideas, ask questions, and collaborate.

Performance: approx. 180 tok/s with a 3070ti