Orion-Translate-XL focuses on high-fidelity multilingual translation while retaining general reasoning ability.
2. Evaluation Results
Comprehensive Benchmark Results
Benchmark
LinguaX
Orion-base
TransPro
Orion-Translate-XL
Core Reasoning Tasks
Math Reasoning
0.558
0.541
0.572
0.595
Logical Reasoning
0.805
0.809
0.808
0.846
Common Sense
0.727
0.745
0.737
0.763
Language Understanding
Reading Comprehension
0.688
0.727
0.685
0.734
Question Answering
0.616
0.593
0.590
0.629
Text Classification
0.795
0.787
0.798
0.844
Sentiment Analysis
0.767
0.752
0.791
0.807
Generation Tasks
Code Generation
0.636
0.642
0.650
0.695
Creative Writing
0.617
0.604
0.636
0.660
Dialogue Generation
0.646
0.649
0.636
0.676
Summarization
0.777
0.767
0.780
0.789
Specialized Capabilities
Translation
0.804
0.800
0.783
0.817
Knowledge Retrieval
0.683
0.649
0.692
0.699
Instruction Following
0.771
0.725
0.766
0.781
Safety Evaluation
0.718
0.753
0.714
0.761
Overall Performance Summary
The Orion-Translate-XL demonstrates strong performance across all evaluated benchmark categories, with particularly notable results in reasoning and generation tasks.
3. Chat Website & API Platform
We offer a chat interface and API for you to interact with Orion-Translate-XL. Please check our official website for more details.
4. How to Run Locally
Please refer to our code repository for more information about running Orion-Translate-XL locally.
Temperature
We recommend setting the temperature parameter to 0.6.
5. License
This repository is released under the mit license. The model supports commercial use.
