Vega-Instruct-13B is tuned for faithful instruction following and low hallucination. This release adds robust function-calling support.
2. Evaluation Results
Comprehensive Benchmark Results
Benchmark
Polaris
Vega-7B
Castor-13B
Vega-Instruct-13B
Core Reasoning Tasks
Math Reasoning
0.573
0.569
0.589
0.621
Logical Reasoning
0.803
0.815
0.824
0.849
Common Sense
0.750
0.763
0.728
0.777
Language Understanding
Reading Comprehension
0.693
0.742
0.697
0.752
Question Answering
0.620
0.593
0.634
0.643
Text Classification
0.799
0.824
0.824
0.848
Sentiment Analysis
0.772
0.757
0.776
0.815
Generation Tasks
Code Generation
0.682
0.711
0.699
0.720
Creative Writing
0.654
0.641
0.654
0.688
Dialogue Generation
0.684
0.646
0.645
0.694
Summarization
0.757
0.755
0.754
0.800
Specialized Capabilities
Translation
0.817
0.782
0.774
0.823
Knowledge Retrieval
0.661
0.677
0.667
0.712
Instruction Following
0.773
0.770
0.772
0.793
Safety Evaluation
0.735
0.733
0.736
0.773
Overall Performance Summary
The Vega-Instruct-13B demonstrates strong performance across all evaluated benchmark categories, with particularly notable results in reasoning and generation tasks.
3. Chat Website & API Platform
We offer a chat interface and API for you to interact with Vega-Instruct-13B. Please check our official website for more details.
4. How to Run Locally
Please refer to our code repository for more information about running Vega-Instruct-13B locally.
Temperature
We recommend setting the temperature parameter to 0.6.
5. License
This repository is released under the cc-by-4.0 license. The model supports commercial use.
6. Contact
If you have any questions, please contact us at contact@vega.ai.
