-
深度中文社区对齐:
相比于基座模型,Fuyuhana-30B-VL 在中文互联网亚文化、俚语及特定社区语境方面进行了增强。它能够更准确地理解和生成带有百度贴吧、小红书等平台风格的内容,懂梗、懂情绪,对话更加“接地气”。
-
高效的端侧/私有化部署:
得益于 MoE 架构设计,虽然模型总参数量为 30B,但其推理时的激活参数极小。配合强大的Qwen视觉编码器,使其成为自建多模态聊天机器人(Chatbot)的理想选择,在消费级显卡上也能获得流畅的体验。
-
性能提升:
在权威评测基准 Arena-Hard-Auto-V2 中,本模型不仅继承了基座的优秀能力,更实现了性能的进一步突破,总分超越了基座模型。
1CUDA_VISIBLE_DEVICES=0,1,2,3 VLLM_USE_V1=1 vllm serve \
2 flymyd/Fuyuhana-30B-VL \
3 --served-model-name Fuyuhana-30B-VL \
4 --tensor-parallel-size 4 \
5 --gpu-memory-utilization 0.9 \
6 --trust-remote-code \
7 --disable-log-requests \
8 --enable-auto-tool-choice \
9 --tool-call-parser hermes \
10 --host 0.0.0.0 \
11 --port 9997
This model aims to provide an interactive experience that better fits the context of the Chinese community while maintaining high inference efficiency, making it highly suitable for individual developers or small-to-medium enterprises for private deployment.
-
Deep Chinese Community Alignment:
Compared to the base model, Fuyuhana-30B-VL is enhanced in the areas of Chinese internet subculture, slang, and specific community contexts. It can more accurately understand and generate content with the style of platforms like Baidu Tieba and Xiaohongshu (Little Red Book). It understands memes and emotions, making conversations more grounded and authentic.
-
Efficient Edge/Private Deployment:
Benefiting from the MoE (Mixture of Experts) architecture design, although the model has a total parameter size of 30B, its active parameters during inference are extremely small. Combined with the powerful Qwen visual encoder, it is an ideal choice for self-hosted multimodal chatbots, delivering a smooth experience even on consumer-grade graphics cards.
-
Performance Improvement:
On the authoritative benchmark Arena-Hard-Auto-V2, this model not only inherits the excellent capabilities of the base model but also achieves a further breakthrough in performance, surpassing the base model in total score.
1CUDA_VISIBLE_DEVICES=0,1,2,3 VLLM_USE_V1=1 vllm serve \
2 flymyd/Fuyuhana-30B-VL \
3 --served-model-name Fuyuhana-30B-VL \
4 --tensor-parallel-size 4 \
5 --gpu-memory-utilization 0.9 \
6 --trust-remote-code \
7 --disable-log-requests \
8 --enable-auto-tool-choice \
9 --tool-call-parser hermes \
10 --host 0.0.0.0 \
11 --port 9997
If you have any questions or suggestions, please feel free to reach out:
如有任何疑问或建议,欢迎通过邮件联系: