internlm2_rkLLM
书生·浦语-1.8B
介绍
internlm2_rkLLM 是从
internlm2-chat-1_8b 转换而来的 RKLLM 模型，专为 Rockchip 设备优化。该模型运行于 RK3588 的 NPU 上。
- 模型名称: internlm2-chat-1_8b
- 模型架构: 与 internlm2-chat-1_8b 相同
- 发布者: FydeOS
- 日期: 2024-06-03
模型详情
书生·浦语-1.8B (InternLM2-1.8B) 是第二代浦语模型系列的18亿参数版本。通过在线 RLHF 在 InternLM2-Chat-1.8B-SFT 之上进一步对齐。 InternLM2-Chat-1.8B表现出更好的指令跟随、聊天体验和函数调用，推荐下游应用程序使用。
InternLM2 模型具备以下的技术特点:
- 有效支持20万字超长上下文：模型在20万字长输入中几乎完美地实现长文“大海捞针”，而且在 LongBench 和 L-Eval 等长文任务中的表现也达到开源模型中的领先水平。
- 综合性能全面提升：各能力维度相比上一代模型全面进步，在推理、数学、代码等方面的能力提升显著。
使用指南
此模型仅支持搭载 Rockchip RK3588/s 芯片的设备。请确认设备信息并确保 NPU 可用。
openFyde 系统
- 下载模型文件
XXX.rkllm。
- 新建文件夹
model/，将模型文件放置于该文件夹内。
- 启动 FydeOS AI，在设置页面进行相关配置。
其它系统
请确保已完成 RKLLM 的 NPU 相关内核更新。
- 下载模型文件
XXX.rkllm。
- 按照官方文档进行配置：官方文档。
常见问题（FAQ）
如遇到问题，请先查阅 issue 区，若问题仍未解决，再提交新的 issue。
限制与注意事项
- 模型在某些情况下可能存在性能限制
- 使用时请遵循相关法律法规
- 可能需要进行适当的参数调优以达到最佳效果
许可证
联系方式
如需更多信息，请联系：
InternLM2-1.8B
Introduction
internlm2_rkLLM is a RKLLM model derived from
internlm2-chat-1_8b, specifically optimized for Rockchip devices. This model operates on the NPU of the RK3588 chip.
- Model Name: internlm2-chat-1_8b
- Architecture: Identical to internlm2-chat-1_8b
- Publisher: FydeOS
- Release Date: 3 June 2024
Model Details
InternLM2-1.8B is the 1.8 billion parameter version of the second generation InternLM series. Further aligned on top of InternLM2-Chat-1.8B-SFT through online RLHF. InternLM2-Chat-1.8B exhibits better instruction following, chat experience, and function calling, which is recommended for downstream applications.
The InternLM2 has the following technical features:
- Effective support for ultra-long contexts of up to 200,000 characters: The model nearly perfectly achieves "finding a needle in a haystack" in long inputs of 200,000 characters. It also leads among open-source models in performance on long-text tasks such as LongBench and L-Eval.
- Comprehensive performance enhancement: Compared to the previous generation model, it shows significant improvements in various capabilities, including reasoning, mathematics, and coding.
User Guide
This model is only supported on devices with the Rockchip RK3588/s chip. Please verify your device's chip information and ensure the NPU is operational.
openFyde System
Ensure you have upgraded to the latest version of openFyde.
- Download the model file
XXX.rkllm.
- Create a folder named
model/ and place the model file inside this folder.
- Launch FydeOS AI and configure the settings on the settings page.
Other Systems
Ensure you have updated the NPU kernel related to RKLLM.
- Download the model file
XXX.rkllm.
- Follow the configuration guidelines provided in the official documentation.
FAQ
If you encounter issues, please refer to the issue section first. If your problem remains unresolved, submit a new issue.
Limitations and Considerations
- The model may have performance limitations in certain scenarios.
- Ensure compliance with relevant laws and regulations during usage.
- Parameter tuning might be necessary to achieve optimal performance.
License
This model is licensed under the same terms as
internlm2-chat-1_8b.
Contact Information
For more information, please contact:
