This version of Virtuoso-Small has been converted to run on the RK3588 NPU using ['w8a8', 'w8a8_g128', 'w8a8_g256', 'w8a8_g512'] quantization.
This model has been optimized with the following LoRA:
Pretty much anything by these folks:
marty1885 and
happyme531Virtuoso-Small is the debut public release of the Virtuoso series of models by Arcee.ai, designed to bring cutting-edge generative AI capabilities to organizations and developers in a compact, efficient form. With 14 billion parameters, Virtuoso-Small is an accessible entry point for high-quality instruction-following, complex reasoning, and business-oriented generative AI tasks. Its larger siblings, Virtuoso-Medium and Virtuoso-Large, offer even greater capabilities and are available via API at
models.arcee.ai.
Virtuoso-Small is available under the Apache-2.0 license and can be deployed locally or accessed through an API at
models.arcee.ai. For larger-scale or more demanding applications, consider Virtuoso-Forte or Virtuoso-Prime.
Detailed results can be found
here
