Model Card for Qwen3-14B-sk
Qwen3-14B-sk is a Slovak language version of the Qwen3-14B large language model with 14 billion parameters.
Model Details
Qwen3-14B-sk is a Slovak language model obtained by full parameter fine-tuning of the Qwen3-14B large language model. The model was developed in collaboration of Institute of Artificial Intelligence, Faculty of Electrical Engineering and Informatics, Technical University of Košice; Centre of Social and Psychological Sciences of the Slovak Academy of Sciences, Ľ. Štúr Institute of Linguistics, Slovak Academy of Sciences and ČZ, o.z. The model was fine-tuned using the following datasets:
- Data from the "Araneum Slovacum VII Maximum" web corpus, provided by the UNESCO Chair in Plurilingual and Multicultural Communication at Comenius University and the Ľudovít Štúr Institute of Linguistics.
- Pre-processed data from the Dictionary of the Slovak Language, provided by the Ľudovít Štúr Institute of Linguistics.
- Data from the Encyclopaedia Beliana, provided by the Encyclopedic Institute of the Slovak Academy of Sciences.
Model overview
- Language: Slovak
- License: Apache license 2.0
- Finetuned from model: Qwen/Qwen3-14B
- Authors:
- Peter Bednár, Institute of Artificial Intelligence, Faculty of Electrical Engineering and Informatics, Technical University of Košice
- Marek Dobeš, Centre of Social and Psychological Sciences of the Slovak Academy of Sciences and ČZ o.z.
- Radovan Garabík, Ľ. Štúr Institute of Linguistics, Slovak Academy of Sciences, supported by DiusAI a. s.
Limitations
The model occasionally exhibits repetitive behavior in its responses. Hallucination rates are comparable to other models of similar scale. Please note that no output moderation or safety filtering techniques have been applied.
Supported by
The Qwen3-14B-sk model was trained using high-performance computing infrastructure operated by CINECA and awarded through the National Leonardo access call by the Computing Centre of the Slovak Academy of Sciences, as well as the PERUN supercomputer provided by Technical University of Košice.
