Repository:
https://github.com/yuzu-ai/japanese-llm-ranking
This is a set of 40 questions in Japanese about Japanese-specific topics designed to evaluate the capabilities of AI Assistants in Japanese.
The questions are evenly distributed between four categories: history, society, government, and geography.
Questions in the first three categories are open-ended, while the geography questions are more specific.
Answers to these questions can be… See the full description on the dataset page:
https://huggingface.co/datasets/yuzuai/rakuda-questions.