Japanese
Swallow, PLaMo, Sarashina, LLM-jp. 15 models on EveryLLM so far.
Japanese models are built for Japanese, which mixes three scripts (kanji, hiragana and katakana), leaves no spaces between words and depends heavily on politeness levels and context. Japan has many builders: universities and national research institutes, telecoms and electronics groups, and start-ups such as Sakana AI and Preferred Networks, supported by a government programme that provides computing time.
Builders
Tokyo Institute of Technology and AIST built the Swallow models by continuing to train Llama models on Japanese text. Fugaku-LLM, a 13-billion-parameter model released in May 2024 by a team including Tokyo Tech, Tohoku University, Fujitsu and RIKEN, was trained on the Fugaku supercomputer with about 60% Japanese data. Preferred Networks builds PLaMo, NTT its tsuzumi models, SoftBank's SB Intuitions the Sarashina series, and the National Institute of Informatics leads LLM-jp.
Government and foreign labs
The Ministry of Economy, Trade and Industry launched the GENIAC programme in 2024 to give model builders computing time and support. Foreign labs court Japanese users too: OpenAI opened a Tokyo office in April 2024 with a GPT-4 model customised for Japanese, and Google released a Japanese version of Gemma 2 in October 2024. Sakana AI, founded in Tokyo in 2023, focuses on methods such as merging existing models into new ones.
Famous japanese models
Further reading
Nothing matches those filters yet. Take one off, or check back: new pages are written every day.