Ricoh builds on Qwen for Japanese business documents
Ricoh developed LMM_35B-A3B, a multimodal language model based on Alibaba Cloud’s Qwen3.6-35B-A3B. The company applied additional training aimed at Japanese reasoning and business documents containing charts and diagrams.[1], [2]
The mixture-of-experts architecture divides processing among internal specialist networks and selects only those needed for each input. The model contains about 35 billion parameters, with about 3 billion active during inference. Ricoh used reinforcement learning and curriculum learning, which organizes the order of training tasks, in adapting the model.[1]
