open-r1-multimodal
AI developer platformsopen-r1-multimodal is a fork of the Hugging Face open-r1 project, aiming to extend the DeepSeek-R1 paradigm to multimodal models and add support for multimodal model training. The project implements multimodal R1 based on huggingface/open-r1 and deepseek-ai/DeepSeek-R1, integrates vision-language models (VLMs) available in transformers such as the Qwen2-VL series and Aria-MoE, and uses the GRPO algorithm for training. The project has open-sourced the first batch of 8k multimodal RL training examples, focusing on mathematical reasoning, with data generated by GPT4o based on Math360K and Geo170K, including reasoning paths and verifiable answers; it has also open-sourced the lmms-lab/Qwen2-VL-2B-GRPO-8k and lmms-lab/Qwen2-VL-7B-GRPO-8k models trained with GRPO. The repository provides scripts for data inspection and custom generation, as well as reference training commands for an 8x H100 GPU node.