ColossalChat is a free open-source version of ChatGPT launched by Colossal-AIchatbotalternative, and its GitHub project has currently received 26K stars.
As a leading open-source large AI model solution today, Colossal AI is the first company to open-source a complete RLHF mechanism based on the LLaMA pretrained model. This mechanism includes supervised data collection, supervised fine-tuning, reward model training, and reinforcement learning fine-tuning, and shares ColossalChat—an open-source project very similar to the original ChatGPT technical solution.
This open-source project includes the following:
- Demo: An interactive demo that can be tried online without registration or joining a waitlist
- Training code: Open-source complete RLHF training code, including 7 billion and 13 billion models.
- Dataset: Open-source 104K Chinese-English bilingual dataset.
- Inference: Only 4GB of GPU memory is needed for 4-bit quantized inference of a 7 billion parameter model.
- Model weights: Fast replication can be achieved on a single server with only a small amount of computing power.
