AI-Writer is an open-source Chinese novel generation project developed by BlinkDL, using its self-developed RWKV model, similar to the GPT-2 architecture but reportedly faster. The project is mainly used to generate web novel text such as fantasy and romance, and supports N/A/I card GPU acceleration.
Purpose The core purpose of AI-Writer is Chinese novel continuation and generation. Users provide the opening text, and the model can automatically continue the subsequent content. The project's training data all comes from web fiction, so the generated style leans toward web literature, but it lacks common life knowledge, and the generated content is for entertainment only.
Main Capabilities
- Supports Chinese novel generation, especially fantasy and romance web fiction.
- Uses the RWKV model, supports N/A/I card GPU acceleration, and can also generate using CPU.
- Provides a Python web interface that can be interacted with through a browser.
- Uses special sampling methods to improve the generation quality of small models.
- The model supports 8849 Chinese characters, with each character corresponding to input group and output group vectors.
How to Use
- Download the model: download the corresponding version from the GitHub Releases page (N card or A/I card), and extract it to the model directory.
- Run: execute python run.py (or double-click run.bat). It is recommended to run it in cmd to see error messages.
- Web interface: execute python server.py (or double-click server.bat), then open index.html in web-client (Chrome recommended).
- Beginner users can use the web version:https://blinkdl.github.io/AI-Writer/ (weaker functionality, but usable on mobile).
- For installation instructions, refer to the Zhihu column link. You need to install exact versions (such as Python 3.8.x, Windows 10 64-bit 21H1).
Applicable Scenarios
- Web fiction creators looking for inspiration or assistance with continuation.
- Researchers or developers interested in Chinese text generation models.
- Text generation experiments for entertainment purposes.
Limitations
- The model's training data all comes from web fiction and lacks common life knowledge, so the generated content may not conform to real-world logic.
- The project is outdated, and the author recommends using the newer RWKV-Runner (https://github.com/josStorer/RWKV-Runner)和在线版(https://modelscope.cn/studios/BlinkDL/RWKV-CHN/summary)。
- The generated text is for entertainment only, and laws and regulations must be complied with.
- Installation requires a specific environment, which may be a barrier for beginners.
Other Information
- Training code:https://github.com/BlinkDL/RWKV-LM
- Paddle version ported by netizens:https://github.com/JunnYu/Paddle-AI-Writer
- User QQ group: 553456870 (joining requires self-introduction), R&D group: 325154699, TG group:https://t.me/ai_writer
- Author's Zhihu:https://www.zhihu.com/people/bopengbopeng