TypemovieInfer
AI imagesTypemovieInfer is a unified multi-GPU inference framework for consumer-grade GPUs (RTX 4090/5090), supporting image generation and video generation models. It accelerates inference through parallel strategies such as Para-Attention and DDP, and provides memory optimizations such as FP8 quantization and CPU offloading, enabling an 8B model to run on a single RTX 4090. The framework provides a unified API, requiring only 3 lines of code to call a model, and supports YAML configuration hot reloading and plugin-based extension. 5/7 models have been tested, covering FLUX, Kontext, Qwen Image, WAN, and more.