The English introduction is being prepared.
optillm
an OpenAI API compatible optimizing inference proxy which implements several state-of-the-art techniques that can improve the accuracy and performance of LLMs.
SuperAPI AI DirectorySuperAPI AI Directoryan OpenAI API compatible optimizing inference proxy which implements several state-of-the-art techniques that can improve the accuracy and performance of LLMs.
The English introduction is being prepared.
