Models

Chat Completions Endpoint

For the chat completions endpoint, Edgen supports any model on Hugging Face that is tagged with the library GGUF. You can explore the available models in the HuggingFace repository.

Audio Transcriptions Endpoint

For the audio transcriptions endpoint, Edgen supports all whisper.cpp models:

Models	Model URL
Whisper (all variants)	ggerganov/whisper.cpp
distil-whisper-small.en	distil-whisper/distil-small.en
distil-whisper-medium.en	distil-whisper/distil-medium.en
distil-whisper-large-v2	distil-whisper/distil-large-v2

How to switch an active model?

Just change the configuration file! Check Documentation » Configuration and if Edgen cannot find the model you specified locally, it'll download it automatically from HuggingFace. See also API Reference » Models.

You can also download your model manually and copy it to the model directory. In this case, Edgen will not manage this model.

The configured model can be overridden by the "model" parameter of endpoint requests. See the API Reference for details.