Skip to main content

Managing Model Files

Language models usually contain a very large number of parameters, with total sizes ranging from megabytes to gigabytes. In addition, they require extra files for chat templates, tokenization, and other supplementary data.

By default, Ailoy automatically downloads the required model files if they are not already present on your system. These files are stored in the following locations depending on your environment:

EnvironmentModel cache root path
Linux~/.cache/ailoy
macOS~/.cache/ailoy
Windows%LOCALAPPDATA%\ailoy
WebAssemblyOrigin Private File System (OPFS)

CLI tool

Ailoy also provides a Command-Line Interface(CLI) tool that helps you to manage the model files directly.

note

Model IDs follow the same naming convention as those registered on small-icon HuggingFace.

info

Please refer to Command-line Interface for more about the CLI.

List

Lists all available models in the local cache directory.

ailoy-model list

Download

Downloads the specified model by its model ID.

ailoy-model download Qwen/Qwen3-0.6B

Remove

Removes the specified model by its model ID.

ailoy-model remove Qwen/Qwen3-0.6B