Sibila CLI tool
The Sibila Command-Line Interface tool simplifies managing the Models factory and is useful to download models from Hugging Face model hub.
The Models factory is based in a "models" folder that contains two configuration files: "models.json" and "formats.json" and the actual files for local models.
The CLI tool is divided in three areas or actions:
| Action | |
|---|---|
| models | Manage models in "model.json" files |
| formats | Manage formats in "model.json" files |
| hub | Search and download models from Hugging Face model hub |
In all commands you should pass the option "-m models_folder" with the path to the "models" folder. Or in alternative run the commands inside the "models" folder.
The following argument names are used below (other unlisted names should be descriptive enough):
| Name | |
|---|---|
| res_name | Model entry name in the form "provider:name", for example "llamacpp:openchat". |
| format_name | Name of a format entry in "formats.json", for example "chatml". |
| query | Case-insensitive query that will be matched by a substring search. |
Usage help is available by running "sibila --help" for general help, or "sibila action --help", where action is one of "models", "formats" or "hub".
Sibila models#
To register a model entry pointing to a model name or filename, and optional format_name is a format name:
To set the format_name for an existing model entry:
To test if a model can run (for example to check if it has the chat template format defined):
List all models with optional case-insensitive substring query:
Delete a model entry in:
Sibila formats#
Check if a model filename has any format defined in the Models factory:
To register a chat template format, where template is the Jinja chat template and optional match is a regexp that matches model filename:
List all formats with optional case-insensitive substring query:
Delete a format entry:
Sibila hub#
List models in the Hugging Face model hub that match the given queries. Argument query can be a list of strings to match, separated by a space character.
Arg Filename is case-insensitive for substring matching.
Arg exact_author is an exact and case-sensitive author name from Hugging Face model hub.
To download a model, where model_id is a string like "TheBloke/openchat-3.5-1210-GGUF". Args filename and author_name same as above: