genie-app

The genie-app tool is a robust test application that allows for general usage of the Genie library. This tool exposes API-level commands and related utilities to enable a wide range of various configurations that more closely emulates developers’ Genie SDK use cases.

DESCRIPTION:
------------
Tool for text to text inference of LLMs using Genie.


REQUIRED ARGUMENTS:
-------------------
-s or --script                        <FILE>      Script file that contains chronological sequence of script commands

OPTIONAL ARGUMENTS:
-------------------
-h or --help                                      Show this help message and exit. Help message contains all currently supported script commands

SCRIPT COMMANDS:
----------------
dialog config create          CONFIG_NAME FILE.json
dialog config bind profile    CONFIG_NAME PROFILE_NAME
dialog config bind log        CONFIG_NAME LOG_NAME
dialog config free            CONFIG_NAME
dialog create                 DIALOG_NAME CONFIG_NAME
dialog query                  DIALOG_NAME ["PROMPT_STR"/PROMPT_FILE] [OUTPUT_FILE]
dialog applyLora              DIALOG_NAME ENGINE_NAME ADAPTER_NAME
dialog setLoraStrength        DIALOG_NAME ENGINE_NAME TENSOR_NAME ALPHA
dialog reset                  DIALOG_NAME
dialog save                   DIALOG_NAME PATH
dialog restore                DIALOG_NAME PATH
dialog free                   DIALOG_NAME
embedding config create       CONFIG_NAME FILE.json
embedding config bind profile CONFIG_NAME PROFILE_NAME
embedding config bind log     CONFIG_NAME LOG_NAME
embedding config free         CONFIG_NAME
embedding create              EMBEDDING_NAME CONFIG_NAME
embedding generate            EMBEDDING_NAME ["PROMPT_STR"/PROMPT_FILE] [OUTPUT_FILE]
embedding setPerformance      EMBEDDING_NAME PERFORMANCE_MODE
embedding free                EMBEDDING_NAME
log create                    LOG_NAME LEVEL [OUTPUT_FILE.txt]
log free                      LOG_NAME
profile create                PROFILE_NAME
profile save                  PROFILE_NAME [OUTPUT_FILE.json]
profile free                  PROFILE_NAME
script FILE
ls
sleep
version
loop                          [NUMBER OF ITERATIONS]
endloop
history [save FILE]
exit
help

See Tutorials for a reference example on how to use the genie-app tool.