genie-t2e-run

The genie-t2e-run tool is provided as a test application to do text to embedding inference run on provided embedding model. It takes a user prompt in text format and outputs the result in the embedding file.

DESCRIPTION:
------------
Tool for text to embedding inference of encoder models using Genie.


REQUIRED ARGUMENTS:
-------------------

-c or --config                        <FILE>      Embedding JSON configuration file.

OPTIONAL ARGUMENTS:
-------------------
-h or --help                                      Show this help message and exit.

-p or --prompt                        <VAL>       Prompt to query. Mutually exclusive with --prompt_file.

--prompt_file                         <FILE>      Prompt to query provided as a file. Mutually exclusive with --prompt.

--output_file                         <FILE>      Output file path to save embedding result. Default file is output.raw.
                                                  Output file saves the float buffer returned by GenieEmbedding_GenerateCallback_t Fn,
                                                  User must consult the rank and dimensions, for the shape of the output.

--log                                 <VAL>       Enables logging. LogLevel must be one of error, warn, info, or verbose.

--profile                             <FILE>      Enables profiling. FILE_NAME is mandatory parameter and provides name of
                                                  output file with profiling data.

See Tutorials for reference example on how to use the genie-t2e-run tool.