Inference¶
Open a command shell on Linux host and run:
# Make sure environment is setup as per instructions, or can cd into bin folder on Linux host
cd <QNN_SDK_ROOT>\bin\x86_64-linux-clang
./genie-t2t-run -c <path to llama2-7b-genaitransformer.json>
-p "Tell me about Qualcomm"