Qualcomm® Gen AI Inference Extensions
v2.39.0
Introduction
Tutorials
Setup
How to Use Genie
Source Code Examples
Genie Dialog
Llama 2 7B
Tutorials
Llama 3 3B
Query Cancellation
KV$ Rewind
Updating the Stop Sequence
Token Query
Updating the Sampler Parameters
Engine Sharing
Genie Embedding
Genie Engine
Genie Log
Genie Profile
Genie Pipeline
Library
Tools
Qualcomm® Gen AI Inference Extensions
»
Tutorials
»
Dialog Tutorials
»
Llama 2 7B
»
QNN Gen AI Transformer
»
Linux
Linux
¶
Choose whether you will be using a LoRA adapter for this tutorial:
Yes
No