Qualcomm® Gen AI Inference Extensions
v2.39.0
Introduction
Tutorials
Setup
How to Use Genie
Source Code Examples
Genie Dialog
Llama 2 7B
Llama 3 3B
Tutorials
Query Cancellation
KV$ Rewind
Updating the Stop Sequence
Token Query
Updating the Sampler Parameters
Engine Sharing
Genie Embedding
Genie Engine
Genie Log
Genie Profile
Genie Pipeline
Library
Tools
Qualcomm® Gen AI Inference Extensions
»
Tutorials
»
Dialog Tutorials
»
Llama 3 3B
»
QNN HTP
»
Android
»
Eaglet Dialog
Eaglet Dialog
¶
Choose whether you will be using a LoRA adapter for this tutorial:
Eaglet Dialog - LoRA & Draft Switching
Eaglet Dialog - LoRA Switching
No