Typedef TfLiteQnnDelegateHtpPerfCtrlStrategy

• Defined in File QnnTFLiteDelegate.h

Typedef Documentation

typedef enum TfLiteQnnDelegateHtpPerfCtrlStrategy TfLiteQnnDelegateHtpPerfCtrlStrategy

Defines performance control strategy

Manual: The performance mode is voted as the backend is initialized, and released at the moment of the backend is destroyed.

Users can control the vote/release of the performance mode by TfLiteQnnDelegateSetPerf().

Note that this is the default strategy.

For example, users can vote before inference starts, and release after all invocations are complete.

TfLiteQnnDelegateSetPerf(delegate, kPerformanceVote);
// invoke inferences...
TfLiteQnnDelegateSetPerf(delegate, kPerformanceRelease);

AUTO: QNN Delegate votes before starting inference, and releases after an idle interval.