English

Model Deployment Principle and Process

In the above sections, we have introduced you to the two quantization methods of PTQ and QAT, UCP board-side deployment and other related contents. This section integrates the forward content to introduce you to the whole process from preparation to deployment of the model, which is interspersed with some introduction to the principles and typical scenarios of the common sample code, so that you can easily understand the process of model deployment and some of the necessary steps.

The model deployment overall flowchart for the Horizon Open Explorer J6 toolchain is shown below:

PTQ Conversion Tools

The hb_compile Tool

PTQ Conversion Steps

PTQ Conversion Samples

FAQ and Common Failure Resolutions

Appendix

Tutorial

Advanced Tutorial

API Reference

QAT

qconfig_setter

Model Export

Horizon Operator

FAQ and Common Failure Resolutions

Model Inference Development

Model Inference API Introduction

Data Type and Data Structure

Function Interface

Model Inference Tool Introduction

The hrt_model_exec Tool Introduction

The hbm_infer Tool Introduction

UCP Common API Introduction

Data Structure

Functional Interface

UCP Performance Analysis Tools

FAQ and Error code