English

Model Conversion and Compilation

After preparing the floating-point model, we can start the model conversion and compilation work. As we mentioned before, Horizon supports PTQ & QAT two paths for model conversion and compilation.

The whole process of model conversion compilation includes the following stages:

After the model has been successfully converted and compiled to generate the required hbm model, we support you to view it visually through the hb_model_info and hrt_model_exec tools with the following reference commands:

The hb_model_info tool

hb_model_info -v model.hbm
The hrt_model_exec tool

hrt_model_exec model_info --model_file model.hbm

PTQ Conversion Tools

The hb_compile Tool

PTQ Conversion Steps

PTQ Conversion Samples

FAQ and Common Failure Resolutions

Appendix

Tutorial

Advanced Tutorial

API Reference

QAT

qconfig_setter

Model Export

Horizon Operator

FAQ and Common Failure Resolutions

Model Inference Development

Model Inference API Introduction

Data Type and Data Structure

Function Interface

Model Inference Tool Introduction

The hrt_model_exec Tool Introduction

The hbm_infer Tool Introduction

UCP Common API Introduction

Data Structure

Functional Interface

UCP Performance Analysis Tools

FAQ and Error code

Model Deployment Principle and Process

Model Deployment Practice Guidance Examples

HMCT API Reference

Toolchain Operator Support Constraint List

Operator Support List

Operator BPU Constraint List

Community Quality Articles

Model Conversion and Compilation

The hb_compile Tool

QAT

qconfig_setter

Model Export

Horizon Operator

Model Inference API Introduction

Data Type and Data Structure

Function Interface

Model Inference Tool Introduction

The hrt_model_exec Tool Introduction

The hbm_infer Tool Introduction

Data Structure

Functional Interface

Operator Support List

Operator BPU Constraint List

#Model Conversion and Compilation

Model Conversion and Compilation