English

Model Checking

To ensure that the model can run smoothly and efficiently on the Horizon platform, the operators used in the model need to conform to the operator constraints of the platform. The OP Restriction section gives a list of the specific operators we support, each with specific parameter constraints. For more details, please refer to the Toolchain Operator Support Constraint List section.

Use the hb_compile Tool to Check Model

Considering the large number of operators supported by Horizon, we support you to check the details of each OP by using the hb_compile in order to save your trouble of verifying each OP manually.

Please refer to section Model Checking for tool usage.

Checking Result

When the floating-point model checking fails, the hb_compile tool will report an Error message. A file named hb_compile.log will be generated in current directory to provide error details.

If there is no ERROR, then the checking passes successfully. The hb_compile tool will output the following message directly:

+--------------------------------------------+-------------------+------+------------------+
| Node                                       | NodeType          | ON   | Output Data Type |
+--------------------------------------------+-------------------+------+------------------+
| Conv_0+Relu_1                              | Conv+Relu         | BPU  | si8              |
| MaxPool_2                                  | MaxPool           | BPU  | si8              |
| Conv_3+Relu_4                              | Conv+Relu         | BPU  | si8              |
| Conv_5+Relu_6                              | Conv+Relu         | BPU  | si8              |
| Conv_7                                     | Conv              | BPU  | si8              |
| Conv_8                                     | Conv              | BPU  | si32             |
| Relu_10                                    | Relu              | BPU  | si8              |
...
The hb_compile completes running

In the above code block, each line represents the model check result of a model node and consists of four columns: Node, NodeType, ON(node executed device) and Output Data Type.

On This Page

PTQ Conversion Tools

The hb_compile Tool

PTQ Conversion Steps

PTQ Conversion Samples

FAQ and Common Failure Resolutions

Appendix

Tutorial

Advanced Tutorial

API Reference

QAT

qconfig_setter

Model Export

Horizon Operator

FAQ and Common Failure Resolutions

Model Inference Development

Model Inference API Introduction

Data Type and Data Structure

Function Interface

Model Inference Tool Introduction

The hrt_model_exec Tool Introduction

The hbm_infer Tool Introduction

UCP Common API Introduction

Data Structure

Functional Interface

UCP Performance Analysis Tools

FAQ and Error code

Model Deployment Principle and Process

Model Deployment Practice Guidance Examples

HMCT API Reference

Toolchain Operator Support Constraint List

Operator Support List

Operator BPU Constraint List

Community Quality Articles

Model Checking

Use the hb_compile Tool to Check Model

Checking Result

The hb_compile Tool

QAT

qconfig_setter

Model Export

Horizon Operator

Model Inference API Introduction

Data Type and Data Structure

Function Interface

Model Inference Tool Introduction

The hrt_model_exec Tool Introduction

The hbm_infer Tool Introduction

Data Structure

Functional Interface

Operator Support List

Operator BPU Constraint List

#Model Checking

#Use the hb_compile Tool to Check Model

#Checking Result

Model Checking

Use the hb_compile Tool to Check Model

Checking Result