Model Modification and HBIR Model Compilation

To pursue ultimate performance in those scenarios with enormous input size, the quantization and conversion of some inputs and outputs can be fused into data pre-processing. At this point you can choose to remove these nodes by using the hb_compile tool, the tool supports also the compilation of HBIR models at the same time.

Support Range

It supports the modification and compilation of the HBIR model.

Usage

Usage: hb_compile [OPTIONS] A tool that maps floating-point models to quantized models and provides some additional validation features Options: -h, --help Show this message and exit. -c, --config PATH Model convert config file -m, --model PATH Model to be compiled or modified

Parameters Introduction

Parameter NameParameter Description
-h, --helpShow help information and exit.
-c, --config

Configuration file for the model compilation, in YAML format.

  • For removing nodes, the march, remove_node_type or remove_node_name parameters need to be specified correctly in the config file.
  • For compiling the HBIR model, the march parameter needs to be specified correctly in the config file.

The configuration of the parameters in the yaml file can be found in section Specific Parameter Information.

-m, --model The model to be modified, which suffix needs to be .bc .

Usage Example

When using hb_compile to modify the model and compile the HBIR model, you can refer to the following command:

hb_compile --config ${config_file} \ --model ${model.bc}