Accuracy Tuning Tool Guide - S100 OpenExplorer

D-Robotics Official Website

D-Robotics Developer Community

English

D-Robotics Official Website

D-Robotics Developer Community

English

OE Document Introduction

Product Introduction

OpenExplorer Introduction

Toolchain Overview

Environment Deployment

Quick Start

PTQ and QAT Introduction

Algorithm Model PTQ + On-board Deployment Quick Start

Algorithm Model QAT + Deployment Quick Start

Post-training Quantization (PTQ)

PTQ Conversion Principle and Process

PTQ Conversion Tools

PTQ Conversion Tool Overview

The hb_compile Tool

Model Quantized Compilation

Model Modification and HBIR Model Compilation

The quant_config Introduction

The hb_model_info Tool

The hb_verifier Tool

The hb_eval_preprocess Tool

The hb_config_generator Tool

The HBRuntime Inference Library

Accuracy Debug Tool

PTQ Conversion Steps

Prepare Floating-point Model

Data Preparation

Model Quantization and Compilation

Model Performance Analysis

Model Accuracy Analysis

Model Accuracy Tuning

Accuracy Tuning Practice

PTQ Conversion Samples

Release Introduction

Common Algorithm Model Samples

FAQ and Common Failure Resolutions

Post-training Quantization (PTQ) FAQ

Common Failure Resolutions

Appendix

Data Normalization Parameter Configuration

Image Processing Transformer

Quantized Awareness Training (QAT)

Environmental Dependence

Algorithm Model QAT + Deployment Quick Start

Tutorial

Floating-point Model Requirements

QConfig in Detail

Prepare in Detail

Calibration Tutorial

Quantized Awareness Training Guide

Accuracy Tuning Tool Guide

Quantization Accuracy Tuning Guide

Quantization Accuracy Tuning Practice

Training-Deployment Consistency

Advanced Tutorial

FX Quantization Principle

Operator Fusion

API Reference

QAT

quantization.fuse_modules

quantization.fuse_known_modules

fx.fx_helper.wrap

quantization.prepare

qconfig_setter

quantization.qconfig_setter

quantization.qconfig_setter.templates

Model Export

quantization.hbdk4.export

quantization.hbdk4.get_hbir_input_flattener

quantization.hbdk4.get_hbir_output_unflattener

Horizon Operator

nn.functional.filter

nn.functional.point_pillars_preprocess

nn.PointPillarsScatter

nn.MultiScaleDeformableAttention

bgr2centered_yuv

rgb2centered_yuv

bgr2centered_gray

rgb2centered_gray

FAQ and Common Failure Resolutions

Model Performance Tuning Guide

Model Performance Optimization

Efficient Model Design Advice

Unify Compute Platform (UCP)

Model Inference Development

Model Inference Application Development Guide

Model Inference API Introduction

Model Inference API Overview

Data Type and Data Structure

HB_DNN_TENSOR_MAX_DIMENSIONS

hbDNNPackedHandle_t

hbDNNTensorShape

hbDNNQuantiScale

hbDNNQuantiType

hbDNNTensorProperties

Function Interface

Model Loading & Releasing

Model Inference

Dynamic Input Introduction

Configuration Info

Basic Sample User Guide

AI Benchmark User Guide

Model Inference Tool Introduction

Common Operations

The hrt_model_exec Tool Introduction

View the Model Information

Model Inference

Model Performance Evaluation

The hbm_infer Tool Introduction

Transmission Optimization

UCP Common API Introduction

Data Structure

Version Information Type

hbUCPTaskHandle_t

hbUCPTaskDoneCb

HB_UCP_ALL_BACKENDS

hbUCPTaskPriority

HB_UCP_INITIALIZE_SCHED_PARAM

hbUCPSchedParam

hbUCPSysMemFlushFlag

Functional Interface

hbUCPGetVersion

hbUCPGetSocName

hbUCPSubmitTask

hbUCPWaitTaskDone

hbUCPSetTaskDoneCb

hbUCPReleaseTask

hbUCPMallocCached

hbUCPGetErrorDesc

Environment Variable

UCP Performance Analysis Tools

UCP Trace Instructions

The hrt_ucp_monitor Tool Introduction

FAQ and Error code

Model Deployment Practice Guidance

Model Deployment Principle and Process

Prepare the Floating Point Model

Model Conversion and Compilation

Model Modification

Performance Evaluation and Tuning

Board-side Deployment

Model Deployment Practice Guidance Examples

The Practical Guide to Deploying the ResNet18 Model with RGB Input

The Practical Guide to Deploying the ResNet18 Model with Pyramid Input

The Practical Guide to Deploying Multi-Batch ResNet18 Model with Pyramid Input

The Practical Guide to Deploying the ResNet18 Model with Resizer Input

The Practical Guide to Deploying ResNet18 Model with Dequantize Nodes Removed

Advanced Contents

HMCT API Reference

hmct.api.load_model

hmct.api.build_model

hmct.api.ORTExecutor

hmct.api.check_model

HBDK Tool API Reference

Benchmark of Model Performance

Appendix

Toolchain Operator Support Constraint List

Operator Support List

S100 ONNX Operator Support List

S100 Torch Operator Support List

Operator BPU Constraint List

S100 ONNX Operator BPU Constraint List

S100 Torch Operator BPU Constraint List

HBIR Operator Definition

Dataset Download

Common Abbreviations

Community Quality Articles

Common Image Format

OE Development Kit Samples Introduction

License Agreement and Third-party Software Vulnerability Description

S100 Algorithm Toolchain License Agreement

Third-Party Software and License Statement

Third-Party Software Vulnerability Description

Previous PageQuantized Awareness Training Guide

Next pageQuantization Accuracy Tuning Guide

On This Page

Quickstart
Analyzing Statistical Information
Multi-machine Multi-GPU
API Reference
Model Structure Checking
QuantAnalysis Class
auto_find_bad_case
set_bad_case
load_bad_case
save_bad_case
set_model_profiler_dir
run
compare_per_layer
sensitivity
clean
ModelProfiler Class
get_info_manager
HbirModelProfiler Class