English

D-Robotics Official Website

D-Robotics Developer Community

中文

English

OE Document Introduction

Product Introduction

OpenExplorer Introduction

Toolchain Overview

Key Concepts

Environment Deployment

Quick Start

PTQ and QAT Introduction

Algorithm Model PTQ + On-board Deployment Quick Start

Algorithm Model QAT + Deployment Quick Start

Post-training Quantization (PTQ)

PTQ Conversion Principle and Process

PTQ Conversion Tools

PTQ Conversion Tool Overview

The hb_compile Tool

Model Checking

Model Quantized Compilation

Model Modification and HBIR Model Compilation

The quant_config Introduction

The hb_model_info Tool

The hb_verifier Tool

The hb_eval_preprocess Tool

The hb_config_generator Tool

The HBRuntime Inference Library

Accuracy Debug Tool

PTQ Conversion Steps

Prepare Floating-point Model

Model Checking

Data Preparation

Model Quantization and Compilation

Model Performance Analysis

Model Accuracy Analysis

Model Accuracy Tuning

Accuracy Tuning Practice

PTQ Conversion Samples

Release Introduction

Common Algorithm Model Samples

FAQ and Common Failure Resolutions

Post-training Quantization (PTQ) FAQ

Common Failure Resolutions

Appendix

Data Normalization Parameter Configuration

Image Processing Transformer

Quantized Awareness Training (QAT)

Introduction

Terminology

Environmental Dependence

Algorithm Model QAT + Deployment Quick Start

Tutorial

Floating-point Model Requirements

QConfig in Detail

Prepare in Detail

Calibration Tutorial

Quantized Awareness Training Guide

Accuracy Tuning Tool Guide

Quantization Accuracy Tuning Guide

Quantization Accuracy Tuning Practice

Training-Deployment Consistency

Advanced Tutorial

Eager Mode

FX Quantization Principle

Operator Fusion

API Reference

March

qconfig

Fake Quantize

QAT

quantization.fuse_modules

quantization.fuse_known_modules

fx.fx_helper.wrap

quantization.prepare

qconfig_setter

quantization.qconfig_setter

quantization.qconfig_setter.templates

Model Export

quantization.hbdk4.export

quantization.hbdk4.get_hbir_input_flattener

quantization.hbdk4.get_hbir_output_unflattener

ONNX

Horizon Operator

nn.functional.filter

nn.functional.point_pillars_preprocess

nn.BgrToYuv444

nn.Correlation

nn.PointPillarsScatter

nn.MultiScaleDeformableAttention

FAQ and Common Failure Resolutions

FAQ

Common Failure

Model Performance Tuning Guide

Model Performance Optimization

Efficient Model Design Advice

Unify Compute Platform (UCP)

Overview

Model Inference Development

Model Inference Application Development Guide

Model Inference API Introduction

Model Inference API Overview

Data Type and Data Structure

HB_DNN_TENSOR_MAX_DIMENSIONS

hbDNNTensorProperties

hbDNNTensor

Function Interface

Version Info

Model Loading & Releasing

Dynamic Input Introduction

Configuration Info

Basic Sample User Guide

AI Benchmark User Guide

Model Inference Tool Introduction

Common Operations

The hrt_model_exec Tool Introduction

View the Model Information

Model Inference

Model Performance Evaluation

FAQ

The hbm_infer Tool Introduction

Standard Mode

Flexible Mode

Transmission Optimization

UCP Common API Introduction

Overview

Data Structure

Version Information Type

HB_UCP_INITIALIZE_SCHED_PARAM

hbUCPSchedParam

hbUCPSysMem

hbUCPSysMemFlushFlag

Functional Interface

UCP Performance Analysis Tools

UCP Trace Instructions

The hrt_ucp_monitor Tool Introduction

FAQ and Error code

FAQ

Error Code

Model Deployment Practice Guidance

Model Deployment Principle and Process

Prepare the Floating Point Model

Model Conversion and Compilation

Model Modification

Performance Evaluation and Tuning

Board-side Deployment

Model Deployment Practice Guidance Examples

The Practical Guide to Deploying the ResNet18 Model with RGB Input

The Practical Guide to Deploying the ResNet18 Model with Pyramid Input

The Practical Guide to Deploying Multi-Batch ResNet18 Model with Pyramid Input

The Practical Guide to Deploying the ResNet18 Model with Resizer Input

The Practical Guide to Deploying ResNet18 Model with Dequantize Nodes Removed

Advanced Contents

HMCT API Reference

HBDK Tool API Reference

Benchmark of Model Performance

Appendix

Toolchain Operator Support Constraint List

Operator Support List

S100 ONNX Operator Support List

S100 Torch Operator Support List

Operator BPU Constraint List

S100 ONNX Operator BPU Constraint List

S100 Torch Operator BPU Constraint List

HBIR Operator Definition

Dataset Download

Common Abbreviations

Community Quality Articles

Common Image Format

OE Development Kit Samples Introduction

License Agreement and Third-party Software Vulnerability Description

S100 Algorithm Toolchain License Agreement

Third-Party Software and License Statement

Third-Party Software Vulnerability Description

hbDNNHandle_t

typedef void *hbDNNHandle_t;

DNN handle, pointing to the single model.

Previous PagehbDNNPackedHandle_t

Next pagehbDNNDataType

On This Page

The hb_compile Tool

QAT

qconfig_setter

Model Export

Horizon Operator

Model Inference API Introduction

Data Type and Data Structure

Function Interface

Model Inference Tool Introduction

The hrt_model_exec Tool Introduction

The hbm_infer Tool Introduction

Data Structure

Functional Interface

Operator Support List

Operator BPU Constraint List

#hbDNNHandle_t

hbDNNHandle_t