OE Document Introduction

This section provides a comprehensive guide to the development process for all developers using the S100 processor.

To give you a full understanding of the overall process, we recommend that you first go through this section, which briefly describes all the sub-sections.

1. OE Document Introduction

This section provides you with an overview of the contents of relevant sections and content jump links, as well as the recommended reading order of the document.

  1. Product Introduction
SectionSection Introduction
OpenExplorer IntroductionThis section introduces OpenExplorer, as well as a brief overview of the contents in the release package.
Toolchain OverviewThis section briefly describes the toolchain and the overall usage process.
  1. Key Concepts

This section provides you with some common key concepts and commonly used background knowledge.

  1. Environmental Deployment

This section describes the environment deployment that needs to be performed in advance in the development and runtime environments.

  1. Quick Start
SectionSection Introduction
PTQ and QAT IntroductionThis section briefly introduces the two quantification methods: PTQ and QAT.
Algorithm Model PTQ + On-board Deployment Quick StartThis section provides a quick start sample of algorithm model quantization + on board using the PTQ scheme to help you understand the basic process of the post-training quantization (PTQ) and on board deployment of the floating-point conversion toolchain.
Algorithm Model QAT + Deployment Quick Start This section provides a quick start of algorithm model quantization + deployment using the QAT scheme to help you understand the basic process of the quantized awareness training (QAT) and deployment.
  1. Post-training Quantization (PTQ)
SectionSection Introduction
PTQ Conversion Principle And ProcessThis section introduces you to the overall process of PTQ model conversion and details of the whole process.
PTQ Conversion Tools GuideThis section provides you with a detailed introduction to the PTQ toolkit provided by algorithm toolchain.
PTQ Conversion StepsThis section provides instructions on how to use it from model preparation, model checking, prepare calibration data, model quantization and compilation, performance analysis, accuracy analysis, accuracy tune and so on.
PTQ Conversion Samples GuideThis section introduces conversion sample package of the horizon_model_convert_sample model and its usage instructions. Provide a quick sample of converting a floating-point model to a fixed-point model using the floating-point model conversion toolchain, including a single inference and accuracy verification sample.
FAQ And Common Failure ResolutionsThis section provides you with answers to some common questions about the PTQ conversion process as well as generalized suggestions for solving common trouble-shooting phenomena.
AppendixThis section introduces the descriptions and analysis of data normalization related parameters and related calculation formulas, as well as the concept of each transformer used in image scaling and cropping, parameter descriptions and examples, and general suggestions for solving common abnormalities and failures.
  1. Quantized Awareness Training (QAT)
SectionSection Introduction
IntroductionThis section briefly introduce you to horizon_plugin_pytorch, a quantized perceptual training tool developed by Horizon based on PyTorch.
Terminology ConventionsThis section introduces you to some of the terminology that will be used in quantized awareness training.
Environmental DependenceThis section introduces you to the environment-dependent requirements for quantized awareness training.
Algorithm Model QAT + Deployment Quick Start This section provides a quick start of algorithm model quantization + deployment using the QAT scheme to help you understand the basic process of the quantized awareness training (QAT) and deployment.
TutorialThis section provides you with instructions to guide you through the Quantized Awareness Training development process.
Advanced TutorialThis section provides you with an introduction to Eager Mode, the principles of FX Quantization, and operator fusion to help you further your understanding of quantized awareness training.
API ReferenceThis section provides an introduction to the API interface for QAT.
FAQ and Commnon Failure ResolutionsThis section provides you with answers to some common questions about the QAT as well as generalized suggestions for solving common trouble-shooting phenomena.
  1. Model Performance Tuning Guide
SectionSection Introduction
Model Performance OptimizationThis section provides you with Horizon's recommendations and measures for improving the performance of a model when a performance analysis is performed and if the performance does not meet your expectations.
Efficient Model Design AdviceAs an advanced content, this section includes general guides and recommendations for you to design efficient models on the S100 processor.
  1. Unify Compute Platform (UCP)
SectionSection Introduction
OverviewThis section introduces you to the general introduction of application development in the Horizon platform, the methods to complete the deployment of vision processing and deep learning models using the Unify Compute Platform.
Model Inference DevelopmentThis section introduces you to the basics of deploying deep learning models, the introduction to interfaces, the introduction to samples, Benchmark usage, and the introduction to end-side tools on the S100 platform.
UCP Common API IntroductionThis section introduces you to the data structures and interfaces related to task processing of the Unify Compute Platform.
UCP Performance Analysis ToolsThis section introduces you to the use of performance analysis tools in the Unify Compute Platform.
FAQ and Error CodeThis section provides you with answers to some common questions during heterogeneous programming as well as error code description.
  1. Model Deployment Practice Guidance
SectionSection Introduction
Model Deployment Principle and ProcessThis section integrates the forward content to introduce you to the whole process from preparation to deployment of the model, which is interspersed with some introduction to the principles and typical scenarios of the common sample code, so that you can easily understand the process of model deployment and some of the necessary steps.
Model Deployment Practice Guidance ExamplesIn this section, we use the public version of ResNet18 as an example to illustrate typical scenarios in the PTQ pathway. This will help you understand the full process of an algorithmic model using the PTQ scheme quantization + on-board operation deployment practice.
  1. Advanced Contents
SectionSection Introduction
HMCT API ReferenceAs an advanced content, this section provides an introduction to the API interface for HMCT.
HBDK Tool API ReferenceAs an advanced content, this section provides an introduction to the API interface for HBDK tools.
  1. Benchmark of Model Performance

This section introduces the model Benchmark data under certain test conditions, so that you can clearly understand the model performance.

  1. Appendix
SectionSection Introduction
Toolchain Operator Support Constraint ListThis section provides a list of operators supported by Horizon, as well as their types, constraints, and general usage restrictions.
HBIR Operator DefinitionThis section provides you with an explanation of the HBIR operator definition and general usage restrictions on the Horizon Computing Platform.
Dataset DownloadThis section provide you with download links to the datasets that will be used when using the sample models for your reference.
Common AbbreviationsThis section introduces some common abbreviations and their full names and meanings in this document.
Community Quantity ArticlesThis section of the content, through the introduction of the algorithmic toolchain of some high-quality development articles, to provide you with some additional introduction to the algorithmic toolchain, convenient for you to find information and content learning.
  1. License Agreement and Third-party Software Vulnerability Description
SectionSection Introduction
S100 Algorithm Toolchain License AgreementThis section provides the license Agreement for our toolkit. Please read it carefully before using the S100 toolchain.
Third-party Software Vulnerability DescriptionThis section provides instructions regarding vulnerability related to third-party software/components.