- 芯片型号：Hobot X3 PI
- 天工开物开发包OpenExplorer版本：
- OE发布包: wget -c ftp://vrftp.horizon.ai/Open_Explorer_gcc_9.3.0/2.6.2b/horizon_xj3_open_explorer_v2.6.2b-py38_20230606.tar.gz
- CPU Docker: wget -c ftp://vrftp.horizon.ai/Open_Explorer_gcc_9.3.0/2.6.2b/docker_openexplorer_ubuntu_20_xj3_cpu_v2.6.2b.tar.gz
- Ai_Toolchain: https://pan.horizon.ai/index.php/s/iZwyzXoJLs8Btme?path=%2FAi_Toolchain_Package-release-v1.20.1-OE-v2.6.2b
- 问题定位：模型转换
- 问题具体描述：目的是在docker中将yolox.onnx文件转换为.bin文件；在运行“hb_mapper makertbin”时出现以下错误：
问题截图部分
以下是模型转换的详细过程：
附件链接：
- 链接: https://pan.baidu.com/s/1jNdw41Kv-6Cf2l7oLxgCGw?pwd=jyni 提取码: jyni
运行docker容器进行模型转换
docker run -it \
-v /.../Ai_Toolchain_Package-release-v1.20.1-OE-v2.6.2b:/workspace/ai_toolchain \
-v /.../horizon_xj3_open_explorer_v2.6.2b-py38_20230606:/workspace/open_explorer \
-v /.../tiny_COCO:/workspace/data \
--name horzion_docker \
openexplorer/ai_toolchain_ubuntu_20_xj3_cpu:v2.6.2b \
/bin/bash
在docker容器中进入data目录
cd /workspace/data
模型验证
hb_mapper checker \
--model-type onnx \
--march bernoulli2 \
--model ./yolox_x_created.onnx \
--input-shape images 1x3x640x640
- 输出结果：
2023-08-25 17:14:43,246 INFO log will be stored in /workspace/data/hb_mapper_checker.log
2023-08-25 17:14:43,246 INFO Start hb_mapper....
2023-08-25 17:14:43,246 INFO hbdk version 3.45.3
2023-08-25 17:14:43,246 INFO horizon_nn version 0.18.2
2023-08-25 17:14:43,246 INFO hb_mapper version 1.17.4
2023-08-25 17:14:44,329 INFO Model type: onnx
2023-08-25 17:14:44,330 INFO input names ['images']
2023-08-25 17:14:44,330 INFO input shapes {'images': [1, 3, 640, 640]}
2023-08-25 17:14:44,781 INFO Begin model checking....
2023-08-25 17:14:44,792 INFO [Fri Aug 25 17:14:44 2023] Start to Horizon NN Model Convert.
2023-08-25 17:14:44,792 INFO Loading horizon_nn debug methods:[]
2023-08-25 17:14:44,792 INFO Parsing the input parameter:{'images': {'input_shape': [1, 3, 640, 640]}}
2023-08-25 17:14:44,793 INFO Parsing the hbdk parameter:{'hbdk_pass_through_params': '--O0'}
2023-08-25 17:14:44,793 INFO HorizonNN version: 0.18.2
2023-08-25 17:14:44,793 INFO HBDK version: 3.45.3
2023-08-25 17:14:44,793 INFO [Fri Aug 25 17:14:44 2023] Start to parse the onnx model.
2023-08-25 17:14:45,057 INFO Input ONNX model infomation:
ONNX IR version: 6
Opset version: [11, 1]
Producer: pytorch1.11.0
Domain: none
Input name: images, [1, 3, 640, 640]
Output name: output, [1, 8400, 85]
2023-08-25 17:14:48,338 INFO [Fri Aug 25 17:14:48 2023] End to parse the onnx model.
2023-08-25 17:14:48,338 INFO Model input names parsed from model: ['images']
2023-08-25 17:14:49,694 INFO Saving the original float model: ./.hb_check/original_float_model.onnx.
2023-08-25 17:14:49,695 INFO [Fri Aug 25 17:14:49 2023] Start to optimize the model.
Layer Conv_289
Expected data shape range of Kernel shape is [[1, 2048],[1, 7],[1, 7],[1, 2048]], but the data shape is [1280,1,1,2560]
Layer Conv_289
Expected data shape range of Kernel shape is [[1, 2048],[1, 7],[1, 7],[1, 2048]], but the data shape is [1280,1,1,2560]
2023-08-25 17:14:53,592 INFO [Fri Aug 25 17:14:53 2023] End to optimize the model.
2023-08-25 17:14:54,804 INFO Saving the optimized model: ./.hb_check/optimized_float_model.onnx.
2023-08-25 17:14:54,804 INFO [Fri Aug 25 17:14:54 2023] Start to calibrate the model.
2023-08-25 17:14:54,840 INFO There are 1 samples in the calibration data set.
2023-08-25 17:14:56,575 INFO Run calibration model with max method.
2023-08-25 17:14:59,271 INFO Calibration using batch 8
max calibration in progress: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:02<00:00, 2.58s/it]
2023-08-25 17:15:08,561 INFO Saving the calibrated model: ./.hb_check/calibrated_model.onnx.
2023-08-25 17:15:08,561 INFO [Fri Aug 25 17:15:08 2023] End to calibrate the model.
2023-08-25 17:15:08,561 INFO [Fri Aug 25 17:15:08 2023] Start to quantize the model.
2023-08-25 17:15:58,675 INFO [Fri Aug 25 17:15:58 2023] End to quantize the model.
2023-08-25 17:16:04,082 INFO Saving the quantized model: ./.hb_check/quantized_model.onnx.
2023-08-25 17:16:19,050 INFO [Fri Aug 25 17:16:19 2023] Start to compile the model with march bernoulli2.
2023-08-25 17:16:19,051 INFO [Fri Aug 25 17:16:19 2023] End to compile the model with march bernoulli2.
2023-08-25 17:16:24,759 INFO Compile submodel: torch-jit-export_subgraph_0
2023-08-25 17:16:33,186 INFO hbdk-cc parameters:['--O0', '--input-layout', 'NHWC', '--output-layout', 'NCHW']
[==================================================] 100%
2023-08-25 17:16:39,251 INFO consumed time 5.84149
2023-08-25 17:16:40,465 INFO FPS=1.5, latency = 666675.6 us (see ./.hb_check/torch-jit-export_subgraph_0.html)
2023-08-25 17:16:42,794 INFO The converted model node information:
==============================================================================================
Node ON Subgraph Type
----------------------------------------------------------------------------------------------
Slice_4 BPU id(0) Slice
Slice_9 BPU id(0) Slice
Slice_14 BPU id(0) Slice
Slice_19 BPU id(0) Slice
Slice_24 BPU id(0) Slice
Slice_29 BPU id(0) Slice
Slice_34 BPU id(0) Slice
Slice_39 BPU id(0) Slice
Concat_40 BPU id(0) Concat
Conv_41 BPU id(0) HzSQuantizedConv
Mul_43 BPU id(0) HzLut
Conv_44 BPU id(0) HzSQuantizedConv
Mul_46 BPU id(0) HzLut
Conv_47 BPU id(0) HzSQuantizedConv
Mul_49 BPU id(0) HzLut
Conv_50 BPU id(0) HzSQuantizedConv
Mul_52 BPU id(0) HzLut
Conv_53 BPU id(0) HzSQuantizedConv
Mul_55 BPU id(0) HzLut
Conv_56 BPU id(0) HzSQuantizedConv
Mul_58 BPU id(0) HzLut
UNIT_CONV_FOR_Add_59 BPU id(0) HzSQuantizedConv
Conv_60 BPU id(0) HzSQuantizedConv
Mul_62 BPU id(0) HzLut
Conv_63 BPU id(0) HzSQuantizedConv
Mul_65 BPU id(0) HzLut
UNIT_CONV_FOR_Add_66 BPU id(0) HzSQuantizedConv
Conv_67 BPU id(0) HzSQuantizedConv
Mul_69 BPU id(0) HzLut
Conv_70 BPU id(0) HzSQuantizedConv
Mul_72 BPU id(0) HzLut
UNIT_CONV_FOR_Add_73 BPU id(0) HzSQuantizedConv
Conv_74 BPU id(0) HzSQuantizedConv
Mul_76 BPU id(0) HzLut
Conv_77 BPU id(0) HzSQuantizedConv
Mul_79 BPU id(0) HzLut
UNIT_CONV_FOR_Add_80 BPU id(0) HzSQuantizedConv
Concat_81 BPU id(0) Concat
Conv_82 BPU id(0) HzSQuantizedConv
Mul_84 BPU id(0) HzLut
Conv_85 BPU id(0) HzSQuantizedConv
Mul_87 BPU id(0) HzLut
Conv_88 BPU id(0) HzSQuantizedConv
Mul_90 BPU id(0) HzLut
Conv_91 BPU id(0) HzSQuantizedConv
Mul_93 BPU id(0) HzLut
Conv_94 BPU id(0) HzSQuantizedConv
Mul_96 BPU id(0) HzLut
Conv_97 BPU id(0) HzSQuantizedConv
Mul_99 BPU id(0) HzLut
UNIT_CONV_FOR_Add_100 BPU id(0) HzSQuantizedConv
Conv_101 BPU id(0) HzSQuantizedConv
Mul_103 BPU id(0) HzLut
Conv_104 BPU id(0) HzSQuantizedConv
Mul_106 BPU id(0) HzLut
UNIT_CONV_FOR_Add_107 BPU id(0) HzSQuantizedConv
Conv_108 BPU id(0) HzSQuantizedConv
Mul_110 BPU id(0) HzLut
Conv_111 BPU id(0) HzSQuantizedConv
Mul_113 BPU id(0) HzLut
UNIT_CONV_FOR_Add_114 BPU id(0) HzSQuantizedConv
Conv_115 BPU id(0) HzSQuantizedConv
Mul_117 BPU id(0) HzLut
Conv_118 BPU id(0) HzSQuantizedConv
Mul_120 BPU id(0) HzLut
UNIT_CONV_FOR_Add_121 BPU id(0) HzSQuantizedConv
Conv_122 BPU id(0) HzSQuantizedConv
Mul_124 BPU id(0) HzLut
Conv_125 BPU id(0) HzSQuantizedConv
Mul_127 BPU id(0) HzLut
UNIT_CONV_FOR_Add_128 BPU id(0) HzSQuantizedConv
Conv_129 BPU id(0) HzSQuantizedConv
Mul_131 BPU id(0) HzLut
Conv_132 BPU id(0) HzSQuantizedConv
Mul_134 BPU id(0) HzLut
UNIT_CONV_FOR_Add_135 BPU id(0) HzSQuantizedConv
Conv_136 BPU id(0) HzSQuantizedConv
Mul_138 BPU id(0) HzLut
Conv_139 BPU id(0) HzSQuantizedConv
Mul_141 BPU id(0) HzLut
UNIT_CONV_FOR_Add_142 BPU id(0) HzSQuantizedConv
Conv_143 BPU id(0) HzSQuantizedConv
Mul_145 BPU id(0) HzLut
Conv_146 BPU id(0) HzSQuantizedConv
Mul_148 BPU id(0) HzLut
UNIT_CONV_FOR_Add_149 BPU id(0) HzSQuantizedConv
Conv_150 BPU id(0) HzSQuantizedConv
Mul_152 BPU id(0) HzLut
Conv_153 BPU id(0) HzSQuantizedConv
Mul_155 BPU id(0) HzLut
UNIT_CONV_FOR_Add_156 BPU id(0) HzSQuantizedConv
Conv_157 BPU id(0) HzSQuantizedConv
Mul_159 BPU id(0) HzLut
Conv_160 BPU id(0) HzSQuantizedConv
Mul_162 BPU id(0) HzLut
UNIT_CONV_FOR_Add_163 BPU id(0) HzSQuantizedConv
Conv_164 BPU id(0) HzSQuantizedConv
Mul_166 BPU id(0) HzLut
Conv_167 BPU id(0) HzSQuantizedConv
Mul_169 BPU id(0) HzLut
UNIT_CONV_FOR_Add_170 BPU id(0) HzSQuantizedConv
Conv_171 BPU id(0) HzSQuantizedConv
Mul_173 BPU id(0) HzLut
Conv_174 BPU id(0) HzSQuantizedConv
Mul_176 BPU id(0) HzLut
UNIT_CONV_FOR_Add_177 BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1004_0.15844_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_178 BPU id(0) Concat
Conv_179 BPU id(0) HzSQuantizedConv
Mul_181 BPU id(0) HzLut
Conv_182 BPU id(0) HzSQuantizedConv
Mul_184 BPU id(0) HzLut
Conv_185 BPU id(0) HzSQuantizedConv
Mul_187 BPU id(0) HzLut
Conv_188 BPU id(0) HzSQuantizedConv
Mul_190 BPU id(0) HzLut
Conv_191 BPU id(0) HzSQuantizedConv
Mul_193 BPU id(0) HzLut
Conv_194 BPU id(0) HzSQuantizedConv
Mul_196 BPU id(0) HzLut
UNIT_CONV_FOR_Add_197 BPU id(0) HzSQuantizedConv
Conv_198 BPU id(0) HzSQuantizedConv
Mul_200 BPU id(0) HzLut
Conv_201 BPU id(0) HzSQuantizedConv
Mul_203 BPU id(0) HzLut
UNIT_CONV_FOR_Add_204 BPU id(0) HzSQuantizedConv
Conv_205 BPU id(0) HzSQuantizedConv
Mul_207 BPU id(0) HzLut
Conv_208 BPU id(0) HzSQuantizedConv
Mul_210 BPU id(0) HzLut
UNIT_CONV_FOR_Add_211 BPU id(0) HzSQuantizedConv
Conv_212 BPU id(0) HzSQuantizedConv
Mul_214 BPU id(0) HzLut
Conv_215 BPU id(0) HzSQuantizedConv
Mul_217 BPU id(0) HzLut
UNIT_CONV_FOR_Add_218 BPU id(0) HzSQuantizedConv
Conv_219 BPU id(0) HzSQuantizedConv
Mul_221 BPU id(0) HzLut
Conv_222 BPU id(0) HzSQuantizedConv
Mul_224 BPU id(0) HzLut
UNIT_CONV_FOR_Add_225 BPU id(0) HzSQuantizedConv
Conv_226 BPU id(0) HzSQuantizedConv
Mul_228 BPU id(0) HzLut
Conv_229 BPU id(0) HzSQuantizedConv
Mul_231 BPU id(0) HzLut
UNIT_CONV_FOR_Add_232 BPU id(0) HzSQuantizedConv
Conv_233 BPU id(0) HzSQuantizedConv
Mul_235 BPU id(0) HzLut
Conv_236 BPU id(0) HzSQuantizedConv
Mul_238 BPU id(0) HzLut
UNIT_CONV_FOR_Add_239 BPU id(0) HzSQuantizedConv
Conv_240 BPU id(0) HzSQuantizedConv
Mul_242 BPU id(0) HzLut
Conv_243 BPU id(0) HzSQuantizedConv
Mul_245 BPU id(0) HzLut
UNIT_CONV_FOR_Add_246 BPU id(0) HzSQuantizedConv
Conv_247 BPU id(0) HzSQuantizedConv
Mul_249 BPU id(0) HzLut
Conv_250 BPU id(0) HzSQuantizedConv
Mul_252 BPU id(0) HzLut
UNIT_CONV_FOR_Add_253 BPU id(0) HzSQuantizedConv
Conv_254 BPU id(0) HzSQuantizedConv
Mul_256 BPU id(0) HzLut
Conv_257 BPU id(0) HzSQuantizedConv
Mul_259 BPU id(0) HzLut
UNIT_CONV_FOR_Add_260 BPU id(0) HzSQuantizedConv
Conv_261 BPU id(0) HzSQuantizedConv
Mul_263 BPU id(0) HzLut
Conv_264 BPU id(0) HzSQuantizedConv
Mul_266 BPU id(0) HzLut
UNIT_CONV_FOR_Add_267 BPU id(0) HzSQuantizedConv
Conv_268 BPU id(0) HzSQuantizedConv
Mul_270 BPU id(0) HzLut
Conv_271 BPU id(0) HzSQuantizedConv
Mul_273 BPU id(0) HzLut
UNIT_CONV_FOR_Add_274 BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1129_0.14461_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_275 BPU id(0) Concat
Conv_276 BPU id(0) HzSQuantizedConv
Mul_278 BPU id(0) HzLut
Conv_279 BPU id(0) HzSQuantizedConv
Mul_281 BPU id(0) HzLut
Conv_282 BPU id(0) HzSQuantizedConv
Mul_284 BPU id(0) HzLut
MaxPool_285 BPU id(0) HzQuantizedMaxPool
MaxPool_286 BPU id(0) HzQuantizedMaxPool
MaxPool_287 BPU id(0) HzQuantizedMaxPool
...NV_FOR_onnx::MaxPool_1250_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1251_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1252_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1253_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_288 BPU id(0) Concat
Conv_289_split BPU id(0) Split
Conv_289_sub1 BPU id(0) HzSQuantizedConv
Conv_289_sub2 BPU id(0) HzSQuantizedConv
Mul_291 BPU id(0) HzLut
Conv_292 BPU id(0) HzSQuantizedConv
Mul_294 BPU id(0) HzLut
Conv_295 BPU id(0) HzSQuantizedConv
Mul_297 BPU id(0) HzLut
Conv_298 BPU id(0) HzSQuantizedConv
Mul_300 BPU id(0) HzLut
Conv_301 BPU id(0) HzSQuantizedConv
Mul_303 BPU id(0) HzLut
Conv_304 BPU id(0) HzSQuantizedConv
Mul_306 BPU id(0) HzLut
Conv_307 BPU id(0) HzSQuantizedConv
Mul_309 BPU id(0) HzLut
Conv_310 BPU id(0) HzSQuantizedConv
Mul_312 BPU id(0) HzLut
Conv_313 BPU id(0) HzSQuantizedConv
Mul_315 BPU id(0) HzLut
Conv_316 BPU id(0) HzSQuantizedConv
Mul_318 BPU id(0) HzLut
Conv_319 BPU id(0) HzSQuantizedConv
Mul_321 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1298_0.10651_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1266_0.10651_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_322 BPU id(0) Concat
Conv_323 BPU id(0) HzSQuantizedConv
Mul_325 BPU id(0) HzLut
Conv_326 BPU id(0) HzSQuantizedConv
Mul_328 BPU id(0) HzLut
Resize_330 BPU id(0) HzQuantizedResizeUpsample
...ONV_FOR_onnx::Concat_1312_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.539_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_331 BPU id(0) Concat
Conv_332 BPU id(0) HzSQuantizedConv
Mul_334 BPU id(0) HzLut
Conv_335 BPU id(0) HzSQuantizedConv
Mul_337 BPU id(0) HzLut
Conv_338 BPU id(0) HzSQuantizedConv
Mul_340 BPU id(0) HzLut
Conv_341 BPU id(0) HzSQuantizedConv
Mul_343 BPU id(0) HzLut
Conv_344 BPU id(0) HzSQuantizedConv
Mul_346 BPU id(0) HzLut
Conv_347 BPU id(0) HzSQuantizedConv
Mul_349 BPU id(0) HzLut
Conv_350 BPU id(0) HzSQuantizedConv
Mul_352 BPU id(0) HzLut
Conv_353 BPU id(0) HzSQuantizedConv
Mul_355 BPU id(0) HzLut
Conv_356 BPU id(0) HzSQuantizedConv
Mul_358 BPU id(0) HzLut
Conv_359 BPU id(0) HzSQuantizedConv
Mul_361 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1353_0.10959_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_362 BPU id(0) Concat
Conv_363 BPU id(0) HzSQuantizedConv
Mul_365 BPU id(0) HzLut
Conv_366 BPU id(0) HzSQuantizedConv
Mul_368 BPU id(0) HzLut
Resize_370 BPU id(0) HzQuantizedResizeUpsample
...ONV_FOR_onnx::Concat_1367_0.07821_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.319_0.07821_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_371 BPU id(0) Concat
Conv_372 BPU id(0) HzSQuantizedConv
Mul_374 BPU id(0) HzLut
Conv_375 BPU id(0) HzSQuantizedConv
Mul_377 BPU id(0) HzLut
Conv_378 BPU id(0) HzSQuantizedConv
Mul_380 BPU id(0) HzLut
Conv_381 BPU id(0) HzSQuantizedConv
Mul_383 BPU id(0) HzLut
Conv_384 BPU id(0) HzSQuantizedConv
Mul_386 BPU id(0) HzLut
Conv_387 BPU id(0) HzSQuantizedConv
Mul_389 BPU id(0) HzLut
Conv_390 BPU id(0) HzSQuantizedConv
Mul_392 BPU id(0) HzLut
Conv_393 BPU id(0) HzSQuantizedConv
Mul_395 BPU id(0) HzLut
Conv_396 BPU id(0) HzSQuantizedConv
Mul_398 BPU id(0) HzLut
Conv_399 BPU id(0) HzSQuantizedConv
Mul_401 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1408_0.08810_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1376_0.08810_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_402 BPU id(0) Concat
Conv_403 BPU id(0) HzSQuantizedConv
Mul_405 BPU id(0) HzLut
Conv_406 BPU id(0) HzSQuantizedConv
Mul_408 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1417_0.09117_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.751_0.09117_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_409 BPU id(0) Concat
Conv_410 BPU id(0) HzSQuantizedConv
Mul_412 BPU id(0) HzLut
Conv_413 BPU id(0) HzSQuantizedConv
Mul_415 BPU id(0) HzLut
Conv_416 BPU id(0) HzSQuantizedConv
Mul_418 BPU id(0) HzLut
Conv_419 BPU id(0) HzSQuantizedConv
Mul_421 BPU id(0) HzLut
Conv_422 BPU id(0) HzSQuantizedConv
Mul_424 BPU id(0) HzLut
Conv_425 BPU id(0) HzSQuantizedConv
Mul_427 BPU id(0) HzLut
Conv_428 BPU id(0) HzSQuantizedConv
Mul_430 BPU id(0) HzLut
Conv_431 BPU id(0) HzSQuantizedConv
Mul_433 BPU id(0) HzLut
Conv_434 BPU id(0) HzSQuantizedConv
Mul_436 BPU id(0) HzLut
Conv_437 BPU id(0) HzSQuantizedConv
Mul_439 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1458_0.07425_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1426_0.07425_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_440 BPU id(0) Concat
Conv_441 BPU id(0) HzSQuantizedConv
Mul_443 BPU id(0) HzLut
Conv_444 BPU id(0) HzSQuantizedConv
Mul_446 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1467_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.655_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_447 BPU id(0) Concat
Conv_448 BPU id(0) HzSQuantizedConv
Mul_450 BPU id(0) HzLut
Conv_451 BPU id(0) HzSQuantizedConv
Mul_453 BPU id(0) HzLut
Conv_454 BPU id(0) HzSQuantizedConv
Mul_456 BPU id(0) HzLut
Conv_457 BPU id(0) HzSQuantizedConv
Mul_459 BPU id(0) HzLut
Conv_460 BPU id(0) HzSQuantizedConv
Mul_462 BPU id(0) HzLut
Conv_463 BPU id(0) HzSQuantizedConv
Mul_465 BPU id(0) HzLut
Conv_466 BPU id(0) HzSQuantizedConv
Mul_468 BPU id(0) HzLut
Conv_469 BPU id(0) HzSQuantizedConv
Mul_471 BPU id(0) HzLut
Conv_472 BPU id(0) HzSQuantizedConv
Mul_474 BPU id(0) HzLut
Conv_475 BPU id(0) HzSQuantizedConv
Mul_477 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1476_0.08863_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_478 BPU id(0) Concat
Conv_479 BPU id(0) HzSQuantizedConv
Mul_481 BPU id(0) HzLut
Conv_482 BPU id(0) HzSQuantizedConv
Mul_484 BPU id(0) HzLut
Conv_485 BPU id(0) HzSQuantizedConv
Mul_487 BPU id(0) HzLut
Conv_488 BPU id(0) HzSQuantizedConv
Mul_490 BPU id(0) HzLut
Conv_491 BPU id(0) HzSQuantizedConv
Conv_492 BPU id(0) HzSQuantizedConv
Mul_494 BPU id(0) HzLut
Conv_495 BPU id(0) HzSQuantizedConv
Mul_497 BPU id(0) HzLut
Conv_498 BPU id(0) HzSQuantizedConv
Conv_499 BPU id(0) HzSQuantizedConv
Sigmoid_500 BPU id(0) HzLut
Sigmoid_501 BPU id(0) HzLut
Concat_502 CPU -- Concat
Conv_503 BPU id(0) HzSQuantizedConv
Mul_505 BPU id(0) HzLut
Conv_506 BPU id(0) HzSQuantizedConv
Mul_508 BPU id(0) HzLut
Conv_509 BPU id(0) HzSQuantizedConv
Mul_511 BPU id(0) HzLut
Conv_512 BPU id(0) HzSQuantizedConv
Conv_513 BPU id(0) HzSQuantizedConv
Mul_515 BPU id(0) HzLut
Conv_516 BPU id(0) HzSQuantizedConv
Mul_518 BPU id(0) HzLut
Conv_519 BPU id(0) HzSQuantizedConv
Conv_520 BPU id(0) HzSQuantizedConv
Sigmoid_521 BPU id(0) HzLut
Sigmoid_522 BPU id(0) HzLut
Concat_523 CPU -- Concat
Conv_524 BPU id(0) HzSQuantizedConv
Mul_526 BPU id(0) HzLut
Conv_527 BPU id(0) HzSQuantizedConv
Mul_529 BPU id(0) HzLut
Conv_530 BPU id(0) HzSQuantizedConv
Mul_532 BPU id(0) HzLut
Conv_533 BPU id(0) HzSQuantizedConv
Conv_534 BPU id(0) HzSQuantizedConv
Mul_536 BPU id(0) HzLut
Conv_537 BPU id(0) HzSQuantizedConv
Mul_539 BPU id(0) HzLut
Conv_540 BPU id(0) HzSQuantizedConv
Conv_541 BPU id(0) HzSQuantizedConv
Sigmoid_542 BPU id(0) HzLut
Sigmoid_543 BPU id(0) HzLut
Concat_544 CPU -- Concat
Reshape_552 CPU -- Reshape
Reshape_560 CPU -- Reshape
Reshape_568 CPU -- Reshape
Concat_569 CPU -- Concat
Transpose_570 CPU -- Transpose
2023-08-25 17:16:42,799 INFO [Fri Aug 25 17:16:42 2023] End to Horizon NN Model Convert.
2023-08-25 17:16:42,832 INFO ONNX model output num : 1
2023-08-25 17:16:43,219 INFO End model checking....
- 输出的hb_mapper_checker.log内容为：
2023-08-25 17:14:43,246 file: tool_utils.py func: tool_utils line No: 73 log will be stored in /workspace/data/hb_mapper_checker.log
2023-08-25 17:14:43,246 file: hb_mapper.py func: hb_mapper line No: 70 Start hb_mapper....
2023-08-25 17:14:43,246 file: hb_mapper.py func: hb_mapper line No: 71 hbdk version 3.45.3
2023-08-25 17:14:43,246 file: hb_mapper.py func: hb_mapper line No: 72 horizon_nn version 0.18.2
2023-08-25 17:14:43,246 file: hb_mapper.py func: hb_mapper line No: 73 hb_mapper version 1.17.4
2023-08-25 17:14:44,305 file: helper.py func: helper line No: 145 Model input names: ['images']
2023-08-25 17:14:44,329 file: hb_mapper_checker.py func: hb_mapper_checker line No: 103 Model type: onnx
2023-08-25 17:14:44,330 file: hb_mapper_checker.py func: hb_mapper_checker line No: 104 march: bernoulli2
2023-08-25 17:14:44,330 file: hb_mapper_checker.py func: hb_mapper_checker line No: 109 input names ['images']
2023-08-25 17:14:44,330 file: hb_mapper_checker.py func: hb_mapper_checker line No: 110 input shapes {'images': [1, 3, 640, 640]}
2023-08-25 17:14:44,780 file: helper.py func: helper line No: 145 Model input names: ['images']
2023-08-25 17:14:44,781 file: hb_mapper_checker.py func: hb_mapper_checker line No: 116 Begin model checking....
2023-08-25 17:14:44,792 file: build.py func: build line No: 35 [Fri Aug 25 17:14:44 2023] Start to Horizon NN Model Convert.
2023-08-25 17:14:44,792 file: model_debug.py func: model_debug line No: 61 Loading horizon_nn debug methods:[]
2023-08-25 17:14:44,792 file: dict_parser.py func: dict_parser line No: 33 Parsing the input parameter:{'images': {'input_shape': [1, 3, 640, 640]}}
2023-08-25 17:14:44,793 file: dict_parser.py func: dict_parser line No: 440 Parsing the hbdk parameter:{'hbdk_pass_through_params': '--O0'}
2023-08-25 17:14:44,793 file: build.py func: build line No: 150 HorizonNN version: 0.18.2
2023-08-25 17:14:44,793 file: build.py func: build line No: 154 HBDK version: 3.45.3
2023-08-25 17:14:44,793 file: build.py func: build line No: 35 [Fri Aug 25 17:14:44 2023] Start to parse the onnx model.
2023-08-25 17:14:45,057 file: onnx_parser.py func: onnx_parser line No: 241 Input ONNX model infomation:
ONNX IR version: 6
Opset version: [11, 1]
Producer: pytorch1.11.0
Domain: none
Input name: images, [1, 3, 640, 640]
Output name: output, [1, 8400, 85]
2023-08-25 17:14:48,338 file: build.py func: build line No: 38 [Fri Aug 25 17:14:48 2023] End to parse the onnx model.
2023-08-25 17:14:48,338 file: build.py func: build line No: 217 Model input names parsed from model: ['images']
2023-08-25 17:14:49,694 file: build.py func: build line No: 464 Saving the original float model: ./.hb_check/original_float_model.onnx.
2023-08-25 17:14:49,695 file: build.py func: build line No: 35 [Fri Aug 25 17:14:49 2023] Start to optimize the model.
2023-08-25 17:14:53,592 file: build.py func: build line No: 38 [Fri Aug 25 17:14:53 2023] End to optimize the model.
2023-08-25 17:14:54,804 file: build.py func: build line No: 487 Saving the optimized model: ./.hb_check/optimized_float_model.onnx.
2023-08-25 17:14:54,804 file: build.py func: build line No: 35 [Fri Aug 25 17:14:54 2023] Start to calibrate the model.
2023-08-25 17:14:54,840 file: calibration_data_set.py func: calibration_data_set line No: 89 input name: images, number_of_samples: 1
2023-08-25 17:14:54,840 file: calibration_data_set.py func: calibration_data_set line No: 100 There are 1 samples in the calibration data set.
2023-08-25 17:14:56,575 file: max_calibrater.py func: max_calibrater line No: 74 Run calibration model with max method.
2023-08-25 17:14:59,271 file: calibrater.py func: calibrater line No: 194 Calibration using batch 8
2023-08-25 17:15:08,561 file: build.py func: build line No: 365 Saving the calibrated model: ./.hb_check/calibrated_model.onnx.
2023-08-25 17:15:08,561 file: build.py func: build line No: 38 [Fri Aug 25 17:15:08 2023] End to calibrate the model.
2023-08-25 17:15:08,561 file: build.py func: build line No: 35 [Fri Aug 25 17:15:08 2023] Start to quantize the model.
2023-08-25 17:15:58,675 file: build.py func: build line No: 38 [Fri Aug 25 17:15:58 2023] End to quantize the model.
2023-08-25 17:16:04,082 file: build.py func: build line No: 500 Saving the quantized model: ./.hb_check/quantized_model.onnx.
2023-08-25 17:16:19,050 file: build.py func: build line No: 35 [Fri Aug 25 17:16:19 2023] Start to compile the model with march bernoulli2.
2023-08-25 17:16:19,051 file: build.py func: build line No: 38 [Fri Aug 25 17:16:19 2023] End to compile the model with march bernoulli2.
2023-08-25 17:16:24,759 file: hybrid_build.py func: hybrid_build line No: 149 Compile submodel: torch-jit-export_subgraph_0
2023-08-25 17:16:33,186 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:['--O0', '--input-layout', 'NHWC', '--output-layout', 'NCHW']
2023-08-25 17:16:33,186 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_50jv6m8/torch-jit-export_subgraph_0.hbir -o /tmp/tmp_50jv6m8/torch-jit-export_subgraph_0.hbm --march bernoulli2 --progressbar --O0 --input-layout NHWC --output-layout NCHW
2023-08-25 17:16:39,251 file: tool_utils.py func: tool_utils line No: 322 consumed time 5.84149
2023-08-25 17:16:40,465 file: tool_utils.py func: tool_utils line No: 322 FPS=1.5, latency = 666675.6 us (see ./.hb_check/torch-jit-export_subgraph_0.html)
2023-08-25 17:16:42,794 file: node_info.py func: node_info line No: 55 The converted model node information:
==============================================================================================
Node ON Subgraph Type
----------------------------------------------------------------------------------------------
Slice_4 BPU id(0) Slice
Slice_9 BPU id(0) Slice
Slice_14 BPU id(0) Slice
Slice_19 BPU id(0) Slice
Slice_24 BPU id(0) Slice
Slice_29 BPU id(0) Slice
Slice_34 BPU id(0) Slice
Slice_39 BPU id(0) Slice
Concat_40 BPU id(0) Concat
Conv_41 BPU id(0) HzSQuantizedConv
Mul_43 BPU id(0) HzLut
Conv_44 BPU id(0) HzSQuantizedConv
Mul_46 BPU id(0) HzLut
Conv_47 BPU id(0) HzSQuantizedConv
Mul_49 BPU id(0) HzLut
Conv_50 BPU id(0) HzSQuantizedConv
Mul_52 BPU id(0) HzLut
Conv_53 BPU id(0) HzSQuantizedConv
Mul_55 BPU id(0) HzLut
Conv_56 BPU id(0) HzSQuantizedConv
Mul_58 BPU id(0) HzLut
UNIT_CONV_FOR_Add_59 BPU id(0) HzSQuantizedConv
Conv_60 BPU id(0) HzSQuantizedConv
Mul_62 BPU id(0) HzLut
Conv_63 BPU id(0) HzSQuantizedConv
Mul_65 BPU id(0) HzLut
UNIT_CONV_FOR_Add_66 BPU id(0) HzSQuantizedConv
Conv_67 BPU id(0) HzSQuantizedConv
Mul_69 BPU id(0) HzLut
Conv_70 BPU id(0) HzSQuantizedConv
Mul_72 BPU id(0) HzLut
UNIT_CONV_FOR_Add_73 BPU id(0) HzSQuantizedConv
Conv_74 BPU id(0) HzSQuantizedConv
Mul_76 BPU id(0) HzLut
Conv_77 BPU id(0) HzSQuantizedConv
Mul_79 BPU id(0) HzLut
UNIT_CONV_FOR_Add_80 BPU id(0) HzSQuantizedConv
Concat_81 BPU id(0) Concat
Conv_82 BPU id(0) HzSQuantizedConv
Mul_84 BPU id(0) HzLut
Conv_85 BPU id(0) HzSQuantizedConv
Mul_87 BPU id(0) HzLut
Conv_88 BPU id(0) HzSQuantizedConv
Mul_90 BPU id(0) HzLut
Conv_91 BPU id(0) HzSQuantizedConv
Mul_93 BPU id(0) HzLut
Conv_94 BPU id(0) HzSQuantizedConv
Mul_96 BPU id(0) HzLut
Conv_97 BPU id(0) HzSQuantizedConv
Mul_99 BPU id(0) HzLut
UNIT_CONV_FOR_Add_100 BPU id(0) HzSQuantizedConv
Conv_101 BPU id(0) HzSQuantizedConv
Mul_103 BPU id(0) HzLut
Conv_104 BPU id(0) HzSQuantizedConv
Mul_106 BPU id(0) HzLut
UNIT_CONV_FOR_Add_107 BPU id(0) HzSQuantizedConv
Conv_108 BPU id(0) HzSQuantizedConv
Mul_110 BPU id(0) HzLut
Conv_111 BPU id(0) HzSQuantizedConv
Mul_113 BPU id(0) HzLut
UNIT_CONV_FOR_Add_114 BPU id(0) HzSQuantizedConv
Conv_115 BPU id(0) HzSQuantizedConv
Mul_117 BPU id(0) HzLut
Conv_118 BPU id(0) HzSQuantizedConv
Mul_120 BPU id(0) HzLut
UNIT_CONV_FOR_Add_121 BPU id(0) HzSQuantizedConv
Conv_122 BPU id(0) HzSQuantizedConv
Mul_124 BPU id(0) HzLut
Conv_125 BPU id(0) HzSQuantizedConv
Mul_127 BPU id(0) HzLut
UNIT_CONV_FOR_Add_128 BPU id(0) HzSQuantizedConv
Conv_129 BPU id(0) HzSQuantizedConv
Mul_131 BPU id(0) HzLut
Conv_132 BPU id(0) HzSQuantizedConv
Mul_134 BPU id(0) HzLut
UNIT_CONV_FOR_Add_135 BPU id(0) HzSQuantizedConv
Conv_136 BPU id(0) HzSQuantizedConv
Mul_138 BPU id(0) HzLut
Conv_139 BPU id(0) HzSQuantizedConv
Mul_141 BPU id(0) HzLut
UNIT_CONV_FOR_Add_142 BPU id(0) HzSQuantizedConv
Conv_143 BPU id(0) HzSQuantizedConv
Mul_145 BPU id(0) HzLut
Conv_146 BPU id(0) HzSQuantizedConv
Mul_148 BPU id(0) HzLut
UNIT_CONV_FOR_Add_149 BPU id(0) HzSQuantizedConv
Conv_150 BPU id(0) HzSQuantizedConv
Mul_152 BPU id(0) HzLut
Conv_153 BPU id(0) HzSQuantizedConv
Mul_155 BPU id(0) HzLut
UNIT_CONV_FOR_Add_156 BPU id(0) HzSQuantizedConv
Conv_157 BPU id(0) HzSQuantizedConv
Mul_159 BPU id(0) HzLut
Conv_160 BPU id(0) HzSQuantizedConv
Mul_162 BPU id(0) HzLut
UNIT_CONV_FOR_Add_163 BPU id(0) HzSQuantizedConv
Conv_164 BPU id(0) HzSQuantizedConv
Mul_166 BPU id(0) HzLut
Conv_167 BPU id(0) HzSQuantizedConv
Mul_169 BPU id(0) HzLut
UNIT_CONV_FOR_Add_170 BPU id(0) HzSQuantizedConv
Conv_171 BPU id(0) HzSQuantizedConv
Mul_173 BPU id(0) HzLut
Conv_174 BPU id(0) HzSQuantizedConv
Mul_176 BPU id(0) HzLut
UNIT_CONV_FOR_Add_177 BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1004_0.15844_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_178 BPU id(0) Concat
Conv_179 BPU id(0) HzSQuantizedConv
Mul_181 BPU id(0) HzLut
Conv_182 BPU id(0) HzSQuantizedConv
Mul_184 BPU id(0) HzLut
Conv_185 BPU id(0) HzSQuantizedConv
Mul_187 BPU id(0) HzLut
Conv_188 BPU id(0) HzSQuantizedConv
Mul_190 BPU id(0) HzLut 链接: https://pan.baidu.com/s/1jNdw41Kv-6Cf2l7oLxgCGw?pwd=jyni 提取码: jyni
Conv_191 BPU id(0) HzSQuantizedConv
Mul_193 BPU id(0) HzLut
Conv_194 BPU id(0) HzSQuantizedConv
Mul_196 BPU id(0) HzLut
UNIT_CONV_FOR_Add_197 BPU id(0) HzSQuantizedConv
Conv_198 BPU id(0) HzSQuantizedConv
Mul_200 BPU id(0) HzLut
Conv_201 BPU id(0) HzSQuantizedConv
Mul_203 BPU id(0) HzLut
UNIT_CONV_FOR_Add_204 BPU id(0) HzSQuantizedConv
Conv_205 BPU id(0) HzSQuantizedConv
Mul_207 BPU id(0) HzLut
Conv_208 BPU id(0) HzSQuantizedConv
Mul_210 BPU id(0) HzLut
UNIT_CONV_FOR_Add_211 BPU id(0) HzSQuantizedConv
Conv_212 BPU id(0) HzSQuantizedConv
Mul_214 BPU id(0) HzLut
Conv_215 BPU id(0) HzSQuantizedConv
Mul_217 BPU id(0) HzLut
UNIT_CONV_FOR_Add_218 BPU id(0) HzSQuantizedConv
Conv_219 BPU id(0) HzSQuantizedConv
Mul_221 BPU id(0) HzLut
Conv_222 BPU id(0) HzSQuantizedConv
Mul_224 BPU id(0) HzLut
UNIT_CONV_FOR_Add_225 BPU id(0) HzSQuantizedConv
Conv_226 BPU id(0) HzSQuantizedConv
Mul_228 BPU id(0) HzLut
Conv_229 BPU id(0) HzSQuantizedConv
Mul_231 BPU id(0) HzLut
UNIT_CONV_FOR_Add_232 BPU id(0) HzSQuantizedConv
Conv_233 BPU id(0) HzSQuantizedConv
Mul_235 BPU id(0) HzLut
Conv_236 BPU id(0) HzSQuantizedConv
Mul_238 BPU id(0) HzLut
UNIT_CONV_FOR_Add_239 BPU id(0) HzSQuantizedConv
Conv_240 BPU id(0) HzSQuantizedConv
Mul_242 BPU id(0) HzLut
Conv_243 BPU id(0) HzSQuantizedConv
Mul_245 BPU id(0) HzLut
UNIT_CONV_FOR_Add_246 BPU id(0) HzSQuantizedConv
Conv_247 BPU id(0) HzSQuantizedConv
Mul_249 BPU id(0) HzLut
Conv_250 BPU id(0) HzSQuantizedConv
Mul_252 BPU id(0) HzLut
UNIT_CONV_FOR_Add_253 BPU id(0) HzSQuantizedConv
Conv_254 BPU id(0) HzSQuantizedConv
Mul_256 BPU id(0) HzLut
Conv_257 BPU id(0) HzSQuantizedConv
Mul_259 BPU id(0) HzLut
UNIT_CONV_FOR_Add_260 BPU id(0) HzSQuantizedConv
Conv_261 BPU id(0) HzSQuantizedConv
Mul_263 BPU id(0) HzLut
Conv_264 BPU id(0) HzSQuantizedConv
Mul_266 BPU id(0) HzLut
UNIT_CONV_FOR_Add_267 BPU id(0) HzSQuantizedConv
Conv_268 BPU id(0) HzSQuantizedConv
Mul_270 BPU id(0) HzLut
Conv_271 BPU id(0) HzSQuantizedConv
Mul_273 BPU id(0) HzLut
UNIT_CONV_FOR_Add_274 BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1129_0.14461_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_275 BPU id(0) Concat
Conv_276 BPU id(0) HzSQuantizedConv
Mul_278 BPU id(0) HzLut
Conv_279 BPU id(0) HzSQuantizedConv
Mul_281 BPU id(0) HzLut
Conv_282 BPU id(0) HzSQuantizedConv
Mul_284 BPU id(0) HzLut
MaxPool_285 BPU id(0) HzQuantizedMaxPool
MaxPool_286 BPU id(0) HzQuantizedMaxPool
MaxPool_287 BPU id(0) HzQuantizedMaxPool
...NV_FOR_onnx::MaxPool_1250_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1251_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1252_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1253_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_288 BPU id(0) Concat
Conv_289_split BPU id(0) Split
Conv_289_sub1 BPU id(0) HzSQuantizedConv
Conv_289_sub2 BPU id(0) HzSQuantizedConv
Mul_291 BPU id(0) HzLut
Conv_292 BPU id(0) HzSQuantizedConv
Mul_294 BPU id(0) HzLut
Conv_295 BPU id(0) HzSQuantizedConv
Mul_297 BPU id(0) HzLut
Conv_298 BPU id(0) HzSQuantizedConv
Mul_300 BPU id(0) HzLut
Conv_301 BPU id(0) HzSQuantizedConv
Mul_303 BPU id(0) HzLut
Conv_304 BPU id(0) HzSQuantizedConv
Mul_306 BPU id(0) HzLut
Conv_307 BPU id(0) HzSQuantizedConv
Mul_309 BPU id(0) HzLut
Conv_310 BPU id(0) HzSQuantizedConv
Mul_312 BPU id(0) HzLut
Conv_313 BPU id(0) HzSQuantizedConv
Mul_315 BPU id(0) HzLut
Conv_316 BPU id(0) HzSQuantizedConv
Mul_318 BPU id(0) HzLut
Conv_319 BPU id(0) HzSQuantizedConv
Mul_321 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1298_0.10651_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1266_0.10651_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_322 BPU id(0) Concat
Conv_323 BPU id(0) HzSQuantizedConv
Mul_325 BPU id(0) HzLut
Conv_326 BPU id(0) HzSQuantizedConv
Mul_328 BPU id(0) HzLut
Resize_330 BPU id(0) HzQuantizedResizeUpsample
...ONV_FOR_onnx::Concat_1312_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.539_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_331 BPU id(0) Concat
Conv_332 BPU id(0) HzSQuantizedConv
Mul_334 BPU id(0) HzLut
Conv_335 BPU id(0) HzSQuantizedConv
Mul_337 BPU id(0) HzLut
Conv_338 BPU id(0) HzSQuantizedConv
Mul_340 BPU id(0) HzLut
Conv_341 BPU id(0) HzSQuantizedConv
Mul_343 BPU id(0) HzLut
Conv_344 BPU id(0) HzSQuantizedConv
Mul_346 BPU id(0) HzLut
Conv_347 BPU id(0) HzSQuantizedConv
Mul_349 BPU id(0) HzLut
Conv_350 BPU id(0) HzSQuantizedConv
Mul_352 BPU id(0) HzLut
Conv_353 BPU id(0) HzSQuantizedConv
Mul_355 BPU id(0) HzLut
Conv_356 BPU id(0) HzSQuantizedConv
Mul_358 BPU id(0) HzLut
Conv_359 BPU id(0) HzSQuantizedConv
Mul_361 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1353_0.10959_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_362 BPU id(0) Concat
Conv_363 BPU id(0) HzSQuantizedConv
Mul_365 BPU id(0) HzLut
Conv_366 BPU id(0) HzSQuantizedConv
Mul_368 BPU id(0) HzLut
Resize_370 BPU id(0) HzQuantizedResizeUpsample
...ONV_FOR_onnx::Concat_1367_0.07821_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.319_0.07821_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_371 BPU id(0) Concat
Conv_372 BPU id(0) HzSQuantizedConv
Mul_374 BPU id(0) HzLut
Conv_375 BPU id(0) HzSQuantizedConv
Mul_377 BPU id(0) HzLut
Conv_378 BPU id(0) HzSQuantizedConv
Mul_380 BPU id(0) HzLut
Conv_381 BPU id(0) HzSQuantizedConv
Mul_383 BPU id(0) HzLut
Conv_384 BPU id(0) HzSQuantizedConv
Mul_386 BPU id(0) HzLut
Conv_387 BPU id(0) HzSQuantizedConv
Mul_389 BPU id(0) HzLut
Conv_390 BPU id(0) HzSQuantizedConv
Mul_392 BPU id(0) HzLut
Conv_393 BPU id(0) HzSQuantizedConv
Mul_395 BPU id(0) HzLut
Conv_396 BPU id(0) HzSQuantizedConv
Mul_398 BPU id(0) HzLut
Conv_399 BPU id(0) HzSQuantizedConv
Mul_401 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1408_0.08810_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1376_0.08810_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_402 BPU id(0) Concat
Conv_403 BPU id(0) HzSQuantizedConv
Mul_405 BPU id(0) HzLut
Conv_406 BPU id(0) HzSQuantizedConv
Mul_408 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1417_0.09117_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.751_0.09117_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_409 BPU id(0) Concat
Conv_410 BPU id(0) HzSQuantizedConv
Mul_412 BPU id(0) HzLut
Conv_413 BPU id(0) HzSQuantizedConv
Mul_415 BPU id(0) HzLut
Conv_416 BPU id(0) HzSQuantizedConv
Mul_418 BPU id(0) HzLut
Conv_419 BPU id(0) HzSQuantizedConv
Mul_421 BPU id(0) HzLut
Conv_422 BPU id(0) HzSQuantizedConv
Mul_424 BPU id(0) HzLut
Conv_425 BPU id(0) HzSQuantizedConv
Mul_427 BPU id(0) HzLut
Conv_428 BPU id(0) HzSQuantizedConv
Mul_430 BPU id(0) HzLut
Conv_431 BPU id(0) HzSQuantizedConv
Mul_433 BPU id(0) HzLut
Conv_434 BPU id(0) HzSQuantizedConv
Mul_436 BPU id(0) HzLut
Conv_437 BPU id(0) HzSQuantizedConv
Mul_439 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1458_0.07425_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
...ONV_FOR_onnx::Concat_1426_0.07425_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_440 BPU id(0) Concat
Conv_441 BPU id(0) HzSQuantizedConv
Mul_443 BPU id(0) HzLut
Conv_444 BPU id(0) HzSQuantizedConv
Mul_446 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1467_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.655_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_447 BPU id(0) Concat
Conv_448 BPU id(0) HzSQuantizedConv
Mul_450 BPU id(0) HzLut
Conv_451 BPU id(0) HzSQuantizedConv
Mul_453 BPU id(0) HzLut
Conv_454 BPU id(0) HzSQuantizedConv
Mul_456 BPU id(0) HzLut
Conv_457 BPU id(0) HzSQuantizedConv
Mul_459 BPU id(0) HzLut
Conv_460 BPU id(0) HzSQuantizedConv
Mul_462 BPU id(0) HzLut
Conv_463 BPU id(0) HzSQuantizedConv
Mul_465 BPU id(0) HzLut
Conv_466 BPU id(0) HzSQuantizedConv
Mul_468 BPU id(0) HzLut
Conv_469 BPU id(0) HzSQuantizedConv
Mul_471 BPU id(0) HzLut
Conv_472 BPU id(0) HzSQuantizedConv
Mul_474 BPU id(0) HzLut
Conv_475 BPU id(0) HzSQuantizedConv
Mul_477 BPU id(0) HzLut
...ONV_FOR_onnx::Concat_1476_0.08863_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_478 BPU id(0) Concat
Conv_479 BPU id(0) HzSQuantizedConv
Mul_481 BPU id(0) HzLut
Conv_482 BPU id(0) HzSQuantizedConv
Mul_484 BPU id(0) HzLut
Conv_485 BPU id(0) HzSQuantizedConv
Mul_487 BPU id(0) HzLut
Conv_488 BPU id(0) HzSQuantizedConv
Mul_490 BPU id(0) HzLut
Conv_491 BPU id(0) HzSQuantizedConv
Conv_492 BPU id(0) HzSQuantizedConv
Mul_494 BPU id(0) HzLut
Conv_495 BPU id(0) HzSQuantizedConv
Mul_497 BPU id(0) HzLut
Conv_498 BPU id(0) HzSQuantizedConv
Conv_499 BPU id(0) HzSQuantizedConv
Sigmoid_500 BPU id(0) HzLut
Sigmoid_501 BPU id(0) HzLut
Concat_502 CPU -- Concat
Conv_503 BPU id(0) HzSQuantizedConv
Mul_505 BPU id(0) HzLut
Conv_506 BPU id(0) HzSQuantizedConv
Mul_508 BPU id(0) HzLut
Conv_509 BPU id(0) HzSQuantizedConv
Mul_511 BPU id(0) HzLut
Conv_512 BPU id(0) HzSQuantizedConv
Conv_513 BPU id(0) HzSQuantizedConv
Mul_515 BPU id(0) HzLut
Conv_516 BPU id(0) HzSQuantizedConv
Mul_518 BPU id(0) HzLut
Conv_519 BPU id(0) HzSQuantizedConv
Conv_520 BPU id(0) HzSQuantizedConv
Sigmoid_521 BPU id(0) HzLut
Sigmoid_522 BPU id(0) HzLut
Concat_523 CPU -- Concat
Conv_524 BPU id(0) HzSQuantizedConv
Mul_526 BPU id(0) HzLut
Conv_527 BPU id(0) HzSQuantizedConv
Mul_529 BPU id(0) HzLut
Conv_530 BPU id(0) HzSQuantizedConv
Mul_532 BPU id(0) HzLut
Conv_533 BPU id(0) HzSQuantizedConv
Conv_534 BPU id(0) HzSQuantizedConv
Mul_536 BPU id(0) HzLut
Conv_537 BPU id(0) HzSQuantizedConv
Mul_539 BPU id(0) HzLut
Conv_540 BPU id(0) HzSQuantizedConv
Conv_541 BPU id(0) HzSQuantizedConv
Sigmoid_542 BPU id(0) HzLut
Sigmoid_543 BPU id(0) HzLut
Concat_544 CPU -- Concat
Reshape_552 CPU -- Reshape
Reshape_560 CPU -- Reshape
Reshape_568 CPU -- Reshape
Concat_569 CPU -- Concat
Transpose_570 CPU -- Transpose
2023-08-25 17:16:42,799 file: build.py func: build line No: 38 [Fri Aug 25 17:16:42 2023] End to Horizon NN Model Convert.
2023-08-25 17:16:42,832 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4122 ONNX model output num : 1
2023-08-25 17:16:42,930 file: onnx2horizonrt.py func: onnx2horizonrt line No: 3863 model_deps_info: {'hb_mapper_version': '1.17.4'}
2023-08-25 17:16:43,219 file: hb_mapper_checker.py func: hb_mapper_checker line No: 167 End model checking....
准备校准数据
python3.8 ./data_preprocess.py
- 输出结果：
regular preprocess
write:./calibration_data_bgr_f32/000000006818.bgr
write:./calibration_data_bgr_f32/000000016228.bgr
write:./calibration_data_bgr_f32/000000017627.bgr
write:./calibration_data_bgr_f32/000000025560.bgr
write:./calibration_data_bgr_f32/000000037777.bgr
write:./calibration_data_bgr_f32/000000041888.bgr
write:./calibration_data_bgr_f32/000000058636.bgr
write:./calibration_data_bgr_f32/000000085329.bgr
write:./calibration_data_bgr_f32/000000087038.bgr
write:./calibration_data_bgr_f32/000000122745.bgr
write:./calibration_data_bgr_f32/000000125211.bgr
write:./calibration_data_bgr_f32/000000143931.bgr
write:./calibration_data_bgr_f32/000000153299.bgr
write:./calibration_data_bgr_f32/000000174482.bgr
write:./calibration_data_bgr_f32/000000181666.bgr
write:./calibration_data_bgr_f32/000000184321.bgr
write:./calibration_data_bgr_f32/000000184791.bgr
write:./calibration_data_bgr_f32/000000185250.bgr
write:./calibration_data_bgr_f32/000000219578.bgr
write:./calibration_data_bgr_f32/000000226111.bgr
write:./calibration_data_bgr_f32/000000233771.bgr
write:./calibration_data_bgr_f32/000000239274.bgr
write:./calibration_data_bgr_f32/000000252219.bgr
write:./calibration_data_bgr_f32/000000266409.bgr
write:./calibration_data_bgr_f32/000000270244.bgr
write:./calibration_data_bgr_f32/000000286994.bgr
write:./calibration_data_bgr_f32/000000289393.bgr
write:./calibration_data_bgr_f32/000000296649.bgr
write:./calibration_data_bgr_f32/000000297343.bgr
write:./calibration_data_bgr_f32/000000301867.bgr
write:./calibration_data_bgr_f32/000000303818.bgr
write:./calibration_data_bgr_f32/000000308394.bgr
write:./calibration_data_bgr_f32/000000312421.bgr
write:./calibration_data_bgr_f32/000000314294.bgr
write:./calibration_data_bgr_f32/000000322864.bgr
write:./calibration_data_bgr_f32/000000329323.bgr
write:./calibration_data_bgr_f32/000000331352.bgr
write:./calibration_data_bgr_f32/000000336587.bgr
write:./calibration_data_bgr_f32/000000348881.bgr
write:./calibration_data_bgr_f32/000000356427.bgr
write:./calibration_data_bgr_f32/000000360661.bgr
write:./calibration_data_bgr_f32/000000382088.bgr
write:./calibration_data_bgr_f32/000000386912.bgr
write:./calibration_data_bgr_f32/000000397133.bgr
write:./calibration_data_bgr_f32/000000403385.bgr
write:./calibration_data_bgr_f32/000000403817.bgr
write:./calibration_data_bgr_f32/000000418281.bgr
write:./calibration_data_bgr_f32/000000443303.bgr
write:./calibration_data_bgr_f32/000000456496.bgr
write:./calibration_data_bgr_f32/000000458054.bgr
模型转换
hb_mapper makertbin --config ./yolox_x_config.yaml --model-type onnx
- 输出结果（等了好长时间~）：
2023-08-25 17:22:09,222 INFO log will be stored in /workspace/data/hb_mapper_makertbin.log
2023-08-25 17:22:09,223 INFO Start hb_mapper....
2023-08-25 17:22:09,223 INFO hbdk version 3.45.3
2023-08-25 17:22:09,223 INFO horizon_nn version 0.18.2
2023-08-25 17:22:09,223 INFO hb_mapper version 1.17.4
2023-08-25 17:22:09,223 INFO Start Model Convert....
2023-08-25 17:22:09,234 INFO Using onnx model file: /workspace/data/yolox_x_created.onnx
2023-08-25 17:22:09,740 INFO Model has 1 inputs according to model file
2023-08-25 17:22:09,740 INFO Model name not given in yaml_file, using model name from model file: ['images']
2023-08-25 17:22:09,740 INFO Model input shape not given in yaml_file, using shape from model file: [[1, 3, 640, 640]]
2023-08-25 17:22:09,741 INFO The calibration dir name suffix is the same as the value float32 of the cal_data_type parameter and will be read with the value of cal_data_type.
2023-08-25 17:22:09,741 INFO custom_op does not exist, skipped
2023-08-25 17:22:09,741 WARNING Input node images's input_source not set, it will be set to ddr by default
2023-08-25 17:22:09,745 INFO *******************************************
2023-08-25 17:22:09,745 INFO First calibration picture name: 000000006818.bgr
2023-08-25 17:22:09,745 INFO First calibration picture md5:
535830d27d3f863110d153c9f0eebf1c /workspace/data/calibration_data_bgr_f32/000000006818.bgr
2023-08-25 17:22:09,758 INFO *******************************************
2023-08-25 17:22:10,073 INFO [Fri Aug 25 17:22:10 2023] Start to Horizon NN Model Convert.
2023-08-25 17:22:10,073 INFO Loading horizon_nn debug methods:[]
2023-08-25 17:22:10,073 INFO Parsing the input parameter:{'images': {'input_shape': [1, 3, 640, 640], 'input_batch': 1, 'expected_input_type': 'BGR_128', 'original_input_type': 'BGR', 'original_input_layout': 'NCHW'}}
2023-08-25 17:22:10,074 INFO Parsing the calibration parameter
2023-08-25 17:22:10,074 INFO Parsing the hbdk parameter:{'hbdk_pass_through_params': '--O3 --core-num 2 --fast ', 'input-source': {'images': 'ddr', '_default_value': 'ddr'}}
2023-08-25 17:22:10,074 INFO HorizonNN version: 0.18.2
2023-08-25 17:22:10,074 INFO HBDK version: 3.45.3
2023-08-25 17:22:10,074 INFO [Fri Aug 25 17:22:10 2023] Start to parse the onnx model.
2023-08-25 17:22:10,521 INFO Input ONNX model infomation:
ONNX IR version: 6
Opset version: [11, 1]
Producer: pytorch1.11.0
Domain: none
Input name: images, [1, 3, 640, 640]
Output name: output, [1, 8400, 85]
2023-08-25 17:22:13,903 INFO [Fri Aug 25 17:22:13 2023] End to parse the onnx model.
2023-08-25 17:22:13,903 INFO Model input names parsed from model: ['images']
2023-08-25 17:22:13,903 INFO Create a preprocessing operator for input_name images with means=None, std=None, original_input_layout=NCHW, color convert from 'BGR' to 'BGR'.
2023-08-25 17:22:15,961 INFO Saving the original float model: yolox_x_created_original_float_model.onnx.
2023-08-25 17:22:15,962 INFO [Fri Aug 25 17:22:15 2023] Start to optimize the model.
Layer Conv_289
Expected data shape range of Kernel shape is [[1, 2048],[1, 7],[1, 7],[1, 2048]], but the data shape is [1280,1,1,2560]
Layer Conv_289
Expected data shape range of Kernel shape is [[1, 2048],[1, 7],[1, 7],[1, 2048]], but the data shape is [1280,1,1,2560]
2023-08-25 17:22:20,026 INFO [Fri Aug 25 17:22:20 2023] End to optimize the model.
2023-08-25 17:22:20,586 INFO Saving the optimized model: yolox_x_created_optimized_float_model.onnx.
2023-08-25 17:22:20,586 INFO [Fri Aug 25 17:22:20 2023] Start to calibrate the model.
2023-08-25 17:22:20,588 INFO There are 50 samples in the calibration data set.
2023-08-25 17:22:22,326 INFO Run calibration model with default calibration method.
2023-08-25 17:22:34,540 INFO Calibration using batch 8
Default calibration in progress: 0%| | 0/7 [00:00<?, ?it/s]2023-08-25 17:23:44.172943432 [E:onnxruntime:, sequential_executor.cc:183 Execute] Non-zero status code returned while running Reshape node. Name:'Reshape_568' Status Message: /home/jenkins/agent/workspace/model_convert/onnxruntime/onnxruntime/core/providers/cpu/tensor/reshape_helper.h:43 onnxruntime::ReshapeHelper::ReshapeHelper(const onnxruntime::TensorShape&, std::vector<long int>&) gsl::narrow_cast<int64_t>(input_shape.Size()) == size was false. The input tensor cannot be reshaped to the requested shape. Input shape:{8,85,20,20}, requested shape:{1,85,400}
Default calibration in progress: 0%| | 0/7 [01:07<?, ?it/s]
2023-08-25 17:23:44,175 INFO Above info is caused by batch mode infer and can be ignored
2023-08-25 17:23:44,175 INFO Reset batch_size=1 and execute calibration again...
Default calibration in progress: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 50/50 [11:39<00:00, 14.00s/it]
Killed
- 输出的hb_mapper_makertbin.log内容为：
2023-08-25 17:22:09,222 file: tool_utils.py func: tool_utils line No: 73 log will be stored in /workspace/data/hb_mapper_makertbin.log
2023-08-25 17:22:09,223 file: hb_mapper.py func: hb_mapper line No: 118 Start hb_mapper....
2023-08-25 17:22:09,223 file: hb_mapper.py func: hb_mapper line No: 119 hbdk version 3.45.3
2023-08-25 17:22:09,223 file: hb_mapper.py func: hb_mapper line No: 120 horizon_nn version 0.18.2
2023-08-25 17:22:09,223 file: hb_mapper.py func: hb_mapper line No: 121 hb_mapper version 1.17.4
2023-08-25 17:22:09,223 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 516 Start Model Convert....
2023-08-25 17:22:09,234 file: mapper_conf_parser.py func: mapper_conf_parser line No: 103 validating model_parameters...
2023-08-25 17:22:09,234 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1309 Using abs path /workspace/data/yolox_x_created.onnx
2023-08-25 17:22:09,234 file: mapper_conf_parser.py func: mapper_conf_parser line No: 257 Using onnx model file: /workspace/data/yolox_x_created.onnx
2023-08-25 17:22:09,739 file: helper.py func: helper line No: 145 Model input names: ['images']
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 261 Model has 1 inputs according to model file
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1309 Using abs path /workspace/data/model_out
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 465 node_dict: {self.node_dict}
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 118 validating model_parameters finished
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 122 validating input_parameters...
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 519 Model name not given in yaml_file, using model name from model file: ['images']
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 571 Model input shape not given in yaml_file, using shape from model file: [[1, 3, 640, 640]]
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 133 validating input_parameters finished
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 137 validating calibration_parameters...
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1309 Using abs path /workspace/data/calibration_data_bgr_f32
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1042 The calibration dir name suffix is the same as the value float32 of the cal_data_type parameter and will be read with the value of cal_data_type.
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 153 validating calibration_parameters finished
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 157 validating custom_op...
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1117 custom_op does not exist, skipped
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 163 validating custom_op finished
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 166 validating compiler_parameters...
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1198 Input node images's input_source not set, it will be set to ddr by default
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 180 validating compiler_parameters finished
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 184 validating deprecated parameters...
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 190 validating deprecated parameters finished
2023-08-25 17:22:09,741 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 57 Dump config:
2023-08-25 17:22:09,741 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 58 calibration_parameters:
cal_data_dir: ./calibration_data_bgr_f32
cal_data_type: float32
calibration_type: default
compiler_parameters:
compile_mode: latency
core_num: 2
debug: false
optimize_level: O3
input_parameters:
input_batch: '1'
input_layout_rt: NCHW
input_layout_train: NCHW
input_type_rt: bgr
input_type_train: bgr
norm_type: no_preprocess
model_parameters:
layer_out_dump: false
march: bernoulli2
onnx_model: ./yolox_x_created.onnx
output_model_file_prefix: yolox_x_created
working_dir: ./model_out
2023-08-25 17:22:09,745 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 63 input 'images' : original model shape: [1, 3, 640, 640]
2023-08-25 17:22:09,745 file: loader.py func: loader line No: 44 *******************************************
2023-08-25 17:22:09,745 file: loader.py func: loader line No: 45 First calibration picture name: 000000006818.bgr
2023-08-25 17:22:09,745 file: loader.py func: loader line No: 47 First calibration picture md5:
2023-08-25 17:22:09,758 file: loader.py func: loader line No: 51 *******************************************
2023-08-25 17:22:09,759 file: loader.py func: loader line No: 125 created RawImageDirLoader of shape:[1, 3, 640, 640]
2023-08-25 17:22:09,759 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000006818.bgr
2023-08-25 17:22:09,768 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000016228.bgr
2023-08-25 17:22:09,774 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000017627.bgr
2023-08-25 17:22:09,779 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000025560.bgr
2023-08-25 17:22:09,785 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000037777.bgr
2023-08-25 17:22:09,790 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000041888.bgr
2023-08-25 17:22:09,795 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000058636.bgr
2023-08-25 17:22:09,801 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000085329.bgr
2023-08-25 17:22:09,805 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000087038.bgr
2023-08-25 17:22:09,811 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000122745.bgr
2023-08-25 17:22:09,815 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000125211.bgr
2023-08-25 17:22:09,820 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000143931.bgr
2023-08-25 17:22:09,826 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000153299.bgr
2023-08-25 17:22:09,830 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000174482.bgr
2023-08-25 17:22:09,835 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000181666.bgr
2023-08-25 17:22:09,841 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000184321.bgr
2023-08-25 17:22:09,845 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000184791.bgr
2023-08-25 17:22:09,851 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000185250.bgr
2023-08-25 17:22:09,856 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000219578.bgr
2023-08-25 17:22:09,860 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000226111.bgr
2023-08-25 17:22:09,866 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000233771.bgr
2023-08-25 17:22:09,871 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000239274.bgr
2023-08-25 17:22:09,876 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000252219.bgr
2023-08-25 17:22:09,881 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000266409.bgr
2023-08-25 17:22:09,886 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000270244.bgr
2023-08-25 17:22:09,891 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000286994.bgr
2023-08-25 17:22:09,896 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000289393.bgr
2023-08-25 17:22:09,901 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000296649.bgr
2023-08-25 17:22:09,906 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000297343.bgr
2023-08-25 17:22:09,911 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000301867.bgr
2023-08-25 17:22:09,917 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000303818.bgr
2023-08-25 17:22:09,922 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000308394.bgr
2023-08-25 17:22:09,928 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000312421.bgr
2023-08-25 17:22:09,934 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000314294.bgr
2023-08-25 17:22:09,939 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000322864.bgr
2023-08-25 17:22:09,945 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000329323.bgr
2023-08-25 17:22:09,951 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000331352.bgr
2023-08-25 17:22:09,955 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000336587.bgr
2023-08-25 17:22:09,960 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000348881.bgr
2023-08-25 17:22:09,966 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000356427.bgr
2023-08-25 17:22:09,970 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000360661.bgr
2023-08-25 17:22:09,975 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000382088.bgr
2023-08-25 17:22:09,980 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000386912.bgr
2023-08-25 17:22:09,985 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000397133.bgr
2023-08-25 17:22:09,991 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000403385.bgr
2023-08-25 17:22:09,995 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000403817.bgr
2023-08-25 17:22:10,001 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000418281.bgr
2023-08-25 17:22:10,006 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000443303.bgr
2023-08-25 17:22:10,011 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000456496.bgr
2023-08-25 17:22:10,016 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000458054.bgr
2023-08-25 17:22:10,021 file: tool_utils.py func: tool_utils line No: 364 num of calibration data: 50
2023-08-25 17:22:10,022 file: tool_utils.py func: tool_utils line No: 365 calibration data shape: (1, 3, 640, 640)
2023-08-25 17:22:10,062 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 505 call build params:
{'march': 'bernoulli2', 'save_model': True, 'name_prefix': 'yolox_x_created', 'input_dict': {'images': {'input_shape': [1, 3, 640, 640], 'input_batch': 1, 'expected_input_type': 'BGR_128', 'original_input_type': 'BGR', 'original_input_layout': 'NCHW'}}, 'cali_dict': {'calibration_type': 'default', 'calibration_data': {'images': [array([[[[ 11., 30., 33., ..., -14., -14., -14.],
[ 13., 37., 50., ..., -14., -14., -14.],
[ 11., 34., 48., ..., -14., -14., -14.],
...,
[-46., -44., -42., ..., -14., -14., -14.],
[-45., -44., -43., ..., -14., -14., -14.],
[-42., -43., -43., ..., -14., -14., -14.]],
[[ -3., 17., 19., ..., -14., -14., -14.],
[ 1., 26., 38., ..., -14., -14., -14.],
[ 0., 23., 37., ..., -14., -14., -14.],
...,
[-72., -70., -68., ..., -14., -14., -14.],
[-71., -70., -69., ..., -14., -14., -14.],
[-71., -69., -69., ..., -14., -14., -14.]],
[[-22., -5., -4., ..., -14., -14., -14.],
[-23., -1., 10., ..., -14., -14., -14.],
[-28., -7., 5., ..., -14., -14., -14.],
...,
[-86., -84., -82., ..., -14., -14., -14.],
[-87., -86., -85., ..., -14., -14., -14.],
[-86., -85., -85., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-108., -108., -107., ..., -111., -109., -109.],
[-108., -108., -107., ..., -110., -108., -109.],
[-108., -108., -107., ..., -109., -108., -109.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-105., -105., -104., ..., -105., -103., -103.],
[-105., -105., -104., ..., -104., -102., -103.],
[-105., -105., -104., ..., -103., -102., -103.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-100., -100., -99., ..., -100., -98., -98.],
[-100., -100., -99., ..., -99., -97., -98.],
[-100., -100., -99., ..., -98., -97., -98.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-118., -119., -119., ..., 48., 38., 42.],
[-119., -118., -118., ..., 48., 48., 44.],
[-118., -118., -118., ..., 40., 36., 40.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-124., -123., -123., ..., -27., -38., -34.],
[-123., -122., -122., ..., -30., -30., -34.],
[-122., -122., -122., ..., -31., -35., -30.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-128., -128., -128., ..., -65., -74., -70.],
[-128., -127., -127., ..., -67., -66., -70.],
[-127., -127., -127., ..., -69., -72., -67.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -70., -66., -71., ..., -101., -102., -110.],
[ -67., -65., -71., ..., -111., -111., -115.],
[ -71., -67., -70., ..., -116., -112., -116.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -78., -75., -81., ..., -104., -103., -109.],
[ -76., -72., -80., ..., -115., -113., -117.],
[ -76., -75., -79., ..., -123., -117., -121.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -95., -89., -91., ..., -108., -107., -111.],
[ -90., -87., -90., ..., -116., -114., -117.],
[ -91., -88., -89., ..., -120., -115., -119.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 44., 42., 39., ..., 25., 27., 28.],
[ 44., 42., 40., ..., 25., 27., 28.],
[ 44., 42., 40., ..., 24., 26., 27.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 47., 45., 42., ..., 28., 30., 31.],
[ 47., 45., 43., ..., 28., 30., 31.],
[ 47., 46., 43., ..., 27., 29., 30.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 45., 43., 40., ..., 26., 28., 29.],
[ 45., 43., 41., ..., 26., 28., 28.],
[ 45., 44., 41., ..., 25., 27., 28.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[115., 114., 114., ..., 77., 89., 76.],
[113., 113., 113., ..., 105., 74., 80.],
[112., 112., 112., ..., 91., 66., 62.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[103., 103., 103., ..., 72., 76., 59.],
[101., 101., 102., ..., 97., 62., 66.],
[100., 100., 100., ..., 78., 54., 54.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 97., 95., 95., ..., 57., 68., 46.],
[ 95., 95., 94., ..., 84., 52., 54.],
[ 94., 94., 94., ..., 70., 42., 41.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 119., 119., 116., ..., -14., -14., -14.],
[ 121., 124., 126., ..., -14., -14., -14.],
[ 117., 117., 120., ..., -14., -14., -14.],
...,
[ 96., 90., 94., ..., -14., -14., -14.],
[ 14., 17., 16., ..., -14., -14., -14.],
[-128., -127., -128., ..., -14., -14., -14.]],
[[ 112., 112., 109., ..., -14., -14., -14.],
[ 114., 117., 119., ..., -14., -14., -14.],
[ 110., 110., 113., ..., -14., -14., -14.],
...,
[ 97., 91., 93., ..., -14., -14., -14.],
[ 13., 16., 13., ..., -14., -14., -14.],
[-128., -127., -128., ..., -14., -14., -14.]],
[[ 95., 95., 92., ..., -14., -14., -14.],
[ 97., 100., 102., ..., -14., -14., -14.],
[ 93., 93., 96., ..., -14., -14., -14.],
...,
[ 77., 71., 73., ..., -14., -14., -14.],
[ 9., 12., 9., ..., -14., -14., -14.],
[-127., -127., -128., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-123., -123., -123., ..., -123., -123., -123.],
[-123., -123., -123., ..., -123., -123., -123.],
[-123., -123., -123., ..., -123., -123., -123.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-122., -122., -122., ..., -122., -122., -122.],
[-122., -122., -122., ..., -122., -122., -122.],
[-122., -122., -122., ..., -122., -122., -122.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-124., -124., -124., ..., -124., -124., -124.],
[-124., -124., -124., ..., -124., -124., -124.],
[-124., -124., -124., ..., -124., -124., -124.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[112., 113., 113., ..., 105., 104., 103.],
[113., 113., 113., ..., 105., 104., 103.],
[113., 113., 113., ..., 105., 104., 103.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[112., 113., 113., ..., 103., 102., 101.],
[113., 113., 113., ..., 103., 102., 101.],
[113., 113., 113., ..., 103., 102., 101.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[112., 113., 113., ..., 102., 101., 100.],
[113., 113., 113., ..., 102., 101., 100.],
[113., 113., 113., ..., 102., 101., 100.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
...,
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.]],
[[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
...,
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.]],
[[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
...,
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.],
[-128., -128., -128., ..., -14., -14., -14.]]]], dtype=float32), array([[[[127., 125., 126., ..., 125., 127., 124.],
[127., 127., 126., ..., 125., 126., 125.],
[127., 127., 127., ..., 127., 125., 125.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[125., 125., 126., ..., 124., 126., 126.],
[125., 126., 127., ..., 126., 126., 127.],
[126., 126., 125., ..., 127., 126., 127.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[125., 125., 126., ..., 126., 127., 126.],
[124., 125., 125., ..., 124., 126., 127.],
[122., 122., 124., ..., 126., 124., 127.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-112., -126., -115., ..., 0., -8., 1.],
[ -67., -86., -118., ..., -1., -5., -2.],
[ -64., -41., -34., ..., -10., -1., -5.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-117., -124., -114., ..., -34., -29., -29.],
[ -91., -105., -112., ..., -26., -28., -32.],
[ -80., -88., -82., ..., -23., -32., -31.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-108., -116., -123., ..., -47., -50., -58.],
[-115., -113., -117., ..., -52., -50., -43.],
[-109., -119., -118., ..., -61., -57., -47.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 37., 59., 65., ..., -14., -14., -14.],
[ 42., 59., 64., ..., -14., -14., -14.],
[ 38., 57., 64., ..., -14., -14., -14.],
...,
[ 58., 61., 63., ..., -14., -14., -14.],
[ 59., 61., 62., ..., -14., -14., -14.],
[ 62., 63., 62., ..., -14., -14., -14.]],
[[ 42., 63., 73., ..., -14., -14., -14.],
[ 49., 66., 73., ..., -14., -14., -14.],
[ 51., 64., 73., ..., -14., -14., -14.],
...,
[ 78., 80., 81., ..., -14., -14., -14.],
[ 78., 80., 81., ..., -14., -14., -14.],
[ 81., 81., 81., ..., -14., -14., -14.]],
[[ 51., 62., 74., ..., -14., -14., -14.],
[ 54., 63., 73., ..., -14., -14., -14.],
[ 51., 60., 71., ..., -14., -14., -14.],
...,
[ 84., 87., 89., ..., -14., -14., -14.],
[ 85., 87., 88., ..., -14., -14., -14.],
[ 88., 88., 89., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-122., -125., -90., ..., -100., -94., -89.],
[-126., -125., -90., ..., -105., -99., -91.],
[-125., -124., -97., ..., -97., -80., -91.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-126., -116., -98., ..., -84., -83., -75.],
[-127., -116., -95., ..., -84., -83., -87.],
[-127., -128., -102., ..., -78., -71., -82.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-127., -119., -115., ..., -78., -79., -86.],
[-128., -119., -110., ..., -92., -77., -69.],
[-127., -122., -103., ..., -87., -68., -79.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 96., 97., 98., ..., 107., 107., 107.],
[ 99., 99., 99., ..., 106., 106., 106.],
[ 99., 99., 99., ..., 106., 106., 105.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 38., 39., 40., ..., 33., 33., 33.],
[ 41., 41., 41., ..., 33., 33., 33.],
[ 43., 43., 43., ..., 33., 33., 32.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 3., 4., 5., ..., -15., -15., -15.],
[ 6., 6., 6., ..., -17., -17., -17.],
[ 8., 8., 8., ..., -17., -17., -18.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 44., 43., 39., ..., 44., 44., 46.],
[ 43., 40., 38., ..., 42., 42., 46.],
[ 40., 36., 44., ..., 43., 43., 46.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 43., 45., 43., ..., 40., 40., 42.],
[ 45., 44., 42., ..., 38., 38., 42.],
[ 42., 40., 48., ..., 39., 39., 42.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 45., 46., 44., ..., 39., 39., 41.],
[ 46., 45., 43., ..., 37., 37., 41.],
[ 43., 41., 49., ..., 38., 38., 41.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 93., 92., 92., ..., 66., 66., 66.],
[ 94., 94., 93., ..., 67., 66., 66.],
[ 94., 94., 94., ..., 67., 66., 66.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 87., 86., 86., ..., 69., 69., 69.],
[ 88., 88., 87., ..., 70., 69., 69.],
[ 88., 88., 88., ..., 70., 69., 69.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 82., 81., 81., ..., 60., 60., 60.],
[ 83., 83., 82., ..., 61., 60., 60.],
[ 83., 83., 83., ..., 61., 60., 60.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 127., 127., 127., ..., -14., -14., -14.],
[ 127., 127., 127., ..., -14., -14., -14.],
[ 127., 127., 127., ..., -14., -14., -14.],
...,
[ -72., -111., -94., ..., -14., -14., -14.],
[ -99., -60., -73., ..., -14., -14., -14.],
[-122., -101., -118., ..., -14., -14., -14.]],
[[ 127., 127., 127., ..., -14., -14., -14.],
[ 127., 127., 127., ..., -14., -14., -14.],
[ 127., 127., 127., ..., -14., -14., -14.],
...,
[ 15., -21., -4., ..., -14., -14., -14.],
[ -30., 23., 16., ..., -14., -14., -14.],
[ -60., -13., -23., ..., -14., -14., -14.]],
[[ 127., 127., 127., ..., -14., -14., -14.],
[ 127., 127., 127., ..., -14., -14., -14.],
[ 127., 127., 127., ..., -14., -14., -14.],
...,
[ 12., -21., -4., ..., -14., -14., -14.],
[ -27., 21., 13., ..., -14., -14., -14.],
[ -60., -19., -30., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-55., -53., -52., ..., -43., -47., -43.],
[-57., -52., -54., ..., -54., -55., -60.],
[-46., -48., -54., ..., -37., -36., -45.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 54., 53., 51., ..., 78., 77., 76.],
[ 46., 53., 55., ..., 75., 77., 74.],
[ 56., 54., 51., ..., 76., 76., 72.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[106., 106., 106., ..., 118., 118., 121.],
[101., 110., 111., ..., 114., 117., 116.],
[115., 113., 108., ..., 119., 122., 117.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 125., 124., 124., ..., -14., -14., -14.],
[ 125., 124., 124., ..., -14., -14., -14.],
[ 125., 125., 124., ..., -14., -14., -14.],
...,
[ -99., -109., -105., ..., -14., -14., -14.],
[ -95., -88., -97., ..., -14., -14., -14.],
[ -88., -93., -99., ..., -14., -14., -14.]],
[[ 124., 123., 123., ..., -14., -14., -14.],
[ 125., 124., 124., ..., -14., -14., -14.],
[ 125., 125., 124., ..., -14., -14., -14.],
...,
[ -77., -89., -89., ..., -14., -14., -14.],
[ -69., -61., -73., ..., -14., -14., -14.],
[ -61., -64., -69., ..., -14., -14., -14.]],
[[ 120., 119., 119., ..., -14., -14., -14.],
[ 119., 118., 118., ..., -14., -14., -14.],
[ 119., 119., 118., ..., -14., -14., -14.],
...,
[ -29., -42., -42., ..., -14., -14., -14.],
[ -9., -4., -21., ..., -14., -14., -14.],
[ 13., 3., -10., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-124., -120., -121., ..., 101., 106., 114.],
[-123., -119., -115., ..., 103., 107., 113.],
[-120., -114., -108., ..., 102., 108., 113.],
...,
[ 94., 94., 94., ..., -126., -127., -128.],
[ 92., 93., 94., ..., -127., -127., -128.],
[ 93., 92., 90., ..., -128., -128., -128.]],
[[-124., -120., -121., ..., 101., 106., 114.],
[-123., -119., -115., ..., 103., 107., 113.],
[-120., -114., -108., ..., 102., 108., 113.],
...,
[ 94., 94., 94., ..., -126., -127., -128.],
[ 92., 93., 94., ..., -127., -127., -128.],
[ 93., 92., 90., ..., -128., -128., -128.]],
[[-124., -120., -121., ..., 101., 106., 114.],
[-123., -119., -115., ..., 103., 107., 113.],
[-120., -114., -108., ..., 102., 108., 113.],
...,
[ 94., 94., 94., ..., -126., -127., -128.],
[ 92., 93., 94., ..., -127., -127., -128.],
[ 93., 92., 90., ..., -128., -128., -128.]]]], dtype=float32), array([[[[ -5., -3., -5., ..., -14., -14., -14.],
[ -3., -3., -4., ..., -14., -14., -14.],
[ -4., -4., -1., ..., -14., -14., -14.],
...,
[ -81., -93., -98., ..., -14., -14., -14.],
[-128., -111., -128., ..., -14., -14., -14.],
[-128., -98., -126., ..., -14., -14., -14.]],
[[ -15., -17., -17., ..., -14., -14., -14.],
[ -12., -13., -17., ..., -14., -14., -14.],
[ -15., -12., -12., ..., -14., -14., -14.],
...,
[ -56., -79., -88., ..., -14., -14., -14.],
[-124., -99., -121., ..., -14., -14., -14.],
[-128., -109., -124., ..., -14., -14., -14.]],
[[ -55., -53., -59., ..., -14., -14., -14.],
[ -55., -60., -55., ..., -14., -14., -14.],
[ -53., -59., -56., ..., -14., -14., -14.],
...,
[ -66., -51., -70., ..., -14., -14., -14.],
[-128., -99., -127., ..., -14., -14., -14.],
[-118., -89., -123., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 89., 53., 11., ..., 52., 57., 56.],
[ 89., 52., 11., ..., 36., 39., 40.],
[ 89., 52., 12., ..., -81., -82., -80.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 72., 42., -20., ..., 25., 30., 30.],
[ 72., 41., -20., ..., 4., 7., 8.],
[ 72., 41., -19., ..., -86., -87., -85.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 59., 28., -29., ..., -85., -81., -84.],
[ 59., 27., -29., ..., -67., -66., -65.],
[ 59., 27., -28., ..., -87., -88., -86.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 67., 68., 68., ..., 51., 51., 45.],
[ 68., 69., 70., ..., 47., 47., 51.],
[ 71., 70., 70., ..., 48., 47., 55.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 40., 37., 35., ..., 21., 26., 20.],
[ 40., 38., 36., ..., 23., 23., 18.],
[ 39., 37., 35., ..., 24., 21., 21.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 13., 14., 15., ..., 2., 6., 0.],
[ 16., 17., 20., ..., 3., 3., 2.],
[ 20., 21., 21., ..., 6., 4., 5.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -57., -60., -60., ..., -65., -63., -57.],
[ -59., -61., -61., ..., -63., -62., -57.],
[ -64., -65., -65., ..., -58., -58., -58.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -53., -55., -55., ..., -76., -84., -87.],
[ -56., -54., -53., ..., -78., -83., -85.],
[ -59., -58., -59., ..., -80., -82., -83.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -88., -87., -86., ..., -126., -128., -128.],
[ -88., -91., -93., ..., -127., -128., -126.],
[ -98., -95., -94., ..., -128., -128., -127.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[104., 104., 105., ..., 90., 90., 94.],
[102., 102., 102., ..., 89., 92., 94.],
[102., 102., 103., ..., 90., 91., 94.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 85., 85., 86., ..., 71., 71., 73.],
[ 86., 86., 85., ..., 73., 73., 75.],
[ 86., 86., 86., ..., 74., 74., 75.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 70., 70., 73., ..., 56., 56., 58.],
[ 70., 70., 72., ..., 57., 58., 60.],
[ 70., 70., 73., ..., 61., 61., 62.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 58., 58., 58., ..., -87., -88., -90.],
[ 58., 58., 58., ..., -86., -86., -88.],
[ 59., 58., 58., ..., -86., -85., -86.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 57., 57., 58., ..., -27., -31., -34.],
[ 57., 58., 58., ..., -26., -29., -33.],
[ 59., 58., 58., ..., -26., -28., -31.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 66., 66., 64., ..., 127., 124., 121.],
[ 66., 64., 64., ..., 127., 126., 124.],
[ 65., 64., 64., ..., 127., 127., 126.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -1., 1., 1., ..., 112., 111., 110.],
[ 0., 0., -1., ..., 110., 109., 108.],
[ -1., -1., -4., ..., 109., 108., 107.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ -5., -3., -3., ..., 81., 80., 79.],
[ -4., -4., -5., ..., 80., 79., 78.],
[ -5., -5., -8., ..., 79., 78., 77.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ -6., -4., -4., ..., 56., 55., 54.],
[ -5., -5., -6., ..., 53., 52., 51.],
[ -6., -6., -9., ..., 50., 49., 48.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-123., -123., -124., ..., -48., -66., -79.],
[-122., -123., -121., ..., -64., -59., -51.],
[-123., -123., -121., ..., -54., -43., -40.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-122., -122., -123., ..., -9., -22., -35.],
[-121., -122., -121., ..., -27., -18., -16.],
[-122., -123., -121., ..., -15., -10., -21.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-124., -124., -125., ..., 43., 25., 6.],
[-123., -124., -121., ..., 25., 27., 24.],
[-124., -123., -121., ..., 37., 36., 22.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 2., 9., 11., ..., -18., -3., 65.],
[ 3., 12., 16., ..., -2., 10., 63.],
[-16., 4., 12., ..., -12., 5., 57.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 3., 10., 14., ..., 62., 64., 68.],
[ -3., 8., 15., ..., 60., 61., 67.],
[-11., 5., 9., ..., 60., 60., 64.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 1., 8., 12., ..., 45., 43., 53.],
[ 2., 13., 17., ..., 48., 47., 56.],
[ -8., 9., 11., ..., 40., 41., 51.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 67., -2., 37., ..., -14., -14., -14.],
[ 44., 20., 24., ..., -14., -14., -14.],
[ 26., 45., 36., ..., -14., -14., -14.],
...,
[-17., -11., -20., ..., -14., -14., -14.],
[-24., -40., -38., ..., -14., -14., -14.],
[-25., -19., -30., ..., -14., -14., -14.]],
[[ 91., 23., 62., ..., -14., -14., -14.],
[ 63., 39., 43., ..., -14., -14., -14.],
[ 43., 62., 54., ..., -14., -14., -14.],
...,
[-13., -6., -16., ..., -14., -14., -14.],
[-18., -36., -37., ..., -14., -14., -14.],
[-15., -15., -32., ..., -14., -14., -14.]],
[[ 97., 27., 66., ..., -14., -14., -14.],
[ 71., 46., 50., ..., -14., -14., -14.],
[ 52., 71., 61., ..., -14., -14., -14.],
...,
[-12., -3., -11., ..., -14., -14., -14.],
[-19., -35., -33., ..., -14., -14., -14.],
[-28., -21., -33., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -38., -42., -47., ..., -128., -128., -128.],
[ -55., -57., -59., ..., -127., -126., -128.],
[ -43., -47., -49., ..., -126., -127., -128.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -7., -11., -16., ..., -127., -127., -127.],
[ -12., -14., -15., ..., -126., -125., -127.],
[ -7., -11., -13., ..., -126., -127., -128.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 16., 12., 5., ..., -128., -128., -128.],
[ 7., 5., 2., ..., -128., -127., -128.],
[ 11., 7., 5., ..., -126., -127., -128.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[127., 127., 127., ..., 126., 126., 126.],
[127., 127., 127., ..., 126., 125., 122.],
[127., 127., 127., ..., 127., 124., 123.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[127., 127., 127., ..., 125., 125., 127.],
[127., 127., 127., ..., 126., 125., 124.],
[127., 127., 127., ..., 127., 127., 125.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[127., 127., 127., ..., 105., 104., 101.],
[127., 127., 127., ..., 108., 107., 104.],
[127., 127., 127., ..., 112., 112., 113.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 27., -21., -29., ..., -104., -77., -72.],
[ -8., 52., -42., ..., -107., -14., -15.],
[ -5., 36., -40., ..., -117., -73., 3.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 69., 38., 47., ..., -85., -60., -42.],
[ 49., 110., 23., ..., -86., 1., 7.],
[ 47., 83., 15., ..., -102., -59., 24.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 46., 34., 46., ..., -100., -73., -61.],
[ 18., 109., 24., ..., -108., -13., -12.],
[ 24., 87., 28., ..., -116., -70., 9.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 16., 35., 51., ..., -14., -14., -14.],
[ 13., 30., 49., ..., -14., -14., -14.],
[ 9., 25., 50., ..., -14., -14., -14.],
...,
[-22., -16., -16., ..., -14., -14., -14.],
[-21., -18., -27., ..., -14., -14., -14.],
[-14., -10., -26., ..., -14., -14., -14.]],
[[-10., 12., 22., ..., -14., -14., -14.],
[ -9., 11., 22., ..., -14., -14., -14.],
[ -9., 9., 26., ..., -14., -14., -14.],
...,
[-24., -18., -16., ..., -14., -14., -14.],
[-21., -18., -27., ..., -14., -14., -14.],
[-14., -10., -26., ..., -14., -14., -14.]],
[[-46., -20., -5., ..., -14., -14., -14.],
[-45., -24., -5., ..., -14., -14., -14.],
[-46., -27., -4., ..., -14., -14., -14.],
...,
[-24., -18., -16., ..., -14., -14., -14.],
[-21., -18., -27., ..., -14., -14., -14.],
[-14., -10., -26., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 119., 121., 118., ..., -14., -14., -14.],
[ 111., 122., 119., ..., -14., -14., -14.],
[ 108., 114., 125., ..., -14., -14., -14.],
...,
[ -96., -97., -97., ..., -14., -14., -14.],
[ -95., -97., -98., ..., -14., -14., -14.],
[ -96., -98., -99., ..., -14., -14., -14.]],
[[ 107., 109., 108., ..., -14., -14., -14.],
[ 101., 112., 109., ..., -14., -14., -14.],
[ 99., 105., 116., ..., -14., -14., -14.],
...,
[ -98., -99., -99., ..., -14., -14., -14.],
[ -97., -99., -100., ..., -14., -14., -14.],
[ -98., -100., -101., ..., -14., -14., -14.]],
[[ 97., 99., 98., ..., -14., -14., -14.],
[ 91., 102., 99., ..., -14., -14., -14.],
[ 89., 95., 106., ..., -14., -14., -14.],
...,
[ -98., -99., -99., ..., -14., -14., -14.],
[ -97., -99., -100., ..., -14., -14., -14.],
[ -98., -100., -101., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -73., -93., -100., ..., -14., -14., -14.],
[ -46., -54., -59., ..., -14., -14., -14.],
[ -25., -29., -35., ..., -14., -14., -14.],
...,
[ -43., -19., 53., ..., -14., -14., -14.],
[ -37., -12., 58., ..., -14., -14., -14.],
[ -38., -15., 55., ..., -14., -14., -14.]],
[[ -79., -98., -104., ..., -14., -14., -14.],
[ -41., -48., -51., ..., -14., -14., -14.],
[ -6., -9., -13., ..., -14., -14., -14.],
...,
[ -55., -26., 51., ..., -14., -14., -14.],
[ -49., -19., 55., ..., -14., -14., -14.],
[ -51., -23., 53., ..., -14., -14., -14.]],
[[ -84., -102., -106., ..., -14., -14., -14.],
[ -31., -36., -37., ..., -14., -14., -14.],
[ 17., 16., 14., ..., -14., -14., -14.],
...,
[ -55., -27., 48., ..., -14., -14., -14.],
[ -48., -19., 53., ..., -14., -14., -14.],
[ -49., -23., 51., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-33., -36., -32., ..., 127., 126., 126.],
[-33., -37., -32., ..., 127., 127., 126.],
[-39., -42., -41., ..., 127., 127., 127.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[-41., -44., -40., ..., 117., 116., 116.],
[-41., -45., -40., ..., 117., 117., 116.],
[-48., -51., -49., ..., 117., 117., 117.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[-40., -43., -39., ..., 110., 109., 109.],
[-40., -44., -39., ..., 110., 110., 109.],
[-45., -48., -48., ..., 110., 110., 110.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[126., 125., 124., ..., 125., 127., 127.],
[126., 125., 124., ..., 125., 127., 127.],
[124., 124., 123., ..., 126., 127., 127.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[117., 116., 115., ..., 124., 125., 126.],
[117., 116., 115., ..., 124., 125., 126.],
[115., 115., 114., ..., 126., 125., 126.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[114., 113., 112., ..., 120., 121., 121.],
[114., 113., 112., ..., 120., 121., 121.],
[112., 112., 111., ..., 120., 120., 121.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 91., 92., 92., ..., -75., -93., -99.],
[ 91., 92., 92., ..., -104., -98., -94.],
[ 91., 92., 92., ..., 14., -85., -33.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 77., 77., 77., ..., -57., -63., -62.],
[ 77., 77., 77., ..., -90., -55., -56.],
[ 77., 77., 77., ..., -18., -91., -33.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 59., 61., 61., ..., -70., -74., -72.],
[ 59., 61., 61., ..., -102., -70., -68.],
[ 59., 61., 61., ..., -23., -98., -39.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[105., 105., 106., ..., 105., 105., 107.],
[106., 106., 107., ..., 106., 106., 108.],
[107., 107., 107., ..., 106., 107., 108.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 72., 72., 73., ..., 72., 72., 74.],
[ 73., 73., 74., ..., 73., 73., 74.],
[ 74., 74., 74., ..., 74., 74., 75.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 23., 23., 24., ..., 26., 26., 28.],
[ 24., 24., 25., ..., 27., 27., 28.],
[ 25., 25., 25., ..., 25., 25., 26.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-53., -57., -53., ..., -32., -36., -40.],
[-57., -62., -60., ..., -38., -37., -40.],
[-60., -63., -58., ..., -35., -35., -40.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[-66., -62., -59., ..., -16., -22., -28.],
[-59., -61., -63., ..., -23., -23., -28.],
[-62., -62., -62., ..., -22., -21., -28.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[-74., -71., -64., ..., -23., -28., -34.],
[-70., -71., -71., ..., -27., -29., -34.],
[-73., -72., -67., ..., -24., -25., -34.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 28., 25., 27., ..., -10., 1., 17.],
[ 33., 27., 21., ..., 4., 0., 10.],
[ 19., 15., 3., ..., -3., 8., 4.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 4., 10., 17., ..., 11., 10., 12.],
[ 10., 13., 13., ..., 23., 9., 7.],
[ -3., 3., -5., ..., 16., 17., 3.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[ 36., 31., 29., ..., 13., 20., 33.],
[ 38., 31., 24., ..., 26., 18., 23.],
[ 26., 25., 12., ..., 21., 26., 19.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -51., -64., -71., ..., -114., -116., -113.],
[ -60., -55., -76., ..., -115., -118., -119.],
[ -60., -59., -83., ..., -121., -88., -72.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 0., -2., -17., ..., -116., -118., -115.],
[ 3., 8., -19., ..., -115., -118., -117.],
[ -2., 3., -24., ..., -122., -86., -68.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -4., -8., -24., ..., -117., -119., -116.],
[ -13., -8., -34., ..., -115., -118., -117.],
[ -13., -11., -39., ..., -120., -85., -67.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-36., -34., -32., ..., -39., -41., -47.],
[-33., -32., -30., ..., -34., -53., -49.],
[-33., -31., -30., ..., -40., -48., -46.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[-37., -35., -33., ..., -36., -38., -44.],
[-34., -33., -31., ..., -31., -49., -43.],
[-35., -32., -31., ..., -33., -41., -39.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[-41., -39., -37., ..., -38., -40., -46.],
[-38., -37., -35., ..., -33., -54., -48.],
[-36., -36., -35., ..., -40., -48., -46.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-128., -127., -127., ..., -124., -121., -118.],
[-128., -126., -127., ..., -124., -123., -120.],
[-128., -127., -126., ..., -122., -123., -120.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[-105., -106., -105., ..., -120., -119., -117.],
[-106., -101., -100., ..., -115., -116., -114.],
[-105., -101., -100., ..., -113., -115., -114.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -41., -47., -53., ..., -104., -100., -97.],
[ -50., -49., -54., ..., -113., -111., -109.],
[ -52., -52., -54., ..., -111., -111., -108.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 111., 111., 112., ..., -115., -116., -114.],
[ 112., 111., 111., ..., -114., -115., -115.],
[ 113., 112., 111., ..., -117., -115., -115.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 101., 101., 102., ..., -110., -112., -115.],
[ 102., 101., 101., ..., -109., -113., -116.],
[ 103., 102., 101., ..., -114., -112., -112.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 83., 83., 84., ..., -119., -117., -119.],
[ 84., 83., 83., ..., -118., -119., -120.],
[ 85., 84., 83., ..., -123., -121., -121.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -6., -3., -1., ..., -106., -105., -106.],
[ -5., -3., 0., ..., -105., -104., -106.],
[ -5., -3., 1., ..., -104., -104., -106.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 13., 12., 10., ..., -106., -107., -109.],
[ 13., 13., 11., ..., -105., -105., -107.],
[ 13., 13., 12., ..., -104., -104., -107.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ 10., 11., 11., ..., -86., -90., -94.],
[ 7., 9., 10., ..., -85., -88., -93.],
[ 5., 7., 9., ..., -84., -87., -92.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[119., 118., 118., ..., 122., 121., 121.],
[120., 119., 119., ..., 118., 118., 117.],
[116., 117., 117., ..., 115., 115., 114.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[119., 118., 118., ..., 122., 121., 121.],
[120., 119., 119., ..., 118., 118., 117.],
[116., 117., 117., ..., 115., 115., 114.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]],
[[119., 118., 118., ..., 122., 121., 121.],
[120., 119., 119., ..., 118., 118., 117.],
[116., 117., 117., ..., 115., 115., 114.],
...,
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.],
[-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -15., -11., -8., ..., -128., -125., -125.],
[ -15., -11., -7., ..., -128., -127., -124.],
[ -11., -10., -6., ..., -125., -126., -123.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -12., -10., -9., ..., -123., -123., -128.],
[ -12., -10., -8., ..., -124., -125., -124.],
[ -9., -8., -7., ..., -121., -124., -122.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]],
[[ -7., -6., -7., ..., -120., -122., -126.],
[ -8., -6., -6., ..., -123., -124., -124.],
[ -8., -7., -5., ..., -120., -124., -124.],
...,
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.],
[ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32)]}}, 'hbdk_dict': {'hbdk_pass_through_params': '--O3 --core-num 2 --fast ', 'input-source': {'images': 'ddr', '_default_value': 'ddr'}}, 'node_dict': {}, 'check_mode': False}
2023-08-25 17:22:10,073 file: build.py func: build line No: 35 [Fri Aug 25 17:22:10 2023] Start to Horizon NN Model Convert.
2023-08-25 17:22:10,073 file: model_debug.py func: model_debug line No: 61 Loading horizon_nn debug methods:[]
2023-08-25 17:22:10,073 file: dict_parser.py func: dict_parser line No: 33 Parsing the input parameter:{'images': {'input_shape': [1, 3, 640, 640], 'input_batch': 1, 'expected_input_type': 'BGR_128', 'original_input_type': 'BGR', 'original_input_layout': 'NCHW'}}
2023-08-25 17:22:10,074 file: build.py func: build line No: 186 Parsing the calibration parameter
2023-08-25 17:22:10,074 file: dict_parser.py func: dict_parser line No: 440 Parsing the hbdk parameter:{'hbdk_pass_through_params': '--O3 --core-num 2 --fast ', 'input-source': {'images': 'ddr', '_default_value': 'ddr'}}
2023-08-25 17:22:10,074 file: build.py func: build line No: 150 HorizonNN version: 0.18.2
2023-08-25 17:22:10,074 file: build.py func: build line No: 154 HBDK version: 3.45.3
2023-08-25 17:22:10,074 file: build.py func: build line No: 35 [Fri Aug 25 17:22:10 2023] Start to parse the onnx model.
2023-08-25 17:22:10,521 file: onnx_parser.py func: onnx_parser line No: 241 Input ONNX model infomation:
ONNX IR version: 6
Opset version: [11, 1]
Producer: pytorch1.11.0
Domain: none
Input name: images, [1, 3, 640, 640]
Output name: output, [1, 8400, 85]
2023-08-25 17:22:13,903 file: build.py func: build line No: 38 [Fri Aug 25 17:22:13 2023] End to parse the onnx model.
2023-08-25 17:22:13,903 file: build.py func: build line No: 217 Model input names parsed from model: ['images']
2023-08-25 17:22:13,903 file: dict_parser.py func: dict_parser line No: 247 Create a preprocessing operator for input_name images with means=None, std=None, original_input_layout=NCHW, color convert from 'BGR' to 'BGR'.
2023-08-25 17:22:15,961 file: build.py func: build line No: 464 Saving the original float model: yolox_x_created_original_float_model.onnx.
2023-08-25 17:22:15,962 file: build.py func: build line No: 35 [Fri Aug 25 17:22:15 2023] Start to optimize the model.
2023-08-25 17:22:20,026 file: build.py func: build line No: 38 [Fri Aug 25 17:22:20 2023] End to optimize the model.
2023-08-25 17:22:20,586 file: build.py func: build line No: 487 Saving the optimized model: yolox_x_created_optimized_float_model.onnx.
2023-08-25 17:22:20,586 file: build.py func: build line No: 35 [Fri Aug 25 17:22:20 2023] Start to calibrate the model.
2023-08-25 17:22:20,588 file: calibration_data_set.py func: calibration_data_set line No: 89 input name: images, number_of_samples: 50
2023-08-25 17:22:20,588 file: calibration_data_set.py func: calibration_data_set line No: 100 There are 50 samples in the calibration data set.
2023-08-25 17:22:22,326 file: default_calibrater.py func: default_calibrater line No: 145 Run calibration model with default calibration method.
2023-08-25 17:22:34,540 file: calibrater.py func: calibrater line No: 194 Calibration using batch 8
2023-08-25 17:23:44,174 file: calibrater.py func: calibrater line No: 217 [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running Reshape node. Name:'Reshape_568' Status Message: /home/jenkins/agent/workspace/model_convert/onnxruntime/onnxruntime/core/providers/cpu/tensor/reshape_helper.h:43 onnxruntime::ReshapeHelper::ReshapeHelper(const onnxruntime::TensorShape&, std::vector<long int>&) gsl::narrow_cast<int64_t>(input_shape.Size()) == size was false. The input tensor cannot be reshaped to the requested shape. Input shape:{8,85,20,20}, requested shape:{1,85,400}
2023-08-25 17:23:44,175 file: calibrater.py func: calibrater line No: 218 Above info is caused by batch mode infer and can be ignored
2023-08-25 17:23:44,175 file: calibrater.py func: calibrater line No: 220 Reset batch_size=1 and execute calibration again...
