- 芯片型号：Hobot X3 PI
- 天工开物开发包OpenExplorer版本：
- OE发布包: wget -c ftp://vrftp.horizon.ai/Open_Explorer_gcc_9.3.0/2.6.2b/horizon_xj3_open_explorer_v2.6.2b-py38_20230606.tar.gz
- CPU Docker: wget -c ftp://vrftp.horizon.ai/Open_Explorer_gcc_9.3.0/2.6.2b/docker_openexplorer_ubuntu_20_xj3_cpu_v2.6.2b.tar.gz
- Ai_Toolchain: https://pan.horizon.ai/index.php/s/iZwyzXoJLs8Btme?path=%2FAi_Toolchain_Package-release-v1.20.1-OE-v2.6.2b
- 问题定位：模型转换
- 问题具体描述：目的是在docker中将yolox.onnx文件转换为.bin文件；在运行“hb_mapper makertbin”时出现以下错误：
以下是模型转换的详细过程：
附件链接：
- 链接: https://pan.baidu.com/s/1jNdw41Kv-6Cf2l7oLxgCGw?pwd=jyni 提取码: jyni
运行docker容器进行模型转换
docker run -it \
-v /.../Ai_Toolchain_Package-release-v1.20.1-OE-v2.6.2b:/workspace/ai_toolchain \
-v /.../horizon_xj3_open_explorer_v2.6.2b-py38_20230606:/workspace/open_explorer \
-v /.../tiny_COCO:/workspace/data \
--name horzion_docker \
openexplorer/ai_toolchain_ubuntu_20_xj3_cpu:v2.6.2b \
/bin/bash
在docker容器中进入data目录
cd /workspace/data
模型验证
hb_mapper checker \
--model-type onnx \
--march bernoulli2 \
--model ./yolox_x_created.onnx \
--input-shape images 1x3x640x640
-
输出结果：
2023-08-25 17:14:43,246 INFO log will be stored in /workspace/data/hb_mapper_checker.log
2023-08-25 17:14:43,246 INFO Start hb_mapper…
2023-08-25 17:14:43,246 INFO hbdk version 3.45.3
2023-08-25 17:14:43,246 INFO horizon_nn version 0.18.2
2023-08-25 17:14:43,246 INFO hb_mapper version 1.17.4
2023-08-25 17:14:44,329 INFO Model type: onnx
2023-08-25 17:14:44,330 INFO input names [‘images’]
2023-08-25 17:14:44,330 INFO input shapes {‘images’: [1, 3, 640, 640]}
2023-08-25 17:14:44,781 INFO Begin model checking…
2023-08-25 17:14:44,792 INFO [Fri Aug 25 17:14:44 2023] Start to Horizon NN Model Convert.
2023-08-25 17:14:44,792 INFO Loading horizon_nn debug methods:
2023-08-25 17:14:44,792 INFO Parsing the input parameter:{‘images’: {‘input_shape’: [1, 3, 640, 640]}}
2023-08-25 17:14:44,793 INFO Parsing the hbdk parameter:{‘hbdk_pass_through_params’: ‘–O0’}
2023-08-25 17:14:44,793 INFO HorizonNN version: 0.18.2
2023-08-25 17:14:44,793 INFO HBDK version: 3.45.3
2023-08-25 17:14:44,793 INFO [Fri Aug 25 17:14:44 2023] Start to parse the onnx model.
2023-08-25 17:14:45,057 INFO Input ONNX model infomation:
ONNX IR version: 6
Opset version: [11, 1]
Producer: pytorch1.11.0
Domain: none
Input name: images, [1, 3, 640, 640]
Output name: output, [1, 8400, 85]
2023-08-25 17:14:48,338 INFO [Fri Aug 25 17:14:48 2023] End to parse the onnx model.
2023-08-25 17:14:48,338 INFO Model input names parsed from model: [‘images’]
2023-08-25 17:14:49,694 INFO Saving the original float model: ./.hb_check/original_float_model.onnx.
2023-08-25 17:14:49,695 INFO [Fri Aug 25 17:14:49 2023] Start to optimize the model.
Layer Conv_289
Expected data shape range of Kernel shape is [[1, 2048],[1, 7],[1, 7],[1, 2048]], but the data shape is [1280,1,1,2560]Layer Conv_289
Expected data shape range of Kernel shape is [[1, 2048],[1, 7],[1, 7],[1, 2048]], but the data shape is [1280,1,1,2560]2023-08-25 17:14:53,592 INFO [Fri Aug 25 17:14:53 2023] End to optimize the model.
2023-08-25 17:14:54,804 INFO Saving the optimized model: ./.hb_check/optimized_float_model.onnx.
2023-08-25 17:14:54,804 INFO [Fri Aug 25 17:14:54 2023] Start to calibrate the model.
2023-08-25 17:14:54,840 INFO There are 1 samples in the calibration data set.
2023-08-25 17:14:56,575 INFO Run calibration model with max method.
2023-08-25 17:14:59,271 INFO Calibration using batch 8
max calibration in progress: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:02<00:00, 2.58s/it]
2023-08-25 17:15:08,561 INFO Saving the calibrated model: ./.hb_check/calibrated_model.onnx.
2023-08-25 17:15:08,561 INFO [Fri Aug 25 17:15:08 2023] End to calibrate the model.
2023-08-25 17:15:08,561 INFO [Fri Aug 25 17:15:08 2023] Start to quantize the model.
2023-08-25 17:15:58,675 INFO [Fri Aug 25 17:15:58 2023] End to quantize the model.
2023-08-25 17:16:04,082 INFO Saving the quantized model: ./.hb_check/quantized_model.onnx.
2023-08-25 17:16:19,050 INFO [Fri Aug 25 17:16:19 2023] Start to compile the model with march bernoulli2.
2023-08-25 17:16:19,051 INFO [Fri Aug 25 17:16:19 2023] End to compile the model with march bernoulli2.
2023-08-25 17:16:24,759 INFO Compile submodel: torch-jit-export_subgraph_0
2023-08-25 17:16:33,186 INFO hbdk-cc parameters:[‘–O0’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NCHW’]
[==================================================] 100%
2023-08-25 17:16:39,251 INFO consumed time 5.84149
2023-08-25 17:16:40,465 INFO FPS=1.5, latency = 666675.6 us (see ./.hb_check/torch-jit-export_subgraph_0.html)
2023-08-25 17:16:42,794 INFO The converted model node information:Node ON Subgraph Type
Slice_4 BPU id(0) Slice
Slice_9 BPU id(0) Slice
Slice_14 BPU id(0) Slice
Slice_19 BPU id(0) Slice
Slice_24 BPU id(0) Slice
Slice_29 BPU id(0) Slice
Slice_34 BPU id(0) Slice
Slice_39 BPU id(0) Slice
Concat_40 BPU id(0) Concat
Conv_41 BPU id(0) HzSQuantizedConv
Mul_43 BPU id(0) HzLut
Conv_44 BPU id(0) HzSQuantizedConv
Mul_46 BPU id(0) HzLut
Conv_47 BPU id(0) HzSQuantizedConv
Mul_49 BPU id(0) HzLut
Conv_50 BPU id(0) HzSQuantizedConv
Mul_52 BPU id(0) HzLut
Conv_53 BPU id(0) HzSQuantizedConv
Mul_55 BPU id(0) HzLut
Conv_56 BPU id(0) HzSQuantizedConv
Mul_58 BPU id(0) HzLut
UNIT_CONV_FOR_Add_59 BPU id(0) HzSQuantizedConv
Conv_60 BPU id(0) HzSQuantizedConv
Mul_62 BPU id(0) HzLut
Conv_63 BPU id(0) HzSQuantizedConv
Mul_65 BPU id(0) HzLut
UNIT_CONV_FOR_Add_66 BPU id(0) HzSQuantizedConv
Conv_67 BPU id(0) HzSQuantizedConv
Mul_69 BPU id(0) HzLut
Conv_70 BPU id(0) HzSQuantizedConv
Mul_72 BPU id(0) HzLut
UNIT_CONV_FOR_Add_73 BPU id(0) HzSQuantizedConv
Conv_74 BPU id(0) HzSQuantizedConv
Mul_76 BPU id(0) HzLut
Conv_77 BPU id(0) HzSQuantizedConv
Mul_79 BPU id(0) HzLut
UNIT_CONV_FOR_Add_80 BPU id(0) HzSQuantizedConv
Concat_81 BPU id(0) Concat
Conv_82 BPU id(0) HzSQuantizedConv
Mul_84 BPU id(0) HzLut
Conv_85 BPU id(0) HzSQuantizedConv
Mul_87 BPU id(0) HzLut
Conv_88 BPU id(0) HzSQuantizedConv
Mul_90 BPU id(0) HzLut
Conv_91 BPU id(0) HzSQuantizedConv
Mul_93 BPU id(0) HzLut
Conv_94 BPU id(0) HzSQuantizedConv
Mul_96 BPU id(0) HzLut
Conv_97 BPU id(0) HzSQuantizedConv
Mul_99 BPU id(0) HzLut
UNIT_CONV_FOR_Add_100 BPU id(0) HzSQuantizedConv
Conv_101 BPU id(0) HzSQuantizedConv
Mul_103 BPU id(0) HzLut
Conv_104 BPU id(0) HzSQuantizedConv
Mul_106 BPU id(0) HzLut
UNIT_CONV_FOR_Add_107 BPU id(0) HzSQuantizedConv
Conv_108 BPU id(0) HzSQuantizedConv
Mul_110 BPU id(0) HzLut
Conv_111 BPU id(0) HzSQuantizedConv
Mul_113 BPU id(0) HzLut
UNIT_CONV_FOR_Add_114 BPU id(0) HzSQuantizedConv
Conv_115 BPU id(0) HzSQuantizedConv
Mul_117 BPU id(0) HzLut
Conv_118 BPU id(0) HzSQuantizedConv
Mul_120 BPU id(0) HzLut
UNIT_CONV_FOR_Add_121 BPU id(0) HzSQuantizedConv
Conv_122 BPU id(0) HzSQuantizedConv
Mul_124 BPU id(0) HzLut
Conv_125 BPU id(0) HzSQuantizedConv
Mul_127 BPU id(0) HzLut
UNIT_CONV_FOR_Add_128 BPU id(0) HzSQuantizedConv
Conv_129 BPU id(0) HzSQuantizedConv
Mul_131 BPU id(0) HzLut
Conv_132 BPU id(0) HzSQuantizedConv
Mul_134 BPU id(0) HzLut
UNIT_CONV_FOR_Add_135 BPU id(0) HzSQuantizedConv
Conv_136 BPU id(0) HzSQuantizedConv
Mul_138 BPU id(0) HzLut
Conv_139 BPU id(0) HzSQuantizedConv
Mul_141 BPU id(0) HzLut
UNIT_CONV_FOR_Add_142 BPU id(0) HzSQuantizedConv
Conv_143 BPU id(0) HzSQuantizedConv
Mul_145 BPU id(0) HzLut
Conv_146 BPU id(0) HzSQuantizedConv
Mul_148 BPU id(0) HzLut
UNIT_CONV_FOR_Add_149 BPU id(0) HzSQuantizedConv
Conv_150 BPU id(0) HzSQuantizedConv
Mul_152 BPU id(0) HzLut
Conv_153 BPU id(0) HzSQuantizedConv
Mul_155 BPU id(0) HzLut
UNIT_CONV_FOR_Add_156 BPU id(0) HzSQuantizedConv
Conv_157 BPU id(0) HzSQuantizedConv
Mul_159 BPU id(0) HzLut
Conv_160 BPU id(0) HzSQuantizedConv
Mul_162 BPU id(0) HzLut
UNIT_CONV_FOR_Add_163 BPU id(0) HzSQuantizedConv
Conv_164 BPU id(0) HzSQuantizedConv
Mul_166 BPU id(0) HzLut
Conv_167 BPU id(0) HzSQuantizedConv
Mul_169 BPU id(0) HzLut
UNIT_CONV_FOR_Add_170 BPU id(0) HzSQuantizedConv
Conv_171 BPU id(0) HzSQuantizedConv
Mul_173 BPU id(0) HzLut
Conv_174 BPU id(0) HzSQuantizedConv
Mul_176 BPU id(0) HzLut
UNIT_CONV_FOR_Add_177 BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1004_0.15844_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_178 BPU id(0) Concat
Conv_179 BPU id(0) HzSQuantizedConv
Mul_181 BPU id(0) HzLut
Conv_182 BPU id(0) HzSQuantizedConv
Mul_184 BPU id(0) HzLut
Conv_185 BPU id(0) HzSQuantizedConv
Mul_187 BPU id(0) HzLut
Conv_188 BPU id(0) HzSQuantizedConv
Mul_190 BPU id(0) HzLut
Conv_191 BPU id(0) HzSQuantizedConv
Mul_193 BPU id(0) HzLut
Conv_194 BPU id(0) HzSQuantizedConv
Mul_196 BPU id(0) HzLut
UNIT_CONV_FOR_Add_197 BPU id(0) HzSQuantizedConv
Conv_198 BPU id(0) HzSQuantizedConv
Mul_200 BPU id(0) HzLut
Conv_201 BPU id(0) HzSQuantizedConv
Mul_203 BPU id(0) HzLut
UNIT_CONV_FOR_Add_204 BPU id(0) HzSQuantizedConv
Conv_205 BPU id(0) HzSQuantizedConv
Mul_207 BPU id(0) HzLut
Conv_208 BPU id(0) HzSQuantizedConv
Mul_210 BPU id(0) HzLut
UNIT_CONV_FOR_Add_211 BPU id(0) HzSQuantizedConv
Conv_212 BPU id(0) HzSQuantizedConv
Mul_214 BPU id(0) HzLut
Conv_215 BPU id(0) HzSQuantizedConv
Mul_217 BPU id(0) HzLut
UNIT_CONV_FOR_Add_218 BPU id(0) HzSQuantizedConv
Conv_219 BPU id(0) HzSQuantizedConv
Mul_221 BPU id(0) HzLut
Conv_222 BPU id(0) HzSQuantizedConv
Mul_224 BPU id(0) HzLut
UNIT_CONV_FOR_Add_225 BPU id(0) HzSQuantizedConv
Conv_226 BPU id(0) HzSQuantizedConv
Mul_228 BPU id(0) HzLut
Conv_229 BPU id(0) HzSQuantizedConv
Mul_231 BPU id(0) HzLut
UNIT_CONV_FOR_Add_232 BPU id(0) HzSQuantizedConv
Conv_233 BPU id(0) HzSQuantizedConv
Mul_235 BPU id(0) HzLut
Conv_236 BPU id(0) HzSQuantizedConv
Mul_238 BPU id(0) HzLut
UNIT_CONV_FOR_Add_239 BPU id(0) HzSQuantizedConv
Conv_240 BPU id(0) HzSQuantizedConv
Mul_242 BPU id(0) HzLut
Conv_243 BPU id(0) HzSQuantizedConv
Mul_245 BPU id(0) HzLut
UNIT_CONV_FOR_Add_246 BPU id(0) HzSQuantizedConv
Conv_247 BPU id(0) HzSQuantizedConv
Mul_249 BPU id(0) HzLut
Conv_250 BPU id(0) HzSQuantizedConv
Mul_252 BPU id(0) HzLut
UNIT_CONV_FOR_Add_253 BPU id(0) HzSQuantizedConv
Conv_254 BPU id(0) HzSQuantizedConv
Mul_256 BPU id(0) HzLut
Conv_257 BPU id(0) HzSQuantizedConv
Mul_259 BPU id(0) HzLut
UNIT_CONV_FOR_Add_260 BPU id(0) HzSQuantizedConv
Conv_261 BPU id(0) HzSQuantizedConv
Mul_263 BPU id(0) HzLut
Conv_264 BPU id(0) HzSQuantizedConv
Mul_266 BPU id(0) HzLut
UNIT_CONV_FOR_Add_267 BPU id(0) HzSQuantizedConv
Conv_268 BPU id(0) HzSQuantizedConv
Mul_270 BPU id(0) HzLut
Conv_271 BPU id(0) HzSQuantizedConv
Mul_273 BPU id(0) HzLut
UNIT_CONV_FOR_Add_274 BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1129_0.14461_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_275 BPU id(0) Concat
Conv_276 BPU id(0) HzSQuantizedConv
Mul_278 BPU id(0) HzLut
Conv_279 BPU id(0) HzSQuantizedConv
Mul_281 BPU id(0) HzLut
Conv_282 BPU id(0) HzSQuantizedConv
Mul_284 BPU id(0) HzLut
MaxPool_285 BPU id(0) HzQuantizedMaxPool
MaxPool_286 BPU id(0) HzQuantizedMaxPool
MaxPool_287 BPU id(0) HzQuantizedMaxPool
…NV_FOR_onnx::MaxPool_1250_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1251_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1252_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1253_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_288 BPU id(0) Concat
Conv_289_split BPU id(0) Split
Conv_289_sub1 BPU id(0) HzSQuantizedConv
Conv_289_sub2 BPU id(0) HzSQuantizedConv
Mul_291 BPU id(0) HzLut
Conv_292 BPU id(0) HzSQuantizedConv
Mul_294 BPU id(0) HzLut
Conv_295 BPU id(0) HzSQuantizedConv
Mul_297 BPU id(0) HzLut
Conv_298 BPU id(0) HzSQuantizedConv
Mul_300 BPU id(0) HzLut
Conv_301 BPU id(0) HzSQuantizedConv
Mul_303 BPU id(0) HzLut
Conv_304 BPU id(0) HzSQuantizedConv
Mul_306 BPU id(0) HzLut
Conv_307 BPU id(0) HzSQuantizedConv
Mul_309 BPU id(0) HzLut
Conv_310 BPU id(0) HzSQuantizedConv
Mul_312 BPU id(0) HzLut
Conv_313 BPU id(0) HzSQuantizedConv
Mul_315 BPU id(0) HzLut
Conv_316 BPU id(0) HzSQuantizedConv
Mul_318 BPU id(0) HzLut
Conv_319 BPU id(0) HzSQuantizedConv
Mul_321 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1298_0.10651_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1266_0.10651_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_322 BPU id(0) Concat
Conv_323 BPU id(0) HzSQuantizedConv
Mul_325 BPU id(0) HzLut
Conv_326 BPU id(0) HzSQuantizedConv
Mul_328 BPU id(0) HzLut
Resize_330 BPU id(0) HzQuantizedResizeUpsample
…ONV_FOR_onnx::Concat_1312_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.539_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_331 BPU id(0) Concat
Conv_332 BPU id(0) HzSQuantizedConv
Mul_334 BPU id(0) HzLut
Conv_335 BPU id(0) HzSQuantizedConv
Mul_337 BPU id(0) HzLut
Conv_338 BPU id(0) HzSQuantizedConv
Mul_340 BPU id(0) HzLut
Conv_341 BPU id(0) HzSQuantizedConv
Mul_343 BPU id(0) HzLut
Conv_344 BPU id(0) HzSQuantizedConv
Mul_346 BPU id(0) HzLut
Conv_347 BPU id(0) HzSQuantizedConv
Mul_349 BPU id(0) HzLut
Conv_350 BPU id(0) HzSQuantizedConv
Mul_352 BPU id(0) HzLut
Conv_353 BPU id(0) HzSQuantizedConv
Mul_355 BPU id(0) HzLut
Conv_356 BPU id(0) HzSQuantizedConv
Mul_358 BPU id(0) HzLut
Conv_359 BPU id(0) HzSQuantizedConv
Mul_361 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1353_0.10959_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_362 BPU id(0) Concat
Conv_363 BPU id(0) HzSQuantizedConv
Mul_365 BPU id(0) HzLut
Conv_366 BPU id(0) HzSQuantizedConv
Mul_368 BPU id(0) HzLut
Resize_370 BPU id(0) HzQuantizedResizeUpsample
…ONV_FOR_onnx::Concat_1367_0.07821_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.319_0.07821_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_371 BPU id(0) Concat
Conv_372 BPU id(0) HzSQuantizedConv
Mul_374 BPU id(0) HzLut
Conv_375 BPU id(0) HzSQuantizedConv
Mul_377 BPU id(0) HzLut
Conv_378 BPU id(0) HzSQuantizedConv
Mul_380 BPU id(0) HzLut
Conv_381 BPU id(0) HzSQuantizedConv
Mul_383 BPU id(0) HzLut
Conv_384 BPU id(0) HzSQuantizedConv
Mul_386 BPU id(0) HzLut
Conv_387 BPU id(0) HzSQuantizedConv
Mul_389 BPU id(0) HzLut
Conv_390 BPU id(0) HzSQuantizedConv
Mul_392 BPU id(0) HzLut
Conv_393 BPU id(0) HzSQuantizedConv
Mul_395 BPU id(0) HzLut
Conv_396 BPU id(0) HzSQuantizedConv
Mul_398 BPU id(0) HzLut
Conv_399 BPU id(0) HzSQuantizedConv
Mul_401 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1408_0.08810_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1376_0.08810_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_402 BPU id(0) Concat
Conv_403 BPU id(0) HzSQuantizedConv
Mul_405 BPU id(0) HzLut
Conv_406 BPU id(0) HzSQuantizedConv
Mul_408 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1417_0.09117_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.751_0.09117_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_409 BPU id(0) Concat
Conv_410 BPU id(0) HzSQuantizedConv
Mul_412 BPU id(0) HzLut
Conv_413 BPU id(0) HzSQuantizedConv
Mul_415 BPU id(0) HzLut
Conv_416 BPU id(0) HzSQuantizedConv
Mul_418 BPU id(0) HzLut
Conv_419 BPU id(0) HzSQuantizedConv
Mul_421 BPU id(0) HzLut
Conv_422 BPU id(0) HzSQuantizedConv
Mul_424 BPU id(0) HzLut
Conv_425 BPU id(0) HzSQuantizedConv
Mul_427 BPU id(0) HzLut
Conv_428 BPU id(0) HzSQuantizedConv
Mul_430 BPU id(0) HzLut
Conv_431 BPU id(0) HzSQuantizedConv
Mul_433 BPU id(0) HzLut
Conv_434 BPU id(0) HzSQuantizedConv
Mul_436 BPU id(0) HzLut
Conv_437 BPU id(0) HzSQuantizedConv
Mul_439 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1458_0.07425_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1426_0.07425_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_440 BPU id(0) Concat
Conv_441 BPU id(0) HzSQuantizedConv
Mul_443 BPU id(0) HzLut
Conv_444 BPU id(0) HzSQuantizedConv
Mul_446 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1467_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.655_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_447 BPU id(0) Concat
Conv_448 BPU id(0) HzSQuantizedConv
Mul_450 BPU id(0) HzLut
Conv_451 BPU id(0) HzSQuantizedConv
Mul_453 BPU id(0) HzLut
Conv_454 BPU id(0) HzSQuantizedConv
Mul_456 BPU id(0) HzLut
Conv_457 BPU id(0) HzSQuantizedConv
Mul_459 BPU id(0) HzLut
Conv_460 BPU id(0) HzSQuantizedConv
Mul_462 BPU id(0) HzLut
Conv_463 BPU id(0) HzSQuantizedConv
Mul_465 BPU id(0) HzLut
Conv_466 BPU id(0) HzSQuantizedConv
Mul_468 BPU id(0) HzLut
Conv_469 BPU id(0) HzSQuantizedConv
Mul_471 BPU id(0) HzLut
Conv_472 BPU id(0) HzSQuantizedConv
Mul_474 BPU id(0) HzLut
Conv_475 BPU id(0) HzSQuantizedConv
Mul_477 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1476_0.08863_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_478 BPU id(0) Concat
Conv_479 BPU id(0) HzSQuantizedConv
Mul_481 BPU id(0) HzLut
Conv_482 BPU id(0) HzSQuantizedConv
Mul_484 BPU id(0) HzLut
Conv_485 BPU id(0) HzSQuantizedConv
Mul_487 BPU id(0) HzLut
Conv_488 BPU id(0) HzSQuantizedConv
Mul_490 BPU id(0) HzLut
Conv_491 BPU id(0) HzSQuantizedConv
Conv_492 BPU id(0) HzSQuantizedConv
Mul_494 BPU id(0) HzLut
Conv_495 BPU id(0) HzSQuantizedConv
Mul_497 BPU id(0) HzLut
Conv_498 BPU id(0) HzSQuantizedConv
Conv_499 BPU id(0) HzSQuantizedConv
Sigmoid_500 BPU id(0) HzLut
Sigmoid_501 BPU id(0) HzLut
Concat_502 CPU – Concat
Conv_503 BPU id(0) HzSQuantizedConv
Mul_505 BPU id(0) HzLut
Conv_506 BPU id(0) HzSQuantizedConv
Mul_508 BPU id(0) HzLut
Conv_509 BPU id(0) HzSQuantizedConv
Mul_511 BPU id(0) HzLut
Conv_512 BPU id(0) HzSQuantizedConv
Conv_513 BPU id(0) HzSQuantizedConv
Mul_515 BPU id(0) HzLut
Conv_516 BPU id(0) HzSQuantizedConv
Mul_518 BPU id(0) HzLut
Conv_519 BPU id(0) HzSQuantizedConv
Conv_520 BPU id(0) HzSQuantizedConv
Sigmoid_521 BPU id(0) HzLut
Sigmoid_522 BPU id(0) HzLut
Concat_523 CPU – Concat
Conv_524 BPU id(0) HzSQuantizedConv
Mul_526 BPU id(0) HzLut
Conv_527 BPU id(0) HzSQuantizedConv
Mul_529 BPU id(0) HzLut
Conv_530 BPU id(0) HzSQuantizedConv
Mul_532 BPU id(0) HzLut
Conv_533 BPU id(0) HzSQuantizedConv
Conv_534 BPU id(0) HzSQuantizedConv
Mul_536 BPU id(0) HzLut
Conv_537 BPU id(0) HzSQuantizedConv
Mul_539 BPU id(0) HzLut
Conv_540 BPU id(0) HzSQuantizedConv
Conv_541 BPU id(0) HzSQuantizedConv
Sigmoid_542 BPU id(0) HzLut
Sigmoid_543 BPU id(0) HzLut
Concat_544 CPU – Concat
Reshape_552 CPU – Reshape
Reshape_560 CPU – Reshape
Reshape_568 CPU – Reshape
Concat_569 CPU – Concat
Transpose_570 CPU – Transpose
2023-08-25 17:16:42,799 INFO [Fri Aug 25 17:16:42 2023] End to Horizon NN Model Convert.
2023-08-25 17:16:42,832 INFO ONNX model output num : 1
2023-08-25 17:16:43,219 INFO End model checking… -
输出的hb_mapper_checker.log内容为：
2023-08-25 17:14:43,246 file: tool_utils.py func: tool_utils line No: 73 log will be stored in /workspace/data/hb_mapper_checker.log
2023-08-25 17:14:43,246 file: hb_mapper.py func: hb_mapper line No: 70 Start hb_mapper…
2023-08-25 17:14:43,246 file: hb_mapper.py func: hb_mapper line No: 71 hbdk version 3.45.3
2023-08-25 17:14:43,246 file: hb_mapper.py func: hb_mapper line No: 72 horizon_nn version 0.18.2
2023-08-25 17:14:43,246 file: hb_mapper.py func: hb_mapper line No: 73 hb_mapper version 1.17.4
2023-08-25 17:14:44,305 file: helper.py func: helper line No: 145 Model input names: [‘images’]
2023-08-25 17:14:44,329 file: hb_mapper_checker.py func: hb_mapper_checker line No: 103 Model type: onnx
2023-08-25 17:14:44,330 file: hb_mapper_checker.py func: hb_mapper_checker line No: 104 march: bernoulli2
2023-08-25 17:14:44,330 file: hb_mapper_checker.py func: hb_mapper_checker line No: 109 input names [‘images’]
2023-08-25 17:14:44,330 file: hb_mapper_checker.py func: hb_mapper_checker line No: 110 input shapes {‘images’: [1, 3, 640, 640]}
2023-08-25 17:14:44,780 file: helper.py func: helper line No: 145 Model input names: [‘images’]
2023-08-25 17:14:44,781 file: hb_mapper_checker.py func: hb_mapper_checker line No: 116 Begin model checking…
2023-08-25 17:14:44,792 file: build.py func: build line No: 35 [Fri Aug 25 17:14:44 2023] Start to Horizon NN Model Convert.
2023-08-25 17:14:44,792 file: model_debug.py func: model_debug line No: 61 Loading horizon_nn debug methods:
2023-08-25 17:14:44,792 file: dict_parser.py func: dict_parser line No: 33 Parsing the input parameter:{‘images’: {‘input_shape’: [1, 3, 640, 640]}}
2023-08-25 17:14:44,793 file: dict_parser.py func: dict_parser line No: 440 Parsing the hbdk parameter:{‘hbdk_pass_through_params’: ‘–O0’}
2023-08-25 17:14:44,793 file: build.py func: build line No: 150 HorizonNN version: 0.18.2
2023-08-25 17:14:44,793 file: build.py func: build line No: 154 HBDK version: 3.45.3
2023-08-25 17:14:44,793 file: build.py func: build line No: 35 [Fri Aug 25 17:14:44 2023] Start to parse the onnx model.
2023-08-25 17:14:45,057 file: onnx_parser.py func: onnx_parser line No: 241 Input ONNX model infomation:
ONNX IR version: 6
Opset version: [11, 1]
Producer: pytorch1.11.0
Domain: none
Input name: images, [1, 3, 640, 640]
Output name: output, [1, 8400, 85]
2023-08-25 17:14:48,338 file: build.py func: build line No: 38 [Fri Aug 25 17:14:48 2023] End to parse the onnx model.
2023-08-25 17:14:48,338 file: build.py func: build line No: 217 Model input names parsed from model: [‘images’]
2023-08-25 17:14:49,694 file: build.py func: build line No: 464 Saving the original float model: ./.hb_check/original_float_model.onnx.
2023-08-25 17:14:49,695 file: build.py func: build line No: 35 [Fri Aug 25 17:14:49 2023] Start to optimize the model.
2023-08-25 17:14:53,592 file: build.py func: build line No: 38 [Fri Aug 25 17:14:53 2023] End to optimize the model.
2023-08-25 17:14:54,804 file: build.py func: build line No: 487 Saving the optimized model: ./.hb_check/optimized_float_model.onnx.
2023-08-25 17:14:54,804 file: build.py func: build line No: 35 [Fri Aug 25 17:14:54 2023] Start to calibrate the model.
2023-08-25 17:14:54,840 file: calibration_data_set.py func: calibration_data_set line No: 89 input name: images, number_of_samples: 1
2023-08-25 17:14:54,840 file: calibration_data_set.py func: calibration_data_set line No: 100 There are 1 samples in the calibration data set.
2023-08-25 17:14:56,575 file: max_calibrater.py func: max_calibrater line No: 74 Run calibration model with max method.
2023-08-25 17:14:59,271 file: calibrater.py func: calibrater line No: 194 Calibration using batch 8
2023-08-25 17:15:08,561 file: build.py func: build line No: 365 Saving the calibrated model: ./.hb_check/calibrated_model.onnx.
2023-08-25 17:15:08,561 file: build.py func: build line No: 38 [Fri Aug 25 17:15:08 2023] End to calibrate the model.
2023-08-25 17:15:08,561 file: build.py func: build line No: 35 [Fri Aug 25 17:15:08 2023] Start to quantize the model.
2023-08-25 17:15:58,675 file: build.py func: build line No: 38 [Fri Aug 25 17:15:58 2023] End to quantize the model.
2023-08-25 17:16:04,082 file: build.py func: build line No: 500 Saving the quantized model: ./.hb_check/quantized_model.onnx.
2023-08-25 17:16:19,050 file: build.py func: build line No: 35 [Fri Aug 25 17:16:19 2023] Start to compile the model with march bernoulli2.
2023-08-25 17:16:19,051 file: build.py func: build line No: 38 [Fri Aug 25 17:16:19 2023] End to compile the model with march bernoulli2.
2023-08-25 17:16:24,759 file: hybrid_build.py func: hybrid_build line No: 149 Compile submodel: torch-jit-export_subgraph_0
2023-08-25 17:16:33,186 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O0’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NCHW’]
2023-08-25 17:16:33,186 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_50jv6m8/torch-jit-export_subgraph_0.hbir -o /tmp/tmp_50jv6m8/torch-jit-export_subgraph_0.hbm --march bernoulli2 --progressbar --O0 --input-layout NHWC --output-layout NCHW
2023-08-25 17:16:39,251 file: tool_utils.py func: tool_utils line No: 322 consumed time 5.84149
2023-08-25 17:16:40,465 file: tool_utils.py func: tool_utils line No: 322 FPS=1.5, latency = 666675.6 us (see ./.hb_check/torch-jit-export_subgraph_0.html)
2023-08-25 17:16:42,794 file: node_info.py func: node_info line No: 55 The converted model node information:Node ON Subgraph Type
Slice_4 BPU id(0) Slice
Slice_9 BPU id(0) Slice
Slice_14 BPU id(0) Slice
Slice_19 BPU id(0) Slice
Slice_24 BPU id(0) Slice
Slice_29 BPU id(0) Slice
Slice_34 BPU id(0) Slice
Slice_39 BPU id(0) Slice
Concat_40 BPU id(0) Concat
Conv_41 BPU id(0) HzSQuantizedConv
Mul_43 BPU id(0) HzLut
Conv_44 BPU id(0) HzSQuantizedConv
Mul_46 BPU id(0) HzLut
Conv_47 BPU id(0) HzSQuantizedConv
Mul_49 BPU id(0) HzLut
Conv_50 BPU id(0) HzSQuantizedConv
Mul_52 BPU id(0) HzLut
Conv_53 BPU id(0) HzSQuantizedConv
Mul_55 BPU id(0) HzLut
Conv_56 BPU id(0) HzSQuantizedConv
Mul_58 BPU id(0) HzLut
UNIT_CONV_FOR_Add_59 BPU id(0) HzSQuantizedConv
Conv_60 BPU id(0) HzSQuantizedConv
Mul_62 BPU id(0) HzLut
Conv_63 BPU id(0) HzSQuantizedConv
Mul_65 BPU id(0) HzLut
UNIT_CONV_FOR_Add_66 BPU id(0) HzSQuantizedConv
Conv_67 BPU id(0) HzSQuantizedConv
Mul_69 BPU id(0) HzLut
Conv_70 BPU id(0) HzSQuantizedConv
Mul_72 BPU id(0) HzLut
UNIT_CONV_FOR_Add_73 BPU id(0) HzSQuantizedConv
Conv_74 BPU id(0) HzSQuantizedConv
Mul_76 BPU id(0) HzLut
Conv_77 BPU id(0) HzSQuantizedConv
Mul_79 BPU id(0) HzLut
UNIT_CONV_FOR_Add_80 BPU id(0) HzSQuantizedConv
Concat_81 BPU id(0) Concat
Conv_82 BPU id(0) HzSQuantizedConv
Mul_84 BPU id(0) HzLut
Conv_85 BPU id(0) HzSQuantizedConv
Mul_87 BPU id(0) HzLut
Conv_88 BPU id(0) HzSQuantizedConv
Mul_90 BPU id(0) HzLut
Conv_91 BPU id(0) HzSQuantizedConv
Mul_93 BPU id(0) HzLut
Conv_94 BPU id(0) HzSQuantizedConv
Mul_96 BPU id(0) HzLut
Conv_97 BPU id(0) HzSQuantizedConv
Mul_99 BPU id(0) HzLut
UNIT_CONV_FOR_Add_100 BPU id(0) HzSQuantizedConv
Conv_101 BPU id(0) HzSQuantizedConv
Mul_103 BPU id(0) HzLut
Conv_104 BPU id(0) HzSQuantizedConv
Mul_106 BPU id(0) HzLut
UNIT_CONV_FOR_Add_107 BPU id(0) HzSQuantizedConv
Conv_108 BPU id(0) HzSQuantizedConv
Mul_110 BPU id(0) HzLut
Conv_111 BPU id(0) HzSQuantizedConv
Mul_113 BPU id(0) HzLut
UNIT_CONV_FOR_Add_114 BPU id(0) HzSQuantizedConv
Conv_115 BPU id(0) HzSQuantizedConv
Mul_117 BPU id(0) HzLut
Conv_118 BPU id(0) HzSQuantizedConv
Mul_120 BPU id(0) HzLut
UNIT_CONV_FOR_Add_121 BPU id(0) HzSQuantizedConv
Conv_122 BPU id(0) HzSQuantizedConv
Mul_124 BPU id(0) HzLut
Conv_125 BPU id(0) HzSQuantizedConv
Mul_127 BPU id(0) HzLut
UNIT_CONV_FOR_Add_128 BPU id(0) HzSQuantizedConv
Conv_129 BPU id(0) HzSQuantizedConv
Mul_131 BPU id(0) HzLut
Conv_132 BPU id(0) HzSQuantizedConv
Mul_134 BPU id(0) HzLut
UNIT_CONV_FOR_Add_135 BPU id(0) HzSQuantizedConv
Conv_136 BPU id(0) HzSQuantizedConv
Mul_138 BPU id(0) HzLut
Conv_139 BPU id(0) HzSQuantizedConv
Mul_141 BPU id(0) HzLut
UNIT_CONV_FOR_Add_142 BPU id(0) HzSQuantizedConv
Conv_143 BPU id(0) HzSQuantizedConv
Mul_145 BPU id(0) HzLut
Conv_146 BPU id(0) HzSQuantizedConv
Mul_148 BPU id(0) HzLut
UNIT_CONV_FOR_Add_149 BPU id(0) HzSQuantizedConv
Conv_150 BPU id(0) HzSQuantizedConv
Mul_152 BPU id(0) HzLut
Conv_153 BPU id(0) HzSQuantizedConv
Mul_155 BPU id(0) HzLut
UNIT_CONV_FOR_Add_156 BPU id(0) HzSQuantizedConv
Conv_157 BPU id(0) HzSQuantizedConv
Mul_159 BPU id(0) HzLut
Conv_160 BPU id(0) HzSQuantizedConv
Mul_162 BPU id(0) HzLut
UNIT_CONV_FOR_Add_163 BPU id(0) HzSQuantizedConv
Conv_164 BPU id(0) HzSQuantizedConv
Mul_166 BPU id(0) HzLut
Conv_167 BPU id(0) HzSQuantizedConv
Mul_169 BPU id(0) HzLut
UNIT_CONV_FOR_Add_170 BPU id(0) HzSQuantizedConv
Conv_171 BPU id(0) HzSQuantizedConv
Mul_173 BPU id(0) HzLut
Conv_174 BPU id(0) HzSQuantizedConv
Mul_176 BPU id(0) HzLut
UNIT_CONV_FOR_Add_177 BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1004_0.15844_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_178 BPU id(0) Concat
Conv_179 BPU id(0) HzSQuantizedConv
Mul_181 BPU id(0) HzLut
Conv_182 BPU id(0) HzSQuantizedConv
Mul_184 BPU id(0) HzLut
Conv_185 BPU id(0) HzSQuantizedConv
Mul_187 BPU id(0) HzLut
Conv_188 BPU id(0) HzSQuantizedConv
Mul_190 BPU id(0) HzLut 链接: 百度网盘-链接不存在 提取码: jyni
Conv_191 BPU id(0) HzSQuantizedConv
Mul_193 BPU id(0) HzLut
Conv_194 BPU id(0) HzSQuantizedConv
Mul_196 BPU id(0) HzLut
UNIT_CONV_FOR_Add_197 BPU id(0) HzSQuantizedConv
Conv_198 BPU id(0) HzSQuantizedConv
Mul_200 BPU id(0) HzLut
Conv_201 BPU id(0) HzSQuantizedConv
Mul_203 BPU id(0) HzLut
UNIT_CONV_FOR_Add_204 BPU id(0) HzSQuantizedConv
Conv_205 BPU id(0) HzSQuantizedConv
Mul_207 BPU id(0) HzLut
Conv_208 BPU id(0) HzSQuantizedConv
Mul_210 BPU id(0) HzLut
UNIT_CONV_FOR_Add_211 BPU id(0) HzSQuantizedConv
Conv_212 BPU id(0) HzSQuantizedConv
Mul_214 BPU id(0) HzLut
Conv_215 BPU id(0) HzSQuantizedConv
Mul_217 BPU id(0) HzLut
UNIT_CONV_FOR_Add_218 BPU id(0) HzSQuantizedConv
Conv_219 BPU id(0) HzSQuantizedConv
Mul_221 BPU id(0) HzLut
Conv_222 BPU id(0) HzSQuantizedConv
Mul_224 BPU id(0) HzLut
UNIT_CONV_FOR_Add_225 BPU id(0) HzSQuantizedConv
Conv_226 BPU id(0) HzSQuantizedConv
Mul_228 BPU id(0) HzLut
Conv_229 BPU id(0) HzSQuantizedConv
Mul_231 BPU id(0) HzLut
UNIT_CONV_FOR_Add_232 BPU id(0) HzSQuantizedConv
Conv_233 BPU id(0) HzSQuantizedConv
Mul_235 BPU id(0) HzLut
Conv_236 BPU id(0) HzSQuantizedConv
Mul_238 BPU id(0) HzLut
UNIT_CONV_FOR_Add_239 BPU id(0) HzSQuantizedConv
Conv_240 BPU id(0) HzSQuantizedConv
Mul_242 BPU id(0) HzLut
Conv_243 BPU id(0) HzSQuantizedConv
Mul_245 BPU id(0) HzLut
UNIT_CONV_FOR_Add_246 BPU id(0) HzSQuantizedConv
Conv_247 BPU id(0) HzSQuantizedConv
Mul_249 BPU id(0) HzLut
Conv_250 BPU id(0) HzSQuantizedConv
Mul_252 BPU id(0) HzLut
UNIT_CONV_FOR_Add_253 BPU id(0) HzSQuantizedConv
Conv_254 BPU id(0) HzSQuantizedConv
Mul_256 BPU id(0) HzLut
Conv_257 BPU id(0) HzSQuantizedConv
Mul_259 BPU id(0) HzLut
UNIT_CONV_FOR_Add_260 BPU id(0) HzSQuantizedConv
Conv_261 BPU id(0) HzSQuantizedConv
Mul_263 BPU id(0) HzLut
Conv_264 BPU id(0) HzSQuantizedConv
Mul_266 BPU id(0) HzLut
UNIT_CONV_FOR_Add_267 BPU id(0) HzSQuantizedConv
Conv_268 BPU id(0) HzSQuantizedConv
Mul_270 BPU id(0) HzLut
Conv_271 BPU id(0) HzSQuantizedConv
Mul_273 BPU id(0) HzLut
UNIT_CONV_FOR_Add_274 BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1129_0.14461_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_275 BPU id(0) Concat
Conv_276 BPU id(0) HzSQuantizedConv
Mul_278 BPU id(0) HzLut
Conv_279 BPU id(0) HzSQuantizedConv
Mul_281 BPU id(0) HzLut
Conv_282 BPU id(0) HzSQuantizedConv
Mul_284 BPU id(0) HzLut
MaxPool_285 BPU id(0) HzQuantizedMaxPool
MaxPool_286 BPU id(0) HzQuantizedMaxPool
MaxPool_287 BPU id(0) HzQuantizedMaxPool
…NV_FOR_onnx::MaxPool_1250_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1251_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1252_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1253_0.03011_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_288 BPU id(0) Concat
Conv_289_split BPU id(0) Split
Conv_289_sub1 BPU id(0) HzSQuantizedConv
Conv_289_sub2 BPU id(0) HzSQuantizedConv
Mul_291 BPU id(0) HzLut
Conv_292 BPU id(0) HzSQuantizedConv
Mul_294 BPU id(0) HzLut
Conv_295 BPU id(0) HzSQuantizedConv
Mul_297 BPU id(0) HzLut
Conv_298 BPU id(0) HzSQuantizedConv
Mul_300 BPU id(0) HzLut
Conv_301 BPU id(0) HzSQuantizedConv
Mul_303 BPU id(0) HzLut
Conv_304 BPU id(0) HzSQuantizedConv
Mul_306 BPU id(0) HzLut
Conv_307 BPU id(0) HzSQuantizedConv
Mul_309 BPU id(0) HzLut
Conv_310 BPU id(0) HzSQuantizedConv
Mul_312 BPU id(0) HzLut
Conv_313 BPU id(0) HzSQuantizedConv
Mul_315 BPU id(0) HzLut
Conv_316 BPU id(0) HzSQuantizedConv
Mul_318 BPU id(0) HzLut
Conv_319 BPU id(0) HzSQuantizedConv
Mul_321 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1298_0.10651_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1266_0.10651_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_322 BPU id(0) Concat
Conv_323 BPU id(0) HzSQuantizedConv
Mul_325 BPU id(0) HzLut
Conv_326 BPU id(0) HzSQuantizedConv
Mul_328 BPU id(0) HzLut
Resize_330 BPU id(0) HzQuantizedResizeUpsample
…ONV_FOR_onnx::Concat_1312_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.539_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_331 BPU id(0) Concat
Conv_332 BPU id(0) HzSQuantizedConv
Mul_334 BPU id(0) HzLut
Conv_335 BPU id(0) HzSQuantizedConv
Mul_337 BPU id(0) HzLut
Conv_338 BPU id(0) HzSQuantizedConv
Mul_340 BPU id(0) HzLut
Conv_341 BPU id(0) HzSQuantizedConv
Mul_343 BPU id(0) HzLut
Conv_344 BPU id(0) HzSQuantizedConv
Mul_346 BPU id(0) HzLut
Conv_347 BPU id(0) HzSQuantizedConv
Mul_349 BPU id(0) HzLut
Conv_350 BPU id(0) HzSQuantizedConv
Mul_352 BPU id(0) HzLut
Conv_353 BPU id(0) HzSQuantizedConv
Mul_355 BPU id(0) HzLut
Conv_356 BPU id(0) HzSQuantizedConv
Mul_358 BPU id(0) HzLut
Conv_359 BPU id(0) HzSQuantizedConv
Mul_361 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1353_0.10959_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_362 BPU id(0) Concat
Conv_363 BPU id(0) HzSQuantizedConv
Mul_365 BPU id(0) HzLut
Conv_366 BPU id(0) HzSQuantizedConv
Mul_368 BPU id(0) HzLut
Resize_370 BPU id(0) HzQuantizedResizeUpsample
…ONV_FOR_onnx::Concat_1367_0.07821_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.319_0.07821_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_371 BPU id(0) Concat
Conv_372 BPU id(0) HzSQuantizedConv
Mul_374 BPU id(0) HzLut
Conv_375 BPU id(0) HzSQuantizedConv
Mul_377 BPU id(0) HzLut
Conv_378 BPU id(0) HzSQuantizedConv
Mul_380 BPU id(0) HzLut
Conv_381 BPU id(0) HzSQuantizedConv
Mul_383 BPU id(0) HzLut
Conv_384 BPU id(0) HzSQuantizedConv
Mul_386 BPU id(0) HzLut
Conv_387 BPU id(0) HzSQuantizedConv
Mul_389 BPU id(0) HzLut
Conv_390 BPU id(0) HzSQuantizedConv
Mul_392 BPU id(0) HzLut
Conv_393 BPU id(0) HzSQuantizedConv
Mul_395 BPU id(0) HzLut
Conv_396 BPU id(0) HzSQuantizedConv
Mul_398 BPU id(0) HzLut
Conv_399 BPU id(0) HzSQuantizedConv
Mul_401 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1408_0.08810_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1376_0.08810_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_402 BPU id(0) Concat
Conv_403 BPU id(0) HzSQuantizedConv
Mul_405 BPU id(0) HzLut
Conv_406 BPU id(0) HzSQuantizedConv
Mul_408 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1417_0.09117_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.751_0.09117_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_409 BPU id(0) Concat
Conv_410 BPU id(0) HzSQuantizedConv
Mul_412 BPU id(0) HzLut
Conv_413 BPU id(0) HzSQuantizedConv
Mul_415 BPU id(0) HzLut
Conv_416 BPU id(0) HzSQuantizedConv
Mul_418 BPU id(0) HzLut
Conv_419 BPU id(0) HzSQuantizedConv
Mul_421 BPU id(0) HzLut
Conv_422 BPU id(0) HzSQuantizedConv
Mul_424 BPU id(0) HzLut
Conv_425 BPU id(0) HzSQuantizedConv
Mul_427 BPU id(0) HzLut
Conv_428 BPU id(0) HzSQuantizedConv
Mul_430 BPU id(0) HzLut
Conv_431 BPU id(0) HzSQuantizedConv
Mul_433 BPU id(0) HzLut
Conv_434 BPU id(0) HzSQuantizedConv
Mul_436 BPU id(0) HzLut
Conv_437 BPU id(0) HzSQuantizedConv
Mul_439 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1458_0.07425_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
…ONV_FOR_onnx::Concat_1426_0.07425_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_440 BPU id(0) Concat
Conv_441 BPU id(0) HzSQuantizedConv
Mul_443 BPU id(0) HzLut
Conv_444 BPU id(0) HzSQuantizedConv
Mul_446 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1467_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
UNIT_CONV_FOR_input.655_0.09537_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_447 BPU id(0) Concat
Conv_448 BPU id(0) HzSQuantizedConv
Mul_450 BPU id(0) HzLut
Conv_451 BPU id(0) HzSQuantizedConv
Mul_453 BPU id(0) HzLut
Conv_454 BPU id(0) HzSQuantizedConv
Mul_456 BPU id(0) HzLut
Conv_457 BPU id(0) HzSQuantizedConv
Mul_459 BPU id(0) HzLut
Conv_460 BPU id(0) HzSQuantizedConv
Mul_462 BPU id(0) HzLut
Conv_463 BPU id(0) HzSQuantizedConv
Mul_465 BPU id(0) HzLut
Conv_466 BPU id(0) HzSQuantizedConv
Mul_468 BPU id(0) HzLut
Conv_469 BPU id(0) HzSQuantizedConv
Mul_471 BPU id(0) HzLut
Conv_472 BPU id(0) HzSQuantizedConv
Mul_474 BPU id(0) HzLut
Conv_475 BPU id(0) HzSQuantizedConv
Mul_477 BPU id(0) HzLut
…ONV_FOR_onnx::Concat_1476_0.08863_TO_FUSE_SCALE BPU id(0) HzSQuantizedConv
Concat_478 BPU id(0) Concat
Conv_479 BPU id(0) HzSQuantizedConv
Mul_481 BPU id(0) HzLut
Conv_482 BPU id(0) HzSQuantizedConv
Mul_484 BPU id(0) HzLut
Conv_485 BPU id(0) HzSQuantizedConv
Mul_487 BPU id(0) HzLut
Conv_488 BPU id(0) HzSQuantizedConv
Mul_490 BPU id(0) HzLut
Conv_491 BPU id(0) HzSQuantizedConv
Conv_492 BPU id(0) HzSQuantizedConv
Mul_494 BPU id(0) HzLut
Conv_495 BPU id(0) HzSQuantizedConv
Mul_497 BPU id(0) HzLut
Conv_498 BPU id(0) HzSQuantizedConv
Conv_499 BPU id(0) HzSQuantizedConv
Sigmoid_500 BPU id(0) HzLut
Sigmoid_501 BPU id(0) HzLut
Concat_502 CPU – Concat
Conv_503 BPU id(0) HzSQuantizedConv
Mul_505 BPU id(0) HzLut
Conv_506 BPU id(0) HzSQuantizedConv
Mul_508 BPU id(0) HzLut
Conv_509 BPU id(0) HzSQuantizedConv
Mul_511 BPU id(0) HzLut
Conv_512 BPU id(0) HzSQuantizedConv
Conv_513 BPU id(0) HzSQuantizedConv
Mul_515 BPU id(0) HzLut
Conv_516 BPU id(0) HzSQuantizedConv
Mul_518 BPU id(0) HzLut
Conv_519 BPU id(0) HzSQuantizedConv
Conv_520 BPU id(0) HzSQuantizedConv
Sigmoid_521 BPU id(0) HzLut
Sigmoid_522 BPU id(0) HzLut
Concat_523 CPU – Concat
Conv_524 BPU id(0) HzSQuantizedConv
Mul_526 BPU id(0) HzLut
Conv_527 BPU id(0) HzSQuantizedConv
Mul_529 BPU id(0) HzLut
Conv_530 BPU id(0) HzSQuantizedConv
Mul_532 BPU id(0) HzLut
Conv_533 BPU id(0) HzSQuantizedConv
Conv_534 BPU id(0) HzSQuantizedConv
Mul_536 BPU id(0) HzLut
Conv_537 BPU id(0) HzSQuantizedConv
Mul_539 BPU id(0) HzLut
Conv_540 BPU id(0) HzSQuantizedConv
Conv_541 BPU id(0) HzSQuantizedConv
Sigmoid_542 BPU id(0) HzLut
Sigmoid_543 BPU id(0) HzLut
Concat_544 CPU – Concat
Reshape_552 CPU – Reshape
Reshape_560 CPU – Reshape
Reshape_568 CPU – Reshape
Concat_569 CPU – Concat
Transpose_570 CPU – Transpose
2023-08-25 17:16:42,799 file: build.py func: build line No: 38 [Fri Aug 25 17:16:42 2023] End to Horizon NN Model Convert.
2023-08-25 17:16:42,832 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4122 ONNX model output num : 1
2023-08-25 17:16:42,930 file: onnx2horizonrt.py func: onnx2horizonrt line No: 3863 model_deps_info: {‘hb_mapper_version’: ‘1.17.4’}
2023-08-25 17:16:43,219 file: hb_mapper_checker.py func: hb_mapper_checker line No: 167 End model checking…
准备校准数据
python3.8 ./data_preprocess.py
-
输出结果：
regular preprocess
write:./calibration_data_bgr_f32/000000006818.bgr
write:./calibration_data_bgr_f32/000000016228.bgr
write:./calibration_data_bgr_f32/000000017627.bgr
write:./calibration_data_bgr_f32/000000025560.bgr
write:./calibration_data_bgr_f32/000000037777.bgr
write:./calibration_data_bgr_f32/000000041888.bgr
write:./calibration_data_bgr_f32/000000058636.bgr
write:./calibration_data_bgr_f32/000000085329.bgr
write:./calibration_data_bgr_f32/000000087038.bgr
write:./calibration_data_bgr_f32/000000122745.bgr
write:./calibration_data_bgr_f32/000000125211.bgr
write:./calibration_data_bgr_f32/000000143931.bgr
write:./calibration_data_bgr_f32/000000153299.bgr
write:./calibration_data_bgr_f32/000000174482.bgr
write:./calibration_data_bgr_f32/000000181666.bgr
write:./calibration_data_bgr_f32/000000184321.bgr
write:./calibration_data_bgr_f32/000000184791.bgr
write:./calibration_data_bgr_f32/000000185250.bgr
write:./calibration_data_bgr_f32/000000219578.bgr
write:./calibration_data_bgr_f32/000000226111.bgr
write:./calibration_data_bgr_f32/000000233771.bgr
write:./calibration_data_bgr_f32/000000239274.bgr
write:./calibration_data_bgr_f32/000000252219.bgr
write:./calibration_data_bgr_f32/000000266409.bgr
write:./calibration_data_bgr_f32/000000270244.bgr
write:./calibration_data_bgr_f32/000000286994.bgr
write:./calibration_data_bgr_f32/000000289393.bgr
write:./calibration_data_bgr_f32/000000296649.bgr
write:./calibration_data_bgr_f32/000000297343.bgr
write:./calibration_data_bgr_f32/000000301867.bgr
write:./calibration_data_bgr_f32/000000303818.bgr
write:./calibration_data_bgr_f32/000000308394.bgr
write:./calibration_data_bgr_f32/000000312421.bgr
write:./calibration_data_bgr_f32/000000314294.bgr
write:./calibration_data_bgr_f32/000000322864.bgr
write:./calibration_data_bgr_f32/000000329323.bgr
write:./calibration_data_bgr_f32/000000331352.bgr
write:./calibration_data_bgr_f32/000000336587.bgr
write:./calibration_data_bgr_f32/000000348881.bgr
write:./calibration_data_bgr_f32/000000356427.bgr
write:./calibration_data_bgr_f32/000000360661.bgr
write:./calibration_data_bgr_f32/000000382088.bgr
write:./calibration_data_bgr_f32/000000386912.bgr
write:./calibration_data_bgr_f32/000000397133.bgr
write:./calibration_data_bgr_f32/000000403385.bgr
write:./calibration_data_bgr_f32/000000403817.bgr
write:./calibration_data_bgr_f32/000000418281.bgr
write:./calibration_data_bgr_f32/000000443303.bgr
write:./calibration_data_bgr_f32/000000456496.bgr
write:./calibration_data_bgr_f32/000000458054.bgr
模型转换
hb_mapper makertbin --config ./yolox_x_config.yaml --model-type onnx
-
输出结果（等了好长时间~）：
2023-08-25 17:22:09,222 INFO log will be stored in /workspace/data/hb_mapper_makertbin.log
2023-08-25 17:22:09,223 INFO Start hb_mapper…
2023-08-25 17:22:09,223 INFO hbdk version 3.45.3
2023-08-25 17:22:09,223 INFO horizon_nn version 0.18.2
2023-08-25 17:22:09,223 INFO hb_mapper version 1.17.4
2023-08-25 17:22:09,223 INFO Start Model Convert…
2023-08-25 17:22:09,234 INFO Using onnx model file: /workspace/data/yolox_x_created.onnx
2023-08-25 17:22:09,740 INFO Model has 1 inputs according to model file
2023-08-25 17:22:09,740 INFO Model name not given in yaml_file, using model name from model file: [‘images’]
2023-08-25 17:22:09,740 INFO Model input shape not given in yaml_file, using shape from model file: [[1, 3, 640, 640]]
2023-08-25 17:22:09,741 INFO The calibration dir name suffix is the same as the value float32 of the cal_data_type parameter and will be read with the value of cal_data_type.
2023-08-25 17:22:09,741 INFO custom_op does not exist, skipped
2023-08-25 17:22:09,741 WARNING Input node images’s input_source not set, it will be set to ddr by default
2023-08-25 17:22:09,745 INFO *******************************************
2023-08-25 17:22:09,745 INFO First calibration picture name: 000000006818.bgr
2023-08-25 17:22:09,745 INFO First calibration picture md5:
535830d27d3f863110d153c9f0eebf1c /workspace/data/calibration_data_bgr_f32/000000006818.bgr
2023-08-25 17:22:09,758 INFO *******************************************
2023-08-25 17:22:10,073 INFO [Fri Aug 25 17:22:10 2023] Start to Horizon NN Model Convert.
2023-08-25 17:22:10,073 INFO Loading horizon_nn debug methods:
2023-08-25 17:22:10,073 INFO Parsing the input parameter:{‘images’: {‘input_shape’: [1, 3, 640, 640], ‘input_batch’: 1, ‘expected_input_type’: ‘BGR_128’, ‘original_input_type’: ‘BGR’, ‘original_input_layout’: ‘NCHW’}}
2023-08-25 17:22:10,074 INFO Parsing the calibration parameter
2023-08-25 17:22:10,074 INFO Parsing the hbdk parameter:{‘hbdk_pass_through_params’: '–O3 --core-num 2 --fast ', ‘input-source’: {‘images’: ‘ddr’, ‘_default_value’: ‘ddr’}}
2023-08-25 17:22:10,074 INFO HorizonNN version: 0.18.2
2023-08-25 17:22:10,074 INFO HBDK version: 3.45.3
2023-08-25 17:22:10,074 INFO [Fri Aug 25 17:22:10 2023] Start to parse the onnx model.
2023-08-25 17:22:10,521 INFO Input ONNX model infomation:
ONNX IR version: 6
Opset version: [11, 1]
Producer: pytorch1.11.0
Domain: none
Input name: images, [1, 3, 640, 640]
Output name: output, [1, 8400, 85]
2023-08-25 17:22:13,903 INFO [Fri Aug 25 17:22:13 2023] End to parse the onnx model.
2023-08-25 17:22:13,903 INFO Model input names parsed from model: [‘images’]
2023-08-25 17:22:13,903 INFO Create a preprocessing operator for input_name images with means=None, std=None, original_input_layout=NCHW, color convert from ‘BGR’ to ‘BGR’.
2023-08-25 17:22:15,961 INFO Saving the original float model: yolox_x_created_original_float_model.onnx.
2023-08-25 17:22:15,962 INFO [Fri Aug 25 17:22:15 2023] Start to optimize the model.
Layer Conv_289
Expected data shape range of Kernel shape is [[1, 2048],[1, 7],[1, 7],[1, 2048]], but the data shape is [1280,1,1,2560]Layer Conv_289
Expected data shape range of Kernel shape is [[1, 2048],[1, 7],[1, 7],[1, 2048]], but the data shape is [1280,1,1,2560]2023-08-25 17:22:20,026 INFO [Fri Aug 25 17:22:20 2023] End to optimize the model.
2023-08-25 17:22:20,586 INFO Saving the optimized model: yolox_x_created_optimized_float_model.onnx.
2023-08-25 17:22:20,586 INFO [Fri Aug 25 17:22:20 2023] Start to calibrate the model.
2023-08-25 17:22:20,588 INFO There are 50 samples in the calibration data set.
2023-08-25 17:22:22,326 INFO Run calibration model with default calibration method.
2023-08-25 17:22:34,540 INFO Calibration using batch 8
Default calibration in progress: 0%| | 0/7 [00:00<?, ?it/s]2023-08-25 17:23:44.172943432 [E:onnxruntime:, sequential_executor.cc:183 Execute] Non-zero status code returned while running Reshape node. Name:‘Reshape_568’ Status Message: /home/jenkins/agent/workspace/model_convert/onnxruntime/onnxruntime/core/providers/cpu/tensor/reshape_helper.h:43 onnxruntime::ReshapeHelper::ReshapeHelper(const onnxruntime::TensorShape&, std::vector&) gsl::narrow_cast<int64_t>(input_shape.Size()) == size was false. The input tensor cannot be reshaped to the requested shape. Input shape:{8,85,20,20}, requested shape:{1,85,400}Default calibration in progress: 0%| | 0/7 [01:07<?, ?it/s]
2023-08-25 17:23:44,175 INFO Above info is caused by batch mode infer and can be ignored
2023-08-25 17:23:44,175 INFO Reset batch_size=1 and execute calibration again…
Default calibration in progress: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 50/50 [11:39<00:00, 14.00s/it]
Killed -
输出的hb_mapper_makertbin.log内容为：
2023-08-25 17:22:09,222 file: tool_utils.py func: tool_utils line No: 73 log will be stored in /workspace/data/hb_mapper_makertbin.log
2023-08-25 17:22:09,223 file: hb_mapper.py func: hb_mapper line No: 118 Start hb_mapper…
2023-08-25 17:22:09,223 file: hb_mapper.py func: hb_mapper line No: 119 hbdk version 3.45.3
2023-08-25 17:22:09,223 file: hb_mapper.py func: hb_mapper line No: 120 horizon_nn version 0.18.2
2023-08-25 17:22:09,223 file: hb_mapper.py func: hb_mapper line No: 121 hb_mapper version 1.17.4
2023-08-25 17:22:09,223 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 516 Start Model Convert…
2023-08-25 17:22:09,234 file: mapper_conf_parser.py func: mapper_conf_parser line No: 103 validating model_parameters…
2023-08-25 17:22:09,234 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1309 Using abs path /workspace/data/yolox_x_created.onnx
2023-08-25 17:22:09,234 file: mapper_conf_parser.py func: mapper_conf_parser line No: 257 Using onnx model file: /workspace/data/yolox_x_created.onnx
2023-08-25 17:22:09,739 file: helper.py func: helper line No: 145 Model input names: [‘images’]
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 261 Model has 1 inputs according to model file
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1309 Using abs path /workspace/data/model_out
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 465 node_dict: {self.node_dict}
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 118 validating model_parameters finished
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 122 validating input_parameters…
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 519 Model name not given in yaml_file, using model name from model file: [‘images’]
2023-08-25 17:22:09,740 file: mapper_conf_parser.py func: mapper_conf_parser line No: 571 Model input shape not given in yaml_file, using shape from model file: [[1, 3, 640, 640]]
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 133 validating input_parameters finished
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 137 validating calibration_parameters…
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1309 Using abs path /workspace/data/calibration_data_bgr_f32
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1042 The calibration dir name suffix is the same as the value float32 of the cal_data_type parameter and will be read with the value of cal_data_type.
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 153 validating calibration_parameters finished
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 157 validating custom_op…
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1117 custom_op does not exist, skipped
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 163 validating custom_op finished
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 166 validating compiler_parameters…
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1198 Input node images’s input_source not set, it will be set to ddr by default
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 180 validating compiler_parameters finished
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 184 validating deprecated parameters…
2023-08-25 17:22:09,741 file: mapper_conf_parser.py func: mapper_conf_parser line No: 190 validating deprecated parameters finished
2023-08-25 17:22:09,741 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 57 Dump config:
2023-08-25 17:22:09,741 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 58 calibration_parameters:
cal_data_dir: ./calibration_data_bgr_f32
cal_data_type: float32
calibration_type: default
compiler_parameters:
compile_mode: latency
core_num: 2
debug: false
optimize_level: O3
input_parameters:
input_batch: ‘1’
input_layout_rt: NCHW
input_layout_train: NCHW
input_type_rt: bgr
input_type_train: bgr
norm_type: no_preprocess
model_parameters:
layer_out_dump: false
march: bernoulli2
onnx_model: ./yolox_x_created.onnx
output_model_file_prefix: yolox_x_created
working_dir: ./model_out2023-08-25 17:22:09,745 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 63 input ‘images’ : original model shape: [1, 3, 640, 640]
2023-08-25 17:22:09,745 file: loader.py func: loader line No: 44 *******************************************
2023-08-25 17:22:09,745 file: loader.py func: loader line No: 45 First calibration picture name: 000000006818.bgr
2023-08-25 17:22:09,745 file: loader.py func: loader line No: 47 First calibration picture md5:
2023-08-25 17:22:09,758 file: loader.py func: loader line No: 51 *******************************************
2023-08-25 17:22:09,759 file: loader.py func: loader line No: 125 created RawImageDirLoader of shape:[1, 3, 640, 640]
2023-08-25 17:22:09,759 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000006818.bgr
2023-08-25 17:22:09,768 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000016228.bgr
2023-08-25 17:22:09,774 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000017627.bgr
2023-08-25 17:22:09,779 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000025560.bgr
2023-08-25 17:22:09,785 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000037777.bgr
2023-08-25 17:22:09,790 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000041888.bgr
2023-08-25 17:22:09,795 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000058636.bgr
2023-08-25 17:22:09,801 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000085329.bgr
2023-08-25 17:22:09,805 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000087038.bgr
2023-08-25 17:22:09,811 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000122745.bgr
2023-08-25 17:22:09,815 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000125211.bgr
2023-08-25 17:22:09,820 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000143931.bgr
2023-08-25 17:22:09,826 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000153299.bgr
2023-08-25 17:22:09,830 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000174482.bgr
2023-08-25 17:22:09,835 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000181666.bgr
2023-08-25 17:22:09,841 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000184321.bgr
2023-08-25 17:22:09,845 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000184791.bgr
2023-08-25 17:22:09,851 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000185250.bgr
2023-08-25 17:22:09,856 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000219578.bgr
2023-08-25 17:22:09,860 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000226111.bgr
2023-08-25 17:22:09,866 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000233771.bgr
2023-08-25 17:22:09,871 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000239274.bgr
2023-08-25 17:22:09,876 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000252219.bgr
2023-08-25 17:22:09,881 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000266409.bgr
2023-08-25 17:22:09,886 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000270244.bgr
2023-08-25 17:22:09,891 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000286994.bgr
2023-08-25 17:22:09,896 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000289393.bgr
2023-08-25 17:22:09,901 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000296649.bgr
2023-08-25 17:22:09,906 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000297343.bgr
2023-08-25 17:22:09,911 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000301867.bgr
2023-08-25 17:22:09,917 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000303818.bgr
2023-08-25 17:22:09,922 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000308394.bgr
2023-08-25 17:22:09,928 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000312421.bgr
2023-08-25 17:22:09,934 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000314294.bgr
2023-08-25 17:22:09,939 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000322864.bgr
2023-08-25 17:22:09,945 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000329323.bgr
2023-08-25 17:22:09,951 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000331352.bgr
2023-08-25 17:22:09,955 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000336587.bgr
2023-08-25 17:22:09,960 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000348881.bgr
2023-08-25 17:22:09,966 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000356427.bgr
2023-08-25 17:22:09,970 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000360661.bgr
2023-08-25 17:22:09,975 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000382088.bgr
2023-08-25 17:22:09,980 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000386912.bgr
2023-08-25 17:22:09,985 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000397133.bgr
2023-08-25 17:22:09,991 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000403385.bgr
2023-08-25 17:22:09,995 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000403817.bgr
2023-08-25 17:22:10,001 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000418281.bgr
2023-08-25 17:22:10,006 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000443303.bgr
2023-08-25 17:22:10,011 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000456496.bgr
2023-08-25 17:22:10,016 file: loader.py func: loader line No: 130 Read raw file: /workspace/data/calibration_data_bgr_f32/000000458054.bgr
2023-08-25 17:22:10,021 file: tool_utils.py func: tool_utils line No: 364 num of calibration data: 50
2023-08-25 17:22:10,022 file: tool_utils.py func: tool_utils line No: 365 calibration data shape: (1, 3, 640, 640)
2023-08-25 17:22:10,062 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 505 call build params:
{‘march’: ‘bernoulli2’, ‘save_model’: True, ‘name_prefix’: ‘yolox_x_created’, ‘input_dict’: {‘images’: {‘input_shape’: [1, 3, 640, 640], ‘input_batch’: 1, ‘expected_input_type’: ‘BGR_128’, ‘original_input_type’: ‘BGR’, ‘original_input_layout’: ‘NCHW’}}, ‘cali_dict’: {‘calibration_type’: ‘default’, ‘calibration_data’: {‘images’: [array([[[[ 11., 30., 33., …, -14., -14., -14.],
[ 13., 37., 50., …, -14., -14., -14.],
[ 11., 34., 48., …, -14., -14., -14.],
…,
[-46., -44., -42., …, -14., -14., -14.],
[-45., -44., -43., …, -14., -14., -14.],
[-42., -43., -43., …, -14., -14., -14.]],[[ -3., 17., 19., ..., -14., -14., -14.], [ 1., 26., 38., ..., -14., -14., -14.], [ 0., 23., 37., ..., -14., -14., -14.], ..., [-72., -70., -68., ..., -14., -14., -14.], [-71., -70., -69., ..., -14., -14., -14.], [-71., -69., -69., ..., -14., -14., -14.]], [[-22., -5., -4., ..., -14., -14., -14.], [-23., -1., 10., ..., -14., -14., -14.], [-28., -7., 5., ..., -14., -14., -14.], ..., [-86., -84., -82., ..., -14., -14., -14.], [-87., -86., -85., ..., -14., -14., -14.], [-86., -85., -85., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-108., -108., -107., ..., -111., -109., -109.], [-108., -108., -107., ..., -110., -108., -109.], [-108., -108., -107., ..., -109., -108., -109.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-105., -105., -104., ..., -105., -103., -103.], [-105., -105., -104., ..., -104., -102., -103.], [-105., -105., -104., ..., -103., -102., -103.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-100., -100., -99., ..., -100., -98., -98.], [-100., -100., -99., ..., -99., -97., -98.], [-100., -100., -99., ..., -98., -97., -98.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-118., -119., -119., ..., 48., 38., 42.], [-119., -118., -118., ..., 48., 48., 44.], [-118., -118., -118., ..., 40., 36., 40.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-124., -123., -123., ..., -27., -38., -34.], [-123., -122., -122., ..., -30., -30., -34.], [-122., -122., -122., ..., -31., -35., -30.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-128., -128., -128., ..., -65., -74., -70.], [-128., -127., -127., ..., -67., -66., -70.], [-127., -127., -127., ..., -69., -72., -67.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -70., -66., -71., ..., -101., -102., -110.], [ -67., -65., -71., ..., -111., -111., -115.], [ -71., -67., -70., ..., -116., -112., -116.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -78., -75., -81., ..., -104., -103., -109.], [ -76., -72., -80., ..., -115., -113., -117.], [ -76., -75., -79., ..., -123., -117., -121.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -95., -89., -91., ..., -108., -107., -111.], [ -90., -87., -90., ..., -116., -114., -117.], [ -91., -88., -89., ..., -120., -115., -119.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 44., 42., 39., ..., 25., 27., 28.], [ 44., 42., 40., ..., 25., 27., 28.], [ 44., 42., 40., ..., 24., 26., 27.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 47., 45., 42., ..., 28., 30., 31.], [ 47., 45., 43., ..., 28., 30., 31.], [ 47., 46., 43., ..., 27., 29., 30.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 45., 43., 40., ..., 26., 28., 29.], [ 45., 43., 41., ..., 26., 28., 28.], [ 45., 44., 41., ..., 25., 27., 28.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[115., 114., 114., ..., 77., 89., 76.], [113., 113., 113., ..., 105., 74., 80.], [112., 112., 112., ..., 91., 66., 62.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[103., 103., 103., ..., 72., 76., 59.], [101., 101., 102., ..., 97., 62., 66.], [100., 100., 100., ..., 78., 54., 54.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 97., 95., 95., ..., 57., 68., 46.], [ 95., 95., 94., ..., 84., 52., 54.], [ 94., 94., 94., ..., 70., 42., 41.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 119., 119., 116., ..., -14., -14., -14.], [ 121., 124., 126., ..., -14., -14., -14.], [ 117., 117., 120., ..., -14., -14., -14.], ..., [ 96., 90., 94., ..., -14., -14., -14.], [ 14., 17., 16., ..., -14., -14., -14.], [-128., -127., -128., ..., -14., -14., -14.]], [[ 112., 112., 109., ..., -14., -14., -14.], [ 114., 117., 119., ..., -14., -14., -14.], [ 110., 110., 113., ..., -14., -14., -14.], ..., [ 97., 91., 93., ..., -14., -14., -14.], [ 13., 16., 13., ..., -14., -14., -14.], [-128., -127., -128., ..., -14., -14., -14.]], [[ 95., 95., 92., ..., -14., -14., -14.], [ 97., 100., 102., ..., -14., -14., -14.], [ 93., 93., 96., ..., -14., -14., -14.], ..., [ 77., 71., 73., ..., -14., -14., -14.], [ 9., 12., 9., ..., -14., -14., -14.], [-127., -127., -128., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-123., -123., -123., ..., -123., -123., -123.], [-123., -123., -123., ..., -123., -123., -123.], [-123., -123., -123., ..., -123., -123., -123.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-122., -122., -122., ..., -122., -122., -122.], [-122., -122., -122., ..., -122., -122., -122.], [-122., -122., -122., ..., -122., -122., -122.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-124., -124., -124., ..., -124., -124., -124.], [-124., -124., -124., ..., -124., -124., -124.], [-124., -124., -124., ..., -124., -124., -124.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[112., 113., 113., ..., 105., 104., 103.], [113., 113., 113., ..., 105., 104., 103.], [113., 113., 113., ..., 105., 104., 103.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[112., 113., 113., ..., 103., 102., 101.], [113., 113., 113., ..., 103., 102., 101.], [113., 113., 113., ..., 103., 102., 101.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[112., 113., 113., ..., 102., 101., 100.], [113., 113., 113., ..., 102., 101., 100.], [113., 113., 113., ..., 102., 101., 100.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], ..., [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.]], [[-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], ..., [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.]], [[-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], ..., [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.], [-128., -128., -128., ..., -14., -14., -14.]]]], dtype=float32), array([[[[127., 125., 126., ..., 125., 127., 124.], [127., 127., 126., ..., 125., 126., 125.], [127., 127., 127., ..., 127., 125., 125.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[125., 125., 126., ..., 124., 126., 126.], [125., 126., 127., ..., 126., 126., 127.], [126., 126., 125., ..., 127., 126., 127.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[125., 125., 126., ..., 126., 127., 126.], [124., 125., 125., ..., 124., 126., 127.], [122., 122., 124., ..., 126., 124., 127.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-112., -126., -115., ..., 0., -8., 1.], [ -67., -86., -118., ..., -1., -5., -2.], [ -64., -41., -34., ..., -10., -1., -5.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-117., -124., -114., ..., -34., -29., -29.], [ -91., -105., -112., ..., -26., -28., -32.], [ -80., -88., -82., ..., -23., -32., -31.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-108., -116., -123., ..., -47., -50., -58.], [-115., -113., -117., ..., -52., -50., -43.], [-109., -119., -118., ..., -61., -57., -47.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 37., 59., 65., ..., -14., -14., -14.], [ 42., 59., 64., ..., -14., -14., -14.], [ 38., 57., 64., ..., -14., -14., -14.], ..., [ 58., 61., 63., ..., -14., -14., -14.], [ 59., 61., 62., ..., -14., -14., -14.], [ 62., 63., 62., ..., -14., -14., -14.]], [[ 42., 63., 73., ..., -14., -14., -14.], [ 49., 66., 73., ..., -14., -14., -14.], [ 51., 64., 73., ..., -14., -14., -14.], ..., [ 78., 80., 81., ..., -14., -14., -14.], [ 78., 80., 81., ..., -14., -14., -14.], [ 81., 81., 81., ..., -14., -14., -14.]], [[ 51., 62., 74., ..., -14., -14., -14.], [ 54., 63., 73., ..., -14., -14., -14.], [ 51., 60., 71., ..., -14., -14., -14.], ..., [ 84., 87., 89., ..., -14., -14., -14.], [ 85., 87., 88., ..., -14., -14., -14.], [ 88., 88., 89., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-122., -125., -90., ..., -100., -94., -89.], [-126., -125., -90., ..., -105., -99., -91.], [-125., -124., -97., ..., -97., -80., -91.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-126., -116., -98., ..., -84., -83., -75.], [-127., -116., -95., ..., -84., -83., -87.], [-127., -128., -102., ..., -78., -71., -82.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-127., -119., -115., ..., -78., -79., -86.], [-128., -119., -110., ..., -92., -77., -69.], [-127., -122., -103., ..., -87., -68., -79.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 96., 97., 98., ..., 107., 107., 107.], [ 99., 99., 99., ..., 106., 106., 106.], [ 99., 99., 99., ..., 106., 106., 105.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 38., 39., 40., ..., 33., 33., 33.], [ 41., 41., 41., ..., 33., 33., 33.], [ 43., 43., 43., ..., 33., 33., 32.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 3., 4., 5., ..., -15., -15., -15.], [ 6., 6., 6., ..., -17., -17., -17.], [ 8., 8., 8., ..., -17., -17., -18.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 44., 43., 39., ..., 44., 44., 46.], [ 43., 40., 38., ..., 42., 42., 46.], [ 40., 36., 44., ..., 43., 43., 46.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 43., 45., 43., ..., 40., 40., 42.], [ 45., 44., 42., ..., 38., 38., 42.], [ 42., 40., 48., ..., 39., 39., 42.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 45., 46., 44., ..., 39., 39., 41.], [ 46., 45., 43., ..., 37., 37., 41.], [ 43., 41., 49., ..., 38., 38., 41.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 93., 92., 92., ..., 66., 66., 66.], [ 94., 94., 93., ..., 67., 66., 66.], [ 94., 94., 94., ..., 67., 66., 66.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 87., 86., 86., ..., 69., 69., 69.], [ 88., 88., 87., ..., 70., 69., 69.], [ 88., 88., 88., ..., 70., 69., 69.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 82., 81., 81., ..., 60., 60., 60.], [ 83., 83., 82., ..., 61., 60., 60.], [ 83., 83., 83., ..., 61., 60., 60.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 127., 127., 127., ..., -14., -14., -14.], [ 127., 127., 127., ..., -14., -14., -14.], [ 127., 127., 127., ..., -14., -14., -14.], ..., [ -72., -111., -94., ..., -14., -14., -14.], [ -99., -60., -73., ..., -14., -14., -14.], [-122., -101., -118., ..., -14., -14., -14.]], [[ 127., 127., 127., ..., -14., -14., -14.], [ 127., 127., 127., ..., -14., -14., -14.], [ 127., 127., 127., ..., -14., -14., -14.], ..., [ 15., -21., -4., ..., -14., -14., -14.], [ -30., 23., 16., ..., -14., -14., -14.], [ -60., -13., -23., ..., -14., -14., -14.]], [[ 127., 127., 127., ..., -14., -14., -14.], [ 127., 127., 127., ..., -14., -14., -14.], [ 127., 127., 127., ..., -14., -14., -14.], ..., [ 12., -21., -4., ..., -14., -14., -14.], [ -27., 21., 13., ..., -14., -14., -14.], [ -60., -19., -30., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-55., -53., -52., ..., -43., -47., -43.], [-57., -52., -54., ..., -54., -55., -60.], [-46., -48., -54., ..., -37., -36., -45.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 54., 53., 51., ..., 78., 77., 76.], [ 46., 53., 55., ..., 75., 77., 74.], [ 56., 54., 51., ..., 76., 76., 72.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[106., 106., 106., ..., 118., 118., 121.], [101., 110., 111., ..., 114., 117., 116.], [115., 113., 108., ..., 119., 122., 117.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 125., 124., 124., ..., -14., -14., -14.], [ 125., 124., 124., ..., -14., -14., -14.], [ 125., 125., 124., ..., -14., -14., -14.], ..., [ -99., -109., -105., ..., -14., -14., -14.], [ -95., -88., -97., ..., -14., -14., -14.], [ -88., -93., -99., ..., -14., -14., -14.]], [[ 124., 123., 123., ..., -14., -14., -14.], [ 125., 124., 124., ..., -14., -14., -14.], [ 125., 125., 124., ..., -14., -14., -14.], ..., [ -77., -89., -89., ..., -14., -14., -14.], [ -69., -61., -73., ..., -14., -14., -14.], [ -61., -64., -69., ..., -14., -14., -14.]], [[ 120., 119., 119., ..., -14., -14., -14.], [ 119., 118., 118., ..., -14., -14., -14.], [ 119., 119., 118., ..., -14., -14., -14.], ..., [ -29., -42., -42., ..., -14., -14., -14.], [ -9., -4., -21., ..., -14., -14., -14.], [ 13., 3., -10., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-124., -120., -121., ..., 101., 106., 114.], [-123., -119., -115., ..., 103., 107., 113.], [-120., -114., -108., ..., 102., 108., 113.], ..., [ 94., 94., 94., ..., -126., -127., -128.], [ 92., 93., 94., ..., -127., -127., -128.], [ 93., 92., 90., ..., -128., -128., -128.]], [[-124., -120., -121., ..., 101., 106., 114.], [-123., -119., -115., ..., 103., 107., 113.], [-120., -114., -108., ..., 102., 108., 113.], ..., [ 94., 94., 94., ..., -126., -127., -128.], [ 92., 93., 94., ..., -127., -127., -128.], [ 93., 92., 90., ..., -128., -128., -128.]], [[-124., -120., -121., ..., 101., 106., 114.], [-123., -119., -115., ..., 103., 107., 113.], [-120., -114., -108., ..., 102., 108., 113.], ..., [ 94., 94., 94., ..., -126., -127., -128.], [ 92., 93., 94., ..., -127., -127., -128.], [ 93., 92., 90., ..., -128., -128., -128.]]]], dtype=float32), array([[[[ -5., -3., -5., ..., -14., -14., -14.], [ -3., -3., -4., ..., -14., -14., -14.], [ -4., -4., -1., ..., -14., -14., -14.], ..., [ -81., -93., -98., ..., -14., -14., -14.], [-128., -111., -128., ..., -14., -14., -14.], [-128., -98., -126., ..., -14., -14., -14.]], [[ -15., -17., -17., ..., -14., -14., -14.], [ -12., -13., -17., ..., -14., -14., -14.], [ -15., -12., -12., ..., -14., -14., -14.], ..., [ -56., -79., -88., ..., -14., -14., -14.], [-124., -99., -121., ..., -14., -14., -14.], [-128., -109., -124., ..., -14., -14., -14.]], [[ -55., -53., -59., ..., -14., -14., -14.], [ -55., -60., -55., ..., -14., -14., -14.], [ -53., -59., -56., ..., -14., -14., -14.], ..., [ -66., -51., -70., ..., -14., -14., -14.], [-128., -99., -127., ..., -14., -14., -14.], [-118., -89., -123., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 89., 53., 11., ..., 52., 57., 56.], [ 89., 52., 11., ..., 36., 39., 40.], [ 89., 52., 12., ..., -81., -82., -80.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 72., 42., -20., ..., 25., 30., 30.], [ 72., 41., -20., ..., 4., 7., 8.], [ 72., 41., -19., ..., -86., -87., -85.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 59., 28., -29., ..., -85., -81., -84.], [ 59., 27., -29., ..., -67., -66., -65.], [ 59., 27., -28., ..., -87., -88., -86.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 67., 68., 68., ..., 51., 51., 45.], [ 68., 69., 70., ..., 47., 47., 51.], [ 71., 70., 70., ..., 48., 47., 55.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 40., 37., 35., ..., 21., 26., 20.], [ 40., 38., 36., ..., 23., 23., 18.], [ 39., 37., 35., ..., 24., 21., 21.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 13., 14., 15., ..., 2., 6., 0.], [ 16., 17., 20., ..., 3., 3., 2.], [ 20., 21., 21., ..., 6., 4., 5.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -57., -60., -60., ..., -65., -63., -57.], [ -59., -61., -61., ..., -63., -62., -57.], [ -64., -65., -65., ..., -58., -58., -58.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -53., -55., -55., ..., -76., -84., -87.], [ -56., -54., -53., ..., -78., -83., -85.], [ -59., -58., -59., ..., -80., -82., -83.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -88., -87., -86., ..., -126., -128., -128.], [ -88., -91., -93., ..., -127., -128., -126.], [ -98., -95., -94., ..., -128., -128., -127.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[104., 104., 105., ..., 90., 90., 94.], [102., 102., 102., ..., 89., 92., 94.], [102., 102., 103., ..., 90., 91., 94.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 85., 85., 86., ..., 71., 71., 73.], [ 86., 86., 85., ..., 73., 73., 75.], [ 86., 86., 86., ..., 74., 74., 75.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 70., 70., 73., ..., 56., 56., 58.], [ 70., 70., 72., ..., 57., 58., 60.], [ 70., 70., 73., ..., 61., 61., 62.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 58., 58., 58., ..., -87., -88., -90.], [ 58., 58., 58., ..., -86., -86., -88.], [ 59., 58., 58., ..., -86., -85., -86.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 57., 57., 58., ..., -27., -31., -34.], [ 57., 58., 58., ..., -26., -29., -33.], [ 59., 58., 58., ..., -26., -28., -31.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 66., 66., 64., ..., 127., 124., 121.], [ 66., 64., 64., ..., 127., 126., 124.], [ 65., 64., 64., ..., 127., 127., 126.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -1., 1., 1., ..., 112., 111., 110.], [ 0., 0., -1., ..., 110., 109., 108.], [ -1., -1., -4., ..., 109., 108., 107.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ -5., -3., -3., ..., 81., 80., 79.], [ -4., -4., -5., ..., 80., 79., 78.], [ -5., -5., -8., ..., 79., 78., 77.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ -6., -4., -4., ..., 56., 55., 54.], [ -5., -5., -6., ..., 53., 52., 51.], [ -6., -6., -9., ..., 50., 49., 48.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-123., -123., -124., ..., -48., -66., -79.], [-122., -123., -121., ..., -64., -59., -51.], [-123., -123., -121., ..., -54., -43., -40.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-122., -122., -123., ..., -9., -22., -35.], [-121., -122., -121., ..., -27., -18., -16.], [-122., -123., -121., ..., -15., -10., -21.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-124., -124., -125., ..., 43., 25., 6.], [-123., -124., -121., ..., 25., 27., 24.], [-124., -123., -121., ..., 37., 36., 22.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 2., 9., 11., ..., -18., -3., 65.], [ 3., 12., 16., ..., -2., 10., 63.], [-16., 4., 12., ..., -12., 5., 57.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 3., 10., 14., ..., 62., 64., 68.], [ -3., 8., 15., ..., 60., 61., 67.], [-11., 5., 9., ..., 60., 60., 64.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 1., 8., 12., ..., 45., 43., 53.], [ 2., 13., 17., ..., 48., 47., 56.], [ -8., 9., 11., ..., 40., 41., 51.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 67., -2., 37., ..., -14., -14., -14.], [ 44., 20., 24., ..., -14., -14., -14.], [ 26., 45., 36., ..., -14., -14., -14.], ..., [-17., -11., -20., ..., -14., -14., -14.], [-24., -40., -38., ..., -14., -14., -14.], [-25., -19., -30., ..., -14., -14., -14.]], [[ 91., 23., 62., ..., -14., -14., -14.], [ 63., 39., 43., ..., -14., -14., -14.], [ 43., 62., 54., ..., -14., -14., -14.], ..., [-13., -6., -16., ..., -14., -14., -14.], [-18., -36., -37., ..., -14., -14., -14.], [-15., -15., -32., ..., -14., -14., -14.]], [[ 97., 27., 66., ..., -14., -14., -14.], [ 71., 46., 50., ..., -14., -14., -14.], [ 52., 71., 61., ..., -14., -14., -14.], ..., [-12., -3., -11., ..., -14., -14., -14.], [-19., -35., -33., ..., -14., -14., -14.], [-28., -21., -33., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -38., -42., -47., ..., -128., -128., -128.], [ -55., -57., -59., ..., -127., -126., -128.], [ -43., -47., -49., ..., -126., -127., -128.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -7., -11., -16., ..., -127., -127., -127.], [ -12., -14., -15., ..., -126., -125., -127.], [ -7., -11., -13., ..., -126., -127., -128.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 16., 12., 5., ..., -128., -128., -128.], [ 7., 5., 2., ..., -128., -127., -128.], [ 11., 7., 5., ..., -126., -127., -128.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[127., 127., 127., ..., 126., 126., 126.], [127., 127., 127., ..., 126., 125., 122.], [127., 127., 127., ..., 127., 124., 123.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[127., 127., 127., ..., 125., 125., 127.], [127., 127., 127., ..., 126., 125., 124.], [127., 127., 127., ..., 127., 127., 125.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[127., 127., 127., ..., 105., 104., 101.], [127., 127., 127., ..., 108., 107., 104.], [127., 127., 127., ..., 112., 112., 113.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 27., -21., -29., ..., -104., -77., -72.], [ -8., 52., -42., ..., -107., -14., -15.], [ -5., 36., -40., ..., -117., -73., 3.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 69., 38., 47., ..., -85., -60., -42.], [ 49., 110., 23., ..., -86., 1., 7.], [ 47., 83., 15., ..., -102., -59., 24.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 46., 34., 46., ..., -100., -73., -61.], [ 18., 109., 24., ..., -108., -13., -12.], [ 24., 87., 28., ..., -116., -70., 9.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 16., 35., 51., ..., -14., -14., -14.], [ 13., 30., 49., ..., -14., -14., -14.], [ 9., 25., 50., ..., -14., -14., -14.], ..., [-22., -16., -16., ..., -14., -14., -14.], [-21., -18., -27., ..., -14., -14., -14.], [-14., -10., -26., ..., -14., -14., -14.]], [[-10., 12., 22., ..., -14., -14., -14.], [ -9., 11., 22., ..., -14., -14., -14.], [ -9., 9., 26., ..., -14., -14., -14.], ..., [-24., -18., -16., ..., -14., -14., -14.], [-21., -18., -27., ..., -14., -14., -14.], [-14., -10., -26., ..., -14., -14., -14.]], [[-46., -20., -5., ..., -14., -14., -14.], [-45., -24., -5., ..., -14., -14., -14.], [-46., -27., -4., ..., -14., -14., -14.], ..., [-24., -18., -16., ..., -14., -14., -14.], [-21., -18., -27., ..., -14., -14., -14.], [-14., -10., -26., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 119., 121., 118., ..., -14., -14., -14.], [ 111., 122., 119., ..., -14., -14., -14.], [ 108., 114., 125., ..., -14., -14., -14.], ..., [ -96., -97., -97., ..., -14., -14., -14.], [ -95., -97., -98., ..., -14., -14., -14.], [ -96., -98., -99., ..., -14., -14., -14.]], [[ 107., 109., 108., ..., -14., -14., -14.], [ 101., 112., 109., ..., -14., -14., -14.], [ 99., 105., 116., ..., -14., -14., -14.], ..., [ -98., -99., -99., ..., -14., -14., -14.], [ -97., -99., -100., ..., -14., -14., -14.], [ -98., -100., -101., ..., -14., -14., -14.]], [[ 97., 99., 98., ..., -14., -14., -14.], [ 91., 102., 99., ..., -14., -14., -14.], [ 89., 95., 106., ..., -14., -14., -14.], ..., [ -98., -99., -99., ..., -14., -14., -14.], [ -97., -99., -100., ..., -14., -14., -14.], [ -98., -100., -101., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -73., -93., -100., ..., -14., -14., -14.], [ -46., -54., -59., ..., -14., -14., -14.], [ -25., -29., -35., ..., -14., -14., -14.], ..., [ -43., -19., 53., ..., -14., -14., -14.], [ -37., -12., 58., ..., -14., -14., -14.], [ -38., -15., 55., ..., -14., -14., -14.]], [[ -79., -98., -104., ..., -14., -14., -14.], [ -41., -48., -51., ..., -14., -14., -14.], [ -6., -9., -13., ..., -14., -14., -14.], ..., [ -55., -26., 51., ..., -14., -14., -14.], [ -49., -19., 55., ..., -14., -14., -14.], [ -51., -23., 53., ..., -14., -14., -14.]], [[ -84., -102., -106., ..., -14., -14., -14.], [ -31., -36., -37., ..., -14., -14., -14.], [ 17., 16., 14., ..., -14., -14., -14.], ..., [ -55., -27., 48., ..., -14., -14., -14.], [ -48., -19., 53., ..., -14., -14., -14.], [ -49., -23., 51., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-33., -36., -32., ..., 127., 126., 126.], [-33., -37., -32., ..., 127., 127., 126.], [-39., -42., -41., ..., 127., 127., 127.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[-41., -44., -40., ..., 117., 116., 116.], [-41., -45., -40., ..., 117., 117., 116.], [-48., -51., -49., ..., 117., 117., 117.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[-40., -43., -39., ..., 110., 109., 109.], [-40., -44., -39., ..., 110., 110., 109.], [-45., -48., -48., ..., 110., 110., 110.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[126., 125., 124., ..., 125., 127., 127.], [126., 125., 124., ..., 125., 127., 127.], [124., 124., 123., ..., 126., 127., 127.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[117., 116., 115., ..., 124., 125., 126.], [117., 116., 115., ..., 124., 125., 126.], [115., 115., 114., ..., 126., 125., 126.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[114., 113., 112., ..., 120., 121., 121.], [114., 113., 112., ..., 120., 121., 121.], [112., 112., 111., ..., 120., 120., 121.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 91., 92., 92., ..., -75., -93., -99.], [ 91., 92., 92., ..., -104., -98., -94.], [ 91., 92., 92., ..., 14., -85., -33.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 77., 77., 77., ..., -57., -63., -62.], [ 77., 77., 77., ..., -90., -55., -56.], [ 77., 77., 77., ..., -18., -91., -33.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 59., 61., 61., ..., -70., -74., -72.], [ 59., 61., 61., ..., -102., -70., -68.], [ 59., 61., 61., ..., -23., -98., -39.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[105., 105., 106., ..., 105., 105., 107.], [106., 106., 107., ..., 106., 106., 108.], [107., 107., 107., ..., 106., 107., 108.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 72., 72., 73., ..., 72., 72., 74.], [ 73., 73., 74., ..., 73., 73., 74.], [ 74., 74., 74., ..., 74., 74., 75.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 23., 23., 24., ..., 26., 26., 28.], [ 24., 24., 25., ..., 27., 27., 28.], [ 25., 25., 25., ..., 25., 25., 26.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-53., -57., -53., ..., -32., -36., -40.], [-57., -62., -60., ..., -38., -37., -40.], [-60., -63., -58., ..., -35., -35., -40.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[-66., -62., -59., ..., -16., -22., -28.], [-59., -61., -63., ..., -23., -23., -28.], [-62., -62., -62., ..., -22., -21., -28.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[-74., -71., -64., ..., -23., -28., -34.], [-70., -71., -71., ..., -27., -29., -34.], [-73., -72., -67., ..., -24., -25., -34.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 28., 25., 27., ..., -10., 1., 17.], [ 33., 27., 21., ..., 4., 0., 10.], [ 19., 15., 3., ..., -3., 8., 4.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 4., 10., 17., ..., 11., 10., 12.], [ 10., 13., 13., ..., 23., 9., 7.], [ -3., 3., -5., ..., 16., 17., 3.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[ 36., 31., 29., ..., 13., 20., 33.], [ 38., 31., 24., ..., 26., 18., 23.], [ 26., 25., 12., ..., 21., 26., 19.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -51., -64., -71., ..., -114., -116., -113.], [ -60., -55., -76., ..., -115., -118., -119.], [ -60., -59., -83., ..., -121., -88., -72.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 0., -2., -17., ..., -116., -118., -115.], [ 3., 8., -19., ..., -115., -118., -117.], [ -2., 3., -24., ..., -122., -86., -68.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -4., -8., -24., ..., -117., -119., -116.], [ -13., -8., -34., ..., -115., -118., -117.], [ -13., -11., -39., ..., -120., -85., -67.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-36., -34., -32., ..., -39., -41., -47.], [-33., -32., -30., ..., -34., -53., -49.], [-33., -31., -30., ..., -40., -48., -46.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[-37., -35., -33., ..., -36., -38., -44.], [-34., -33., -31., ..., -31., -49., -43.], [-35., -32., -31., ..., -33., -41., -39.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[-41., -39., -37., ..., -38., -40., -46.], [-38., -37., -35., ..., -33., -54., -48.], [-36., -36., -35., ..., -40., -48., -46.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[-128., -127., -127., ..., -124., -121., -118.], [-128., -126., -127., ..., -124., -123., -120.], [-128., -127., -126., ..., -122., -123., -120.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[-105., -106., -105., ..., -120., -119., -117.], [-106., -101., -100., ..., -115., -116., -114.], [-105., -101., -100., ..., -113., -115., -114.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -41., -47., -53., ..., -104., -100., -97.], [ -50., -49., -54., ..., -113., -111., -109.], [ -52., -52., -54., ..., -111., -111., -108.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ 111., 111., 112., ..., -115., -116., -114.], [ 112., 111., 111., ..., -114., -115., -115.], [ 113., 112., 111., ..., -117., -115., -115.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 101., 101., 102., ..., -110., -112., -115.], [ 102., 101., 101., ..., -109., -113., -116.], [ 103., 102., 101., ..., -114., -112., -112.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 83., 83., 84., ..., -119., -117., -119.], [ 84., 83., 83., ..., -118., -119., -120.], [ 85., 84., 83., ..., -123., -121., -121.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -6., -3., -1., ..., -106., -105., -106.], [ -5., -3., 0., ..., -105., -104., -106.], [ -5., -3., 1., ..., -104., -104., -106.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 13., 12., 10., ..., -106., -107., -109.], [ 13., 13., 11., ..., -105., -105., -107.], [ 13., 13., 12., ..., -104., -104., -107.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ 10., 11., 11., ..., -86., -90., -94.], [ 7., 9., 10., ..., -85., -88., -93.], [ 5., 7., 9., ..., -84., -87., -92.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[119., 118., 118., ..., 122., 121., 121.], [120., 119., 119., ..., 118., 118., 117.], [116., 117., 117., ..., 115., 115., 114.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[119., 118., 118., ..., 122., 121., 121.], [120., 119., 119., ..., 118., 118., 117.], [116., 117., 117., ..., 115., 115., 114.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]], [[119., 118., 118., ..., 122., 121., 121.], [120., 119., 119., ..., 118., 118., 117.], [116., 117., 117., ..., 115., 115., 114.], ..., [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.], [-14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32), array([[[[ -15., -11., -8., ..., -128., -125., -125.], [ -15., -11., -7., ..., -128., -127., -124.], [ -11., -10., -6., ..., -125., -126., -123.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -12., -10., -9., ..., -123., -123., -128.], [ -12., -10., -8., ..., -124., -125., -124.], [ -9., -8., -7., ..., -121., -124., -122.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]], [[ -7., -6., -7., ..., -120., -122., -126.], [ -8., -6., -6., ..., -123., -124., -124.], [ -8., -7., -5., ..., -120., -124., -124.], ..., [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.], [ -14., -14., -14., ..., -14., -14., -14.]]]], dtype=float32)]}}, 'hbdk_dict': {'hbdk_pass_through_params': '--O3 --core-num 2 --fast ', 'input-source': {'images': 'ddr', '_default_value': 'ddr'}}, 'node_dict': {}, 'check_mode': False}2023-08-25 17:22:10,073 file: build.py func: build line No: 35 [Fri Aug 25 17:22:10 2023] Start to Horizon NN Model Convert.
2023-08-25 17:22:10,073 file: model_debug.py func: model_debug line No: 61 Loading horizon_nn debug methods:
2023-08-25 17:22:10,073 file: dict_parser.py func: dict_parser line No: 33 Parsing the input parameter:{‘images’: {‘input_shape’: [1, 3, 640, 640], ‘input_batch’: 1, ‘expected_input_type’: ‘BGR_128’, ‘original_input_type’: ‘BGR’, ‘original_input_layout’: ‘NCHW’}}
2023-08-25 17:22:10,074 file: build.py func: build line No: 186 Parsing the calibration parameter
2023-08-25 17:22:10,074 file: dict_parser.py func: dict_parser line No: 440 Parsing the hbdk parameter:{‘hbdk_pass_through_params’: '–O3 --core-num 2 --fast ', ‘input-source’: {‘images’: ‘ddr’, ‘_default_value’: ‘ddr’}}
2023-08-25 17:22:10,074 file: build.py func: build line No: 150 HorizonNN version: 0.18.2
2023-08-25 17:22:10,074 file: build.py func: build line No: 154 HBDK version: 3.45.3
2023-08-25 17:22:10,074 file: build.py func: build line No: 35 [Fri Aug 25 17:22:10 2023] Start to parse the onnx model.
2023-08-25 17:22:10,521 file: onnx_parser.py func: onnx_parser line No: 241 Input ONNX model infomation:
ONNX IR version: 6
Opset version: [11, 1]
Producer: pytorch1.11.0
Domain: none
Input name: images, [1, 3, 640, 640]
Output name: output, [1, 8400, 85]
2023-08-25 17:22:13,903 file: build.py func: build line No: 38 [Fri Aug 25 17:22:13 2023] End to parse the onnx model.
2023-08-25 17:22:13,903 file: build.py func: build line No: 217 Model input names parsed from model: [‘images’]
2023-08-25 17:22:13,903 file: dict_parser.py func: dict_parser line No: 247 Create a preprocessing operator for input_name images with means=None, std=None, original_input_layout=NCHW, color convert from ‘BGR’ to ‘BGR’.
2023-08-25 17:22:15,961 file: build.py func: build line No: 464 Saving the original float model: yolox_x_created_original_float_model.onnx.
2023-08-25 17:22:15,962 file: build.py func: build line No: 35 [Fri Aug 25 17:22:15 2023] Start to optimize the model.
2023-08-25 17:22:20,026 file: build.py func: build line No: 38 [Fri Aug 25 17:22:20 2023] End to optimize the model.
2023-08-25 17:22:20,586 file: build.py func: build line No: 487 Saving the optimized model: yolox_x_created_optimized_float_model.onnx.
2023-08-25 17:22:20,586 file: build.py func: build line No: 35 [Fri Aug 25 17:22:20 2023] Start to calibrate the model.
2023-08-25 17:22:20,588 file: calibration_data_set.py func: calibration_data_set line No: 89 input name: images, number_of_samples: 50
2023-08-25 17:22:20,588 file: calibration_data_set.py func: calibration_data_set line No: 100 There are 50 samples in the calibration data set.
2023-08-25 17:22:22,326 file: default_calibrater.py func: default_calibrater line No: 145 Run calibration model with default calibration method.
2023-08-25 17:22:34,540 file: calibrater.py func: calibrater line No: 194 Calibration using batch 8
2023-08-25 17:23:44,174 file: calibrater.py func: calibrater line No: 217 [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running Reshape node. Name:‘Reshape_568’ Status Message: /home/jenkins/agent/workspace/model_convert/onnxruntime/onnxruntime/core/providers/cpu/tensor/reshape_helper.h:43 onnxruntime::ReshapeHelper::ReshapeHelper(const onnxruntime::TensorShape&, std::vector&) gsl::narrow_cast<int64_t>(input_shape.Size()) == size was false. The input tensor cannot be reshaped to the requested shape. Input shape:{8,85,20,20}, requested shape:{1,85,400}2023-08-25 17:23:44,175 file: calibrater.py func: calibrater line No: 218 Above info is caused by batch mode infer and can be ignored
2023-08-25 17:23:44,175 file: calibrater.py func: calibrater line No: 220 Reset batch_size=1 and execute calibration again…
