root@OE-GPU-3-7-0:/data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights# hb_compile -c yolo11n_coco_config.yaml
2026-05-11 16:07:58,913 INFO The log will be stored in /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/hb_compile.log
2026-05-11 16:07:58,913 INFO Start hb_compile…
2026-05-11 16:07:58,913 INFO hbdk version: 4.7.5
2026-05-11 16:07:58,913 INFO hmct version: 2.6.5
2026-05-11 16:07:58,913 INFO hb_compile version: 3.5.3
2026-05-11 16:07:58,913 INFO Start verifying yaml
2026-05-11 16:07:58,922 INFO Using the onnx model file: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/best.onnx
2026-05-11 16:07:58,923 INFO Model has 1 inputs according to model file
2026-05-11 16:07:58,923 INFO The working_dir does not exist. Create working_dir: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output
2026-05-11 16:07:58,923 WARNING Please note that the parameter norm_type has been deprecated and will be determined by the specification of the mean/scale/std parameters
2026-05-11 16:07:58,923 WARNING The input node images’s input_source is not be specified, it will be specified as None by default
2026-05-11 16:07:58,923 INFO The parameter compile_mode is specified as latency, the balance_factor will be specified as 100.
2026-05-11 16:07:58,923 INFO End verifying yaml
2026-05-11 16:07:58,923 INFO Processing calibration set data for input[images]
2026-05-11 16:07:58,924 INFO *******************************************
2026-05-11 16:07:58,924 INFO First calibration picture name: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/calibration_data_rgb/000000000009.rgb
2026-05-11 16:07:58,929 INFO First calibration picture md5: 4191892c92270f938afdf8e9ed350645
2026-05-11 16:07:58,929 INFO *******************************************
2026-05-11 16:07:59,217 INFO Finished. data num: 200
2026-05-11 16:07:59,387 INFO Start to Horizon NN Model Convert.
2026-05-11 16:07:59,394 INFO The specified model compilation architecture: nash-e.
2026-05-11 16:07:59,394 INFO Loading horizon_nn debug methods: set().
2026-05-11 16:07:59,394 INFO The specified model compilation optimization parameters: .
2026-05-11 16:07:59,395 INFO Start to prepare the onnx model.
2026-05-11 16:07:59,404 INFO Input ONNX Model Information:
IR Version: 7
Opset Version: [‘ai.onnx v12’, ‘horizon v1’]
Model Producer: pytorch v2.11.0
Model Domain: None
Model Version: None
Graph Input:
images : shape=[1, 3, 640, 640], dtype=FLOAT32
Graph Output:
output0 : shape=[1, 84, 8400], dtype=FLOAT32
2026-05-11 16:07:59,404 INFO The input model’s opset version is 12, try to convert to opset version of 19.
2026-05-11 16:07:59,466 INFO End to prepare the onnx model.
2026-05-11 16:07:59,478 INFO Saving model to: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12_original_float_model.onnx.
2026-05-11 16:07:59,478 INFO Start to optimize the onnx model.
2026-05-11 16:07:59,999 INFO End to optimize the onnx model.
2026-05-11 16:08:00,010 INFO Saving model to: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12_optimized_float_model.onnx.
2026-05-11 16:08:00,010 INFO The activation calibration configuration:
calibration_type: [‘max’, ‘kl’]
max_percentile: [0.99995, 1.0]
per_channel: [True, False]
asymmetric: [True, False]
The modelwise search configuration:
similarity: 0.995
metric: cosine-similarity
2026-05-11 16:08:00,010 INFO Start to calibrate the model.
2026-05-11 16:08:00,021 INFO There are 200 samples in the dataset.
2026-05-11 16:08:00,894 INFO Provided calibration data md5: b8e29970d3e7df98073dd56578e2316e
2026-05-11 16:08:01.334747374 [E:onnxruntime:, sequential_executor.cc:516 ExecuteKernel] Non-zero status code returned while running Reshape node. Name:‘/model.10/m/m.0/attn/Reshape’ Status Message: /onnxruntime_src/onnxruntime/core/providers/cpu/tensor/reshape_helper.h:45 onnxruntime::ReshapeHelper::ReshapeHelper(const onnxruntime::TensorShape&, onnxruntime::TensorShapeVector&, bool) input_shape_size == size was false. The input tensor cannot be reshaped to the requested shape. Input shape:{8,256,20,20}, requested shape:{1,2,128,400}
2026-05-11 16:08:01,334 INFO Reset batch_size=1 and execute forward again…
2026-05-11 16:08:04,873 INFO Run calibration model with modelwise search method.
2026-05-11 16:08:05,185 INFO Calibration using batch 8
calibration in progress: 0%| | 0/25 [00:00<?, ?it/s]2026-05-11 16:08:05.756044021 [E:onnxruntime:, sequential_executor.cc:516 ExecuteKernel] Non-zero status code returned while running Reshape node. Name:‘/model.10/m/m.0/attn/Reshape’ Status Message: /onnxruntime_src/onnxruntime/core/providers/cpu/tensor/reshape_helper.h:45 onnxruntime::ReshapeHelper::ReshapeHelper(const onnxruntime::TensorShape&, onnxruntime::TensorShapeVector&, bool) input_shape_size == size was false. The input tensor cannot be reshaped to the requested shape. Input shape:{8,256,20,20}, requested shape:{1,2,128,400}
calibration in progress: 0%| | 0/25 [00:00<?, ?it/s]
2026-05-11 16:08:05,756 INFO Reset batch_size=1 and execute forward again…
calibration in progress: 100%|████████████████| 200/200 [06:32<00:00, 1.96s/it]
2026-05-11 16:14:39,202 INFO Calibration using batch 8
calibration in progress: 0%| | 0/25 [00:00<?, ?it/s]2026-05-11 16:14:39.322725839 [E:onnxruntime:, sequential_executor.cc:516 ExecuteKernel] Non-zero status code returned while running Reshape node. Name:‘/model.10/m/m.0/attn/Reshape’ Status Message: /onnxruntime_src/onnxruntime/core/providers/cpu/tensor/reshape_helper.h:45 onnxruntime::ReshapeHelper::ReshapeHelper(const onnxruntime::TensorShape&, onnxruntime::TensorShapeVector&, bool) input_shape_size == size was false. The input tensor cannot be reshaped to the requested shape. Input shape:{8,256,20,20}, requested shape:{1,2,128,400}
calibration in progress: 0%| | 0/25 [00:00<?, ?it/s]
2026-05-11 16:14:39,322 INFO Reset batch_size=1 and execute forward again…
calibration in progress: 100%|████████████████| 200/200 [00:02<00:00, 75.73it/s]
2026-05-11 16:14:42,299 INFO Calibration using batch 8
calibration in progress: 0%| | 0/25 [00:00<?, ?it/s]2026-05-11 16:14:42.993961217 [E:onnxruntime:, sequential_executor.cc:516 ExecuteKernel] Non-zero status code returned while running Reshape node. Name:‘/model.10/m/m.0/attn/Reshape’ Status Message: /onnxruntime_src/onnxruntime/core/providers/cpu/tensor/reshape_helper.h:45 onnxruntime::ReshapeHelper::ReshapeHelper(const onnxruntime::TensorShape&, onnxruntime::TensorShapeVector&, bool) input_shape_size == size was false. The input tensor cannot be reshaped to the requested shape. Input shape:{8,256,20,20}, requested shape:{1,2,128,400}
calibration in progress: 0%| | 0/25 [00:00<?, ?it/s]
2026-05-11 16:14:42,994 INFO Reset batch_size=1 and execute forward again…
calibration in progress: 100%|████████████████| 200/200 [06:20<00:00, 1.90s/it]
2026-05-11 16:21:07,592 INFO Select max-percentile:percentile=0.99995,per_channel method.
2026-05-11 16:21:07,592 INFO Perchannel quantization is enabled.
2026-05-11 16:21:07,885 INFO End to calibrate the model.
2026-05-11 16:21:07,928 INFO Saving model to: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12_calibrated_model.onnx.
2026-05-11 16:21:07,928 INFO Start to quantize the model.
2026-05-11 16:21:08,708 INFO End to quantize the model.
2026-05-11 16:21:08,756 INFO Saving model to: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12_ptq_model.onnx.
2026-05-11 16:21:09,741 INFO End to Horizon NN Model Convert.
2026-05-11 16:21:09,741 INFO Start to export model.
2026-05-11 16:21:10,023 INFO Successfully export model.
2026-05-11 16:21:10,023 WARNING Insert transpose op for images at input 0
2026-05-11 16:21:10,023 WARNING Insert image preprocess op for images at input 0
2026-05-11 16:21:10,059 WARNING Insert image convert op for images at input 0
2026-05-11 16:21:10,059 INFO Start to convert model.
2026-05-11 16:21:10,532 INFO Successfully convert model.
2026-05-11 16:21:10,534 INFO Start to check params …
2026-05-11 16:21:10,719 INFO End to check params.
2026-05-11 16:21:10,751 INFO Start to inference onnx model yolo11n_coco_640x640_nv12_optimized_float_model
2026-05-11 16:21:10,803 INFO Start to inference bc model yolo11n_coco_640x640_nv12_quantized_model
2026-05-11 16:21:12,358 WARNING The model [/model.23/dfl/Transpose_output_0] has different shapes, skip this tensor calculation. Model shape is different: (1, 8400, 4, 16) vs (1, 8400, 16, 4)
2026-05-11 16:21:12,358 WARNING The model [/model.23/dfl/Softmax_output_0] has different shapes, skip this tensor calculation. Model shape is different: (1, 8400, 4, 16) vs (1, 8400, 16, 4)
2026-05-11 16:21:12,379 INFO ±----------------------------------------------------------±------------±----±-------------±------------------±-----------------±-----------------+
2026-05-11 16:21:12,379 INFO | Node | NodeType | ON | Threshold | Calibrated Cosine | Quantized Cosine | Output Data Type |
2026-05-11 16:21:12,379 INFO ±----------------------------------------------------------±------------±----±-------------±------------------±-----------------±-----------------+
2026-05-11 16:21:12,379 INFO | /model.0/conv/Conv | Conv | BPU | 255.0 | 1.000022 | -0.00862981 | si8 |
2026-05-11 16:21:12,379 INFO | /model.0/act/Mul | HzSwish | BPU | 9351.912109 | 0.999437 | 0.0175689 | si8 |
2026-05-11 16:21:12,379 INFO | /model.1/conv/Conv | Conv | BPU | 8351.381836 | 0.998308 | -0.00260172 | si8 |
2026-05-11 16:21:12,379 INFO | /model.1/act/Mul | HzSwish | BPU | 13880.93457 | 0.997921 | 0.0182564 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/cv1/conv/Conv | Conv | BPU | 12162.323242 | 0.996470 | 0.00940067 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/cv1/act/Mul | HzSwish | BPU | 11368.162109 | 0.996007 | 0.0049805 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/Split | Split | BPU | 5704.182129 | 0.995947 | 0.00691977 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/m.0/cv1/conv/Conv | Conv | BPU | 4347.750488 | 0.997591 | 0.00903017 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/m.0/cv1/act/Mul | HzSwish | BPU | 1539.709839 | 0.970795 | 0.0 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/m.0/cv2/conv/Conv | Conv | BPU | 189.980881 | 0.968004 | -0.127251 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/m.0/cv2/act/Mul | HzSwish | BPU | 1623.31897 | 0.973729 | 0.0587649 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/m.0/Add | Add | BPU | 4347.750488 | 0.994003 | 0.00533182 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/Concat | Concat | BPU | 5704.182129 | 0.995301 | 0.00501273 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/cv2/conv/Conv | Conv | BPU | 5378.605469 | 0.996764 | 0.0228122 | si8 |
2026-05-11 16:21:12,379 INFO | /model.2/cv2/act/Mul | HzSwish | BPU | 5958.138184 | 0.993781 | 0.0261072 | si8 |
2026-05-11 16:21:12,379 INFO | /model.3/conv/Conv | Conv | BPU | 1742.818359 | 0.985110 | 0.00895251 | si8 |
2026-05-11 16:21:12,379 INFO | /model.3/act/Mul | HzSwish | BPU | 1434.104126 | 0.932600 | 0.00956717 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/cv1/conv/Conv | Conv | BPU | 932.278381 | 0.914114 | -0.0476012 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/cv1/act/Mul | HzSwish | BPU | 886.946777 | 0.955730 | 0.0076022 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/Split | Split | BPU | 331.294739 | 0.964264 | 0.00761274 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/m.0/cv1/conv/Conv | Conv | BPU | 200.945587 | 0.926281 | -0.332171 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/m.0/cv1/act/Mul | HzSwish | BPU | 176.836777 | 0.911521 | 0.0870817 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/m.0/cv2/conv/Conv | Conv | BPU | 107.286995 | 0.900860 | 0.102111 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/m.0/cv2/act/Mul | HzSwish | BPU | 133.239441 | 0.911897 | 0.412122 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/m.0/Add | Add | BPU | 200.945587 | 0.933114 | 0.386895 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/Concat | Concat | BPU | 331.294739 | 0.949048 | 0.166518 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/cv2/conv/Conv | Conv | BPU | 314.635223 | 0.963454 | 0.139994 | si8 |
2026-05-11 16:21:12,379 INFO | /model.4/cv2/act/Mul | HzSwish | BPU | 443.684814 | 0.934292 | 0.0209813 | si8 |
2026-05-11 16:21:12,379 INFO | /model.5/conv/Conv | Conv | BPU | 166.927689 | 0.948013 | 0.182352 | si8 |
2026-05-11 16:21:12,379 INFO | /model.5/act/Mul | HzSwish | BPU | 272.003296 | 0.932560 | 0.180051 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/cv1/conv/Conv | Conv | BPU | 178.792603 | 0.965064 | 0.320244 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/cv1/act/Mul | HzSwish | BPU | 547.588562 | 0.941660 | 0.308373 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/Split | Split | BPU | 215.129776 | 0.954993 | 0.389876 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/m.0/cv1/conv/Conv | Conv | BPU | 210.769608 | 0.928284 | 0.353655 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/m.0/cv1/act/Mul | HzSwish | BPU | 214.507599 | 0.909086 | 0.333812 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/m.0/m/m.0/cv1/conv/Conv | Conv | BPU | 97.436951 | 0.938651 | 0.49555 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/m.0/m/m.0/cv1/act/Mul | HzSwish | BPU | 168.797623 | 0.834172 | 0.0215175 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/m.0/m/m.0/cv2/conv/Conv | Conv | BPU | 55.509354 | 0.852180 | 0.0660395 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/m.0/m/m.0/cv2/act/Mul | HzSwish | BPU | 61.031242 | 0.839391 | 0.16904 | si8 |
2026-05-11 16:21:12,379 INFO | /model.6/m.0/m/m.0/Add | Add | BPU | 97.436951 | 0.897643 | 0.390715 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/m/m.1/cv1/conv/Conv | Conv | BPU | 104.747574 | 0.934342 | 0.552307 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/m/m.1/cv1/act/Mul | HzSwish | BPU | 109.960869 | 0.862837 | 0.13546 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/m/m.1/cv2/conv/Conv | Conv | BPU | 43.824482 | 0.907537 | 0.054444 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/m/m.1/cv2/act/Mul | HzSwish | BPU | 75.643105 | 0.828802 | 0.323149 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/m/m.1/Add | Add | BPU | 104.747574 | 0.905708 | 0.456894 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/cv2/conv/Conv | Conv | BPU | 210.769608 | 0.924431 | 0.131217 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/cv2/act/Mul | HzSwish | BPU | 356.381989 | 0.917582 | 0.190303 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/Concat | Concat | BPU | 273.502686 | 0.913869 | 0.280096 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/cv3/conv/Conv | Conv | BPU | 273.502686 | 0.918926 | 0.30963 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/m.0/cv3/act/Mul | HzSwish | BPU | 196.878601 | 0.910589 | 0.255456 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/Concat | Concat | BPU | 215.129776 | 0.939324 | 0.304074 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/cv2/conv/Conv | Conv | BPU | 209.519867 | 0.958093 | 0.476821 | si8 |
2026-05-11 16:21:12,380 INFO | /model.6/cv2/act/Mul | HzSwish | BPU | 357.071991 | 0.913119 | 0.231361 | si8 |
2026-05-11 16:21:12,380 INFO | /model.7/conv/Conv | Conv | BPU | 111.499817 | 0.951512 | 0.398748 | si8 |
2026-05-11 16:21:12,380 INFO | /model.7/act/Mul | HzSwish | BPU | 175.52298 | 0.928160 | 0.284858 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/cv1/conv/Conv | Conv | BPU | 103.919952 | 0.963963 | 0.570749 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/cv1/act/Mul | HzSwish | BPU | 265.855347 | 0.929559 | 0.427374 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/Split | Split | BPU | 165.217758 | 0.914182 | 0.302352 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/cv1/conv/Conv | Conv | BPU | 180.812958 | 0.963835 | 0.698707 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/cv1/act/Mul | HzSwish | BPU | 172.970535 | 0.869006 | 0.348351 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.0/cv1/conv/Conv | Conv | BPU | 35.605675 | 0.940249 | 0.577153 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.0/cv1/act/Mul | HzSwish | BPU | 98.418327 | 0.757880 | 0.0475016 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.0/cv2/conv/Conv | Conv | BPU | 39.03455 | 0.831917 | 0.259258 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.0/cv2/act/Mul | HzSwish | BPU | 31.524948 | 0.788716 | 0.295858 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.0/Add | Add | BPU | 35.605675 | 0.860083 | 0.40573 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.1/cv1/conv/Conv | Conv | BPU | 38.53574 | 0.923505 | 0.313826 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.1/cv1/act/Mul | HzSwish | BPU | 53.109779 | 0.788609 | 0.333895 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.1/cv2/conv/Conv | Conv | BPU | 16.21316 | 0.858130 | 0.403729 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.1/cv2/act/Mul | HzSwish | BPU | 35.92659 | 0.843871 | 0.46513 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/m/m.1/Add | Add | BPU | 38.53574 | 0.879656 | 0.480716 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/cv2/conv/Conv | Conv | BPU | 180.812958 | 0.952679 | 0.637481 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/cv2/act/Mul | HzSwish | BPU | 268.512543 | 0.940299 | 0.562211 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/Concat | Concat | BPU | 199.249634 | 0.936517 | 0.493403 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/cv3/conv/Conv | Conv | BPU | 199.249634 | 0.945017 | 0.465102 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/m.0/cv3/act/Mul | HzSwish | BPU | 151.093048 | 0.944705 | 0.479342 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/Concat | Concat | BPU | 165.217758 | 0.932702 | 0.436519 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/cv2/conv/Conv | Conv | BPU | 161.043381 | 0.965375 | 0.63171 | si8 |
2026-05-11 16:21:12,380 INFO | /model.8/cv2/act/Mul | HzSwish | BPU | 239.729279 | 0.888692 | 0.288457 | si8 |
2026-05-11 16:21:12,380 INFO | /model.9/cv1/conv/Conv | Conv | BPU | 86.060417 | 0.924672 | -0.144636 | si8 |
2026-05-11 16:21:12,380 INFO | /model.9/m/MaxPool | MaxPool | BPU | 69.991173 | 0.947267 | 0.575239 | si8 |
2026-05-11 16:21:12,380 INFO | /model.9/m_1/MaxPool | MaxPool | BPU | 69.991173 | 0.963302 | 0.682921 | si8 |
2026-05-11 16:21:12,380 INFO | /model.9/m_2/MaxPool | MaxPool | BPU | 69.991173 | 0.967957 | 0.716444 | si8 |
2026-05-11 16:21:12,380 INFO | /model.9/Concat | Concat | BPU | 69.991173 | 0.953389 | 0.539951 | si8 |
2026-05-11 16:21:12,380 INFO | /model.9/cv2/conv/Conv | Conv | BPU | 60.04681 | 0.961368 | 0.653881 | si8 |
2026-05-11 16:21:12,380 INFO | /model.9/cv2/act/Mul | HzSwish | BPU | 106.833961 | 0.907948 | 0.104964 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/cv1/conv/Conv | Conv | BPU | 41.159988 | 0.929719 | 0.342625 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/cv1/act/Mul | HzSwish | BPU | 170.641785 | 0.895368 | 0.242719 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/Split | Split | BPU | 99.064278 | 0.895486 | 0.255993 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/m/m.0/attn/qkv/conv/Conv | Conv | BPU | 66.942963 | 0.918963 | 0.0831237 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/m/m.0/attn/Reshape | Reshape | BPU | 122.697128 | 0.918963 | 0.0829409 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/m/m.0/attn/Split | Split | BPU | 122.697128 | 0.951377 | 0.145926 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/m/m.0/attn/Transpose | Transpose | BPU | 122.697128 | 0.921257 | 0.145926 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/m/m.0/attn/MatMul | MatMul | BPU | 122.697128 | 0.961670 | 0.516979 | si8 |
2026-05-11 16:21:12,380 INFO | /model.10/m/m.0/attn/Mul | Mul | BPU | 6888.411621 | 0.961669 | 0.516986 | si16 |
2026-05-11 16:21:12,380 INFO | …tmax_reducemax_FROM_QUANTIZED_SOFTMAX | ReduceMax | BPU | 1217.710571 | 0.977822 | – | si16 |
2026-05-11 16:21:12,380 INFO | …tn/Softmax_sub_FROM_QUANTIZED_SOFTMAX | Sub | BPU | 1217.710571 | 0.692137 | – | si16 |
2026-05-11 16:21:12,380 INFO | …tn/Softmax_exp_FROM_QUANTIZED_SOFTMAX | Exp | – | 11.090324 | 0.132219 | – | – |
2026-05-11 16:21:12,381 INFO | …tmax_reducesum_FROM_QUANTIZED_SOFTMAX | ReduceSum | BPU | 1.0 | 0.461317 | – | si16 |
2026-05-11 16:21:12,381 INFO | …max_reciprocal_FROM_QUANTIZED_SOFTMAX | Reciprocal | – | 48.635765 | 0.854974 | – | – |
2026-05-11 16:21:12,381 INFO | …tn/Softmax_mul_FROM_QUANTIZED_SOFTMAX | Mul | BPU | 1.0 | 0.313796 | 0.0436576 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/attn/Transpose_1 | Transpose | – | 1.0 | 0.313795 | – | – |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/attn/MatMul_1 | MatMul | BPU | 75.197166 | 0.888455 | 0.105957 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/attn/Reshape_1 | Reshape | BPU | 98.125 | 0.888455 | 0.105957 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/attn/Reshape_2 | Reshape | BPU | 75.197166 | 0.897850 | 0.123308 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/attn/pe/conv/Conv | Conv | BPU | 75.197166 | 0.907583 | – | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/attn/Reshape_1+/model.10/m/m.0/attn/Add | Reshape+Add | BPU | 98.125 | 0.797263 | – | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/attn/proj/conv/Conv | Conv | BPU | 83.476875 | 0.754362 | 0.112618 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/Split+/model.10/m/m.0/Add | Split+Add | BPU | 99.064278 | 0.801010 | 0.112618 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/ffn/ffn.0/conv/Conv | Conv | BPU | 67.086525 | 0.813509 | 0.290077 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/ffn/ffn.0/act/Mul | HzSwish | BPU | 91.149628 | 0.763034 | 0.29088 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/ffn/ffn.1/conv/Conv | Conv | BPU | 68.423065 | 0.793752 | 0.455315 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/m/m.0/attn/proj/conv/Conv+/model.10/m/m.0/Add_1 | Conv+Add | BPU | 83.476875 | 0.822897 | 0.455315 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/Concat | Concat | BPU | 99.064278 | 0.828955 | 0.437082 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/cv2/conv/Conv | Conv | BPU | 147.739029 | 0.919799 | 0.790154 | si8 |
2026-05-11 16:21:12,381 INFO | /model.10/cv2/act/Mul | HzSwish | BPU | 185.118073 | 0.586565 | 0.16134 | si8 |
2026-05-11 16:21:12,381 INFO | /model.11/Resize | Resize | BPU | 48.666119 | 0.586566 | 0.164096 | si8 |
2026-05-11 16:21:12,381 INFO | /model.12/Concat | Concat | BPU | 48.666119 | 0.821770 | 0.164126 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/cv1/conv/Conv | Conv | BPU | 92.968636 | 0.848636 | 0.250403 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/cv1/act/Mul | HzSwish | BPU | 86.984787 | 0.810451 | 0.336884 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/Split | Split | BPU | 64.771065 | 0.794760 | 0.301287 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/m.0/cv1/conv/Conv | Conv | BPU | 48.933708 | 0.882070 | 0.512904 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/m.0/cv1/act/Mul | HzSwish | BPU | 105.587402 | 0.743823 | 0.283698 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/m.0/cv2/conv/Conv | Conv | BPU | 42.019596 | 0.793446 | 0.420538 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/m.0/cv2/act/Mul | HzSwish | BPU | 79.150192 | 0.722326 | 0.363871 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/m.0/Add | Add | BPU | 48.933708 | 0.823296 | 0.476103 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/Concat | Concat | BPU | 64.771065 | 0.815884 | 0.398655 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/cv2/conv/Conv | Conv | BPU | 63.019989 | 0.895600 | 0.597166 | si8 |
2026-05-11 16:21:12,381 INFO | /model.13/cv2/act/Mul | HzSwish | BPU | 116.83989 | 0.734361 | 0.299397 | si8 |
2026-05-11 16:21:12,381 INFO | /model.14/Resize | Resize | BPU | 37.574505 | 0.734328 | 0.343274 | si8 |
2026-05-11 16:21:12,381 INFO | /model.15/Concat | Concat | BPU | 37.574505 | 0.924703 | 0.0686767 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/cv1/conv/Conv | Conv | BPU | 147.774246 | 0.956532 | 0.497589 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/cv1/act/Mul | HzSwish | BPU | 255.092209 | 0.893173 | 0.24844 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/Split | Split | BPU | 53.185299 | 0.893845 | 0.247195 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/m.0/cv1/conv/Conv | Conv | BPU | 50.121967 | 0.888975 | -0.0536161 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/m.0/cv1/act/Mul | HzSwish | BPU | 71.811874 | 0.884865 | 0.193293 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/m.0/cv2/conv/Conv | Conv | BPU | 65.077751 | 0.881444 | 0.00981073 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/m.0/cv2/act/Mul | HzSwish | BPU | 112.204269 | 0.789423 | 0.211825 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/m.0/Add | Add | BPU | 50.121967 | 0.853862 | 0.234859 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/Concat | Concat | BPU | 53.185299 | 0.873433 | 0.243032 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/cv2/conv/Conv | Conv | BPU | 53.711334 | 0.867814 | 0.218986 | si8 |
2026-05-11 16:21:12,381 INFO | /model.16/cv2/act/Mul | HzSwish | BPU | 81.671844 | 0.881612 | 0.270863 | si8 |
2026-05-11 16:21:12,381 INFO | /model.17/conv/Conv | Conv | BPU | 69.021194 | 0.908521 | 0.360555 | si8 |
2026-05-11 16:21:12,381 INFO | /model.17/act/Mul | HzSwish | BPU | 69.286331 | 0.892149 | 0.245712 | si8 |
2026-05-11 16:21:12,381 INFO | /model.18/Concat | Concat | BPU | 46.983341 | 0.825467 | 0.26545 | si8 |
2026-05-11 16:21:12,381 INFO | /model.19/cv1/conv/Conv | Conv | BPU | 46.983341 | 0.884682 | 0.443314 | si8 |
2026-05-11 16:21:12,381 INFO | /model.19/cv1/act/Mul | HzSwish | BPU | 70.497513 | 0.797971 | 0.322275 | si8 |
2026-05-11 16:21:12,381 INFO | /model.19/Split | Split | BPU | 41.75238 | 0.799474 | 0.353696 | si8 |
2026-05-11 16:21:12,381 INFO | /model.19/m.0/cv1/conv/Conv | Conv | BPU | 26.898848 | 0.836062 | 0.228953 | si8 |
2026-05-11 16:21:12,381 INFO | /model.19/m.0/cv1/act/Mul | HzSwish | BPU | 52.214134 | 0.751378 | 0.315503 | si8 |
2026-05-11 16:21:12,382 INFO | /model.19/m.0/cv2/conv/Conv | Conv | BPU | 37.070232 | 0.774022 | 0.273359 | si8 |
2026-05-11 16:21:12,382 INFO | /model.19/m.0/cv2/act/Mul | HzSwish | BPU | 68.372917 | 0.700582 | 0.245616 | si8 |
2026-05-11 16:21:12,382 INFO | /model.19/m.0/Add | Add | BPU | 26.898848 | 0.747370 | 0.268911 | si8 |
2026-05-11 16:21:12,382 INFO | /model.19/Concat | Concat | BPU | 41.75238 | 0.773782 | 0.300176 | si8 |
2026-05-11 16:21:12,382 INFO | /model.19/cv2/conv/Conv | Conv | BPU | 44.337784 | 0.815924 | 0.419696 | si8 |
2026-05-11 16:21:12,382 INFO | /model.19/cv2/act/Mul | HzSwish | BPU | 66.424866 | 0.717404 | 0.24597 | si8 |
2026-05-11 16:21:12,382 INFO | /model.20/conv/Conv | Conv | BPU | 30.344326 | 0.847123 | 0.508057 | si8 |
2026-05-11 16:21:12,382 INFO | /model.20/act/Mul | HzSwish | BPU | 58.551563 | 0.801846 | 0.353046 | si8 |
2026-05-11 16:21:12,382 INFO | /model.21/Concat | Concat | BPU | 46.289806 | 0.633770 | 0.183535 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/cv1/conv/Conv | Conv | BPU | 46.289806 | 0.750304 | 0.354992 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/cv1/act/Mul | HzSwish | BPU | 81.561172 | 0.597792 | 0.280491 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/Split | Split | BPU | 49.782333 | 0.568580 | 0.232027 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/cv1/conv/Conv | Conv | BPU | 49.551422 | 0.764411 | 0.607357 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/cv1/act/Mul | HzSwish | BPU | 40.901157 | 0.507228 | 0.276541 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.0/cv1/conv/Conv | Conv | BPU | 12.511212 | 0.532190 | 0.4114 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.0/cv1/act/Mul | HzSwish | BPU | 47.247391 | 0.457000 | 0.175336 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.0/cv2/conv/Conv | Conv | BPU | 28.406231 | 0.621697 | 0.405714 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.0/cv2/act/Mul | HzSwish | BPU | 55.114552 | 0.472016 | 0.200568 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.0/Add | Add | BPU | 12.511212 | 0.512523 | 0.168477 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.1/cv1/conv/Conv | Conv | BPU | 37.521248 | 0.734672 | 0.410112 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.1/cv1/act/Mul | HzSwish | BPU | 65.340378 | 0.506371 | 0.186939 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.1/cv2/conv/Conv | Conv | BPU | 27.395306 | 0.631246 | 0.234851 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.1/cv2/act/Mul | HzSwish | BPU | 86.810577 | 0.693632 | 0.444031 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/m/m.1/Add | Add | BPU | 37.521248 | 0.722664 | 0.452789 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/cv2/conv/Conv | Conv | BPU | 49.551422 | 0.746807 | 0.546553 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/cv2/act/Mul | HzSwish | BPU | 74.343765 | 0.631296 | 0.471149 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/Concat | Concat | BPU | 81.408508 | 0.686466 | 0.382746 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/cv3/conv/Conv | Conv | BPU | 81.408508 | 0.695322 | 0.329415 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/m.0/cv3/act/Mul | HzSwish | BPU | 101.422676 | 0.535022 | 0.229055 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/Concat | Concat | BPU | 49.782333 | 0.576744 | 0.263409 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/cv2/conv/Conv | Conv | BPU | 48.832722 | 0.725973 | 0.436956 | si8 |
2026-05-11 16:21:12,382 INFO | /model.22/cv2/act/Mul | HzSwish | BPU | 75.491318 | 0.530821 | 0.273914 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.0/cv2.0.0/conv/Conv | Conv | BPU | 69.021194 | 0.926622 | 0.444473 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.0/cv2.0.0/act/Mul | HzSwish | BPU | 87.37941 | 0.819527 | 0.077299 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.0/cv2.0.1/conv/Conv | Conv | BPU | 41.182571 | 0.862727 | 0.050508 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.0/cv2.0.1/act/Mul | HzSwish | BPU | 255.500519 | 0.867773 | 0.259349 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.0/cv2.0.2/Conv | Conv | BPU | 243.852661 | 0.895356 | 0.259025 | si16 |
2026-05-11 16:21:12,382 INFO | /model.23/Reshape | Reshape | BPU | 122.158539 | 0.895356 | 0.259025 | si16 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.1/cv2.1.0/conv/Conv | Conv | BPU | 30.344326 | 0.781092 | 0.365929 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.1/cv2.1.0/act/Mul | HzSwish | BPU | 75.73011 | 0.706579 | 0.207684 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.1/cv2.1.1/conv/Conv | Conv | BPU | 45.167706 | 0.729277 | 0.112042 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.1/cv2.1.1/act/Mul | HzSwish | BPU | 263.286926 | 0.766243 | 0.302246 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.1/cv2.1.2/Conv | Conv | BPU | 263.286926 | 0.795275 | 0.372887 | si16 |
2026-05-11 16:21:12,382 INFO | /model.23/Reshape_1 | Reshape | BPU | 122.158539 | 0.795275 | 0.372887 | si16 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.2/cv2.2.0/conv/Conv | Conv | BPU | 41.215839 | 0.667173 | 0.29928 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.2/cv2.2.0/act/Mul | HzSwish | BPU | 106.365906 | 0.596964 | 0.41275 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.2/cv2.2.1/conv/Conv | Conv | BPU | 30.262478 | 0.642980 | 0.267262 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.2/cv2.2.1/act/Mul | HzSwish | BPU | 181.966354 | 0.690772 | 0.464466 | si8 |
2026-05-11 16:21:12,382 INFO | /model.23/cv2.2/cv2.2.2/Conv | Conv | BPU | 181.966354 | 0.776509 | 0.566848 | si16 |
2026-05-11 16:21:12,382 INFO | /model.23/Reshape_2 | Reshape | BPU | 122.158539 | 0.776509 | 0.566848 | si16 |
2026-05-11 16:21:12,382 INFO | /model.23/Concat | Concat | BPU | 122.158539 | 0.884375 | 0.278301 | si16 |
2026-05-11 16:21:12,382 INFO | …23/cv3.0/cv3.0.0/cv3.0.0.0/conv/Conv | Conv | BPU | 69.021194 | 0.912898 | 0.396895 | si8 |
2026-05-11 16:21:12,382 INFO | …el.23/cv3.0/cv3.0.0/cv3.0.0.0/act/Mul | HzSwish | BPU | 88.663803 | 0.924844 | 0.538335 | si8 |
2026-05-11 16:21:12,382 INFO | …23/cv3.0/cv3.0.0/cv3.0.0.1/conv/Conv | Conv | BPU | 87.593925 | 0.902002 | 0.364348 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.0/cv3.0.0/cv3.0.0.1/act/Mul | HzSwish | BPU | 84.387466 | 0.897515 | 0.431522 | si8 |
2026-05-11 16:21:12,383 INFO | …23/cv3.0/cv3.0.1/cv3.0.1.0/conv/Conv | Conv | BPU | 57.224781 | 0.910477 | 0.387211 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.0/cv3.0.1/cv3.0.1.0/act/Mul | HzSwish | BPU | 66.316681 | 0.885796 | 0.448837 | si8 |
2026-05-11 16:21:12,383 INFO | …23/cv3.0/cv3.0.1/cv3.0.1.1/conv/Conv | Conv | BPU | 46.35553 | 0.873234 | 0.217073 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.0/cv3.0.1/cv3.0.1.1/act/Mul | HzSwish | BPU | 260.759033 | 0.850191 | 0.375862 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/cv3.0/cv3.0.2/Conv | Conv | BPU | 228.071823 | 0.908154 | 0.904696 | si16 |
2026-05-11 16:21:12,383 INFO | /model.23/Reshape_3 | Reshape | BPU | 11.09031 | 0.908154 | 0.904696 | si16 |
2026-05-11 16:21:12,383 INFO | …23/cv3.1/cv3.1.0/cv3.1.0.0/conv/Conv | Conv | BPU | 30.344326 | 0.818556 | 0.472636 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.1/cv3.1.0/cv3.1.0.0/act/Mul | HzSwish | BPU | 58.442734 | 0.825281 | 0.555324 | si8 |
2026-05-11 16:21:12,383 INFO | …23/cv3.1/cv3.1.0/cv3.1.0.1/conv/Conv | Conv | BPU | 51.763023 | 0.851901 | 0.57733 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.1/cv3.1.0/cv3.1.0.1/act/Mul | HzSwish | BPU | 72.589851 | 0.746716 | 0.423374 | si8 |
2026-05-11 16:21:12,383 INFO | …23/cv3.1/cv3.1.1/cv3.1.1.0/conv/Conv | Conv | BPU | 36.28904 | 0.737574 | 0.436097 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.1/cv3.1.1/cv3.1.1.0/act/Mul | HzSwish | BPU | 42.051666 | 0.803321 | 0.619302 | si8 |
2026-05-11 16:21:12,383 INFO | …23/cv3.1/cv3.1.1/cv3.1.1.1/conv/Conv | Conv | BPU | 29.242893 | 0.649243 | 0.458142 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.1/cv3.1.1/cv3.1.1.1/act/Mul | HzSwish | BPU | 161.052032 | 0.652678 | 0.527875 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/cv3.1/cv3.1.2/Conv | Conv | BPU | 133.086548 | 0.956701 | 0.956132 | si16 |
2026-05-11 16:21:12,383 INFO | /model.23/Reshape_4 | Reshape | BPU | 11.09031 | 0.956701 | 0.956132 | si16 |
2026-05-11 16:21:12,383 INFO | …23/cv3.2/cv3.2.0/cv3.2.0.0/conv/Conv | Conv | BPU | 41.215839 | 0.618159 | 0.371604 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.2/cv3.2.0/cv3.2.0.0/act/Mul | HzSwish | BPU | 88.462303 | 0.675205 | 0.471401 | si8 |
2026-05-11 16:21:12,383 INFO | …23/cv3.2/cv3.2.0/cv3.2.0.1/conv/Conv | Conv | BPU | 70.519371 | 0.779525 | 0.548931 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.2/cv3.2.0/cv3.2.0.1/act/Mul | HzSwish | BPU | 85.819069 | 0.650663 | 0.320906 | si8 |
2026-05-11 16:21:12,383 INFO | …23/cv3.2/cv3.2.1/cv3.2.1.0/conv/Conv | Conv | BPU | 45.219406 | 0.719822 | 0.443862 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.2/cv3.2.1/cv3.2.1.0/act/Mul | HzSwish | BPU | 51.65884 | 0.771083 | 0.494311 | si8 |
2026-05-11 16:21:12,383 INFO | …23/cv3.2/cv3.2.1/cv3.2.1.1/conv/Conv | Conv | BPU | 44.154854 | 0.712619 | 0.214256 | si8 |
2026-05-11 16:21:12,383 INFO | …el.23/cv3.2/cv3.2.1/cv3.2.1.1/act/Mul | HzSwish | BPU | 160.622162 | 0.700860 | 0.390241 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/cv3.2/cv3.2.2/Conv | Conv | BPU | 159.598389 | 0.937723 | 0.92689 | si16 |
2026-05-11 16:21:12,383 INFO | /model.23/Reshape_5 | Reshape | BPU | 11.09031 | 0.937723 | 0.92689 | si16 |
2026-05-11 16:21:12,383 INFO | /model.23/Concat_1 | Concat | BPU | 11.09031 | 0.904628 | 0.901379 | si16 |
2026-05-11 16:21:12,383 INFO | /model.23/dfl/Reshape | Reshape | BPU | 122.158539 | 0.884375 | – | si16 |
2026-05-11 16:21:12,383 INFO | /model.23/dfl/Transpose | Transpose | BPU | 122.158539 | 0.884378 | – | si16 |
2026-05-11 16:21:12,383 INFO | …tmax_reducemax_FROM_QUANTIZED_SOFTMAX | ReduceMax | BPU | 122.158539 | 0.950604 | – | si16 |
2026-05-11 16:21:12,383 INFO | …fl/Softmax_sub_FROM_QUANTIZED_SOFTMAX | Sub | BPU | 122.158539 | 0.792102 | – | si16 |
2026-05-11 16:21:12,383 INFO | …fl/Softmax_exp_FROM_QUANTIZED_SOFTMAX | Exp | – | 11.090324 | 0.681781 | – | – |
2026-05-11 16:21:12,383 INFO | …tmax_reducesum_FROM_QUANTIZED_SOFTMAX | ReduceSum | BPU | 1.0 | 0.904823 | – | si16 |
2026-05-11 16:21:12,383 INFO | …max_reciprocal_FROM_QUANTIZED_SOFTMAX | Reciprocal | – | 10.133236 | 0.950647 | – | – |
2026-05-11 16:21:12,383 INFO | …fl/Softmax_mul_FROM_QUANTIZED_SOFTMAX | Mul | BPU | 1.0 | 0.725497 | – | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/dfl/Transpose_1 | Transpose | – | 1.0 | 0.725502 | 0.326448 | – |
2026-05-11 16:21:12,383 INFO | /model.23/dfl/conv/Conv | Conv | BPU | 1.0 | 0.907746 | 0.694002 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Slice | Slice | BPU | 14.802801 | 0.884862 | 0.702507 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Slice_1 | Slice | BPU | 14.802801 | 0.923929 | 0.727354 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Sub | Sub | BPU | 79.5 | 0.998631 | 0.995511 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Add_1 | Add | BPU | 79.5 | 0.999043 | 0.997085 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Add_2 | Add | BPU | 79.435814 | 0.999590 | 0.998944 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Div_1_mul | Mul | BPU | 161.928894 | 0.999589 | 0.998943 | si8 |
2026-05-11 16:21:12,383 INFO | …mul/model.23/Div_1_output_0_Reshape | Reshape | BPU | 80.695976 | 0.999589 | 0.998943 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Sub_1 | Sub | BPU | 87.011543 | 0.933009 | 0.772432 | si8 |
2026-05-11 16:21:12,383 INFO | …ub_1_/model.23/Sub_1_output_0_Reshape | Reshape | BPU | 80.695976 | 0.933009 | 0.772432 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Concat_2 | Concat | BPU | 80.695976 | 0.996742 | 0.988992 | si8 |
2026-05-11 16:21:12,383 INFO | /model.23/Mul_2 | Mul | BPU | 80.695976 | 0.993560 | 0.9825 | si16 |
2026-05-11 16:21:12,383 INFO | /model.23/Sigmoid | Sigmoid | BPU | 11.09031 | 0.405706 | 0.0402401 | si16 |
2026-05-11 16:21:12,383 INFO | /model.23/Concat_3 | Concat | – | 673.74585 | 0.993560 | – | – |
2026-05-11 16:21:12,383 INFO ±----------------------------------------------------------±------------±----±-------------±------------------±-----------------±-----------------+
2026-05-11 16:21:12,384 INFO ±-----------±------------------±-----------------+
2026-05-11 16:21:12,384 INFO | TensorName | Calibrated Cosine | Quantized Cosine |
2026-05-11 16:21:12,384 INFO ±-----------±------------------±-----------------+
2026-05-11 16:21:12,384 INFO | output0 | 0.993560 | 0.9825 |
2026-05-11 16:21:12,384 INFO ±-----------±------------------±-----------------+
Remove op type b30vpu.dequantize successfully, delete node type list [‘Dequantize’]
2026-05-11 16:21:12,412 INFO Successfully remove node, the removed node info is:
2026-05-11 16:21:12,412 INFO Node Name Type
2026-05-11 16:21:12,412 INFO --------------------- ----------
2026-05-11 16:21:12,412 INFO output0_HzCalibration Dequantize
2026-05-11 16:21:12,452 INFO Start to compile model.
[==================================================]100%
[08h:27m:36s:687250760ns INFO hbrt4_log::logger] pid:8805 tid:8805 hbrt4_log/src/logger.rs:409: Logger of HBRT4 initialized, version = 4.7.5
[08h:27m:36s:687257766ns INFO hbrt4_loader::parsing] pid:8805 tid:8805 hbrt4_loader/src/parsing.rs:126: Load hbm from file; filename=“/data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm”
2026-05-11 16:27:36,700 INFO Successfully compile the hbm model, generated hbm model is saved at /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm
[08h:27m:36s:706012897ns INFO hbrt4_log::logger] pid:17380 tid:17380 hbrt4_log/src/logger.rs:409: Logger of HBRT4 initialized, version = 4.7.5
[08h:27m:36s:706021165ns INFO hbrt4_loader::parsing] pid:17380 tid:17380 hbrt4_loader/src/parsing.rs:74: Load hbm header from file /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm
[08h:27m:36s:706316535ns INFO hbrt4_log::logger] pid:17380 tid:17380 hbrt4_log/src/logger.rs:409: Logger of HBRT4 initialized, version = 4.7.5
[08h:27m:36s:706321243ns INFO hbrt4_loader::parsing] pid:17380 tid:17380 hbrt4_loader/src/parsing.rs:126: Load hbm from file; filename=“/data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm”
FPS=923.13, latency = 1083.3 us, DDR = 16439424 bytes, Compiling HBDK version = “4.7.5” (see /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.html)
A total of 1 graphs were processed.
HBDK hbm perf SUCCESS
2026-05-11 16:27:37,016 INFO Successfully perf the model, generated result is saved at /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output
2026-05-11 16:27:37,016 INFO hbm_path: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm
[08h:27m:37s:016999287ns INFO hbrt4_loader::parsing] pid:8805 tid:8805 hbrt4_loader/src/parsing.rs:74: Load hbm header from file /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm
[08h:27m:37s:017778973ns INFO hbrt4_log::logger] pid:8805 tid:8805 hbrt4_log/src/logger.rs:409: Logger of HBRT4 initialized, version = 4.7.5
[08h:27m:37s:017781604ns INFO hbrt4_loader::parsing] pid:8805 tid:8805 hbrt4_loader/src/parsing.rs:126: Load hbm from file; filename=“/data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm”
2026-05-11 16:27:37,021 INFO ************************* yolo11n_coco_640x640_nv12 *************************
2026-05-11 16:27:37,021 INFO ############# model deps info #############
2026-05-11 16:27:37,021 INFO builder version : 3.5.3
2026-05-11 16:27:37,021 INFO hbdk version : 4.7.5
2026-05-11 16:27:37,021 INFO hmct version : 2.6.5
2026-05-11 16:27:37,021 INFO ############# model_parameters info #############
2026-05-11 16:27:37,021 INFO onnx_model : /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/best.onnx
2026-05-11 16:27:37,021 INFO BPU march : nash-e
2026-05-11 16:27:37,021 INFO layer_out_dump : False
2026-05-11 16:27:37,021 INFO working dir : /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output
2026-05-11 16:27:37,021 INFO output_model_file_prefix: yolo11n_coco_640x640_nv12
2026-05-11 16:27:37,021 INFO remove_node_type : Dequantize
2026-05-11 16:27:37,021 INFO node_info : {}
2026-05-11 16:27:37,021 INFO ############# input_parameters info #############
2026-05-11 16:27:37,021 INFO ------------------------------------------
2026-05-11 16:27:37,021 INFO ---------input info : images ---------
2026-05-11 16:27:37,021 INFO input_name : images
2026-05-11 16:27:37,021 INFO input_type_rt : nv12
2026-05-11 16:27:37,021 INFO input_space&range : regular
2026-05-11 16:27:37,021 INFO input_type_train : rgb
2026-05-11 16:27:37,021 INFO input_layout_train : NCHW
2026-05-11 16:27:37,022 INFO norm_type : data_mean_and_scale
2026-05-11 16:27:37,022 INFO input_shape : 1x3x640x640
2026-05-11 16:27:37,022 INFO mean_value : [0.0, 0.0, 0.0]
2026-05-11 16:27:37,022 INFO scale_value : [0.003921568627, 0.003921568627, 0.003921568627]
2026-05-11 16:27:37,022 INFO std_value :
2026-05-11 16:27:37,022 INFO input_batch : 1
2026-05-11 16:27:37,022 INFO separate_batch : False
2026-05-11 16:27:37,022 INFO ---------input info : images end -------
2026-05-11 16:27:37,022 INFO ------------------------------------------
2026-05-11 16:27:37,022 INFO ############# calibration_parameters info #############
2026-05-11 16:27:37,022 INFO calibration_type : default
2026-05-11 16:27:37,022 INFO max_percentile : None
2026-05-11 16:27:37,022 INFO per_channel : False
2026-05-11 16:27:37,022 INFO cal_data_dir : /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/calibration_data_rgb
2026-05-11 16:27:37,022 INFO ############# compiler_parameters info #############
2026-05-11 16:27:37,022 INFO debug : True
2026-05-11 16:27:37,022 INFO optimize_level : O2
2026-05-11 16:27:37,022 INFO compile_mode : latency
2026-05-11 16:27:37,022 INFO core_num : 1
2026-05-11 16:27:37,022 INFO max_time_per_fc : 1000
2026-05-11 16:27:37,022 INFO balance_factor : 100
2026-05-11 16:27:37,022 INFO input_source : {‘images’: ‘pyramid’}
2026-05-11 16:27:37,022 INFO cache_mode : disable
2026-05-11 16:27:37,022 INFO max_l2m_size : 0
2026-05-11 16:27:37,022 INFO ############# memory info #############
2026-05-11 16:27:37,024 INFO input memory : 614400
2026-05-11 16:27:37,024 INFO output memory : 1419264
2026-05-11 16:27:37,024 INFO static memory : 5128744
2026-05-11 16:27:37,024 INFO dynamic memory : 4770304
2026-05-11 16:27:37,024 INFO intermediate memory : 0
2026-05-11 16:27:37,024 INFO temporary memory : 2736640
2026-05-11 16:27:37,024 INFO min memory requirement: 9899048
2026-05-11 16:27:37,025 INFO hbm_path: /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm
[08h:27m:37s:025076690ns INFO hbrt4_loader::parsing] pid:8805 tid:8805 hbrt4_loader/src/parsing.rs:74: Load hbm header from file /data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm
[08h:27m:37s:025440356ns INFO hbrt4_log::logger] pid:8805 tid:8805 hbrt4_log/src/logger.rs:409: Logger of HBRT4 initialized, version = 4.7.5
[08h:27m:37s:025442943ns INFO hbrt4_loader::parsing] pid:8805 tid:8805 hbrt4_loader/src/parsing.rs:126: Load hbm from file; filename=“/data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights/model_output/yolo11n_coco_640x640_nv12.hbm”
2026-05-11 16:27:37,029 INFO ############# Model input/output info #############
2026-05-11 16:27:37,029 INFO NAME TYPE SHAPE DATA_TYPE
2026-05-11 16:27:37,029 INFO --------- ------ ---------------- ---------
2026-05-11 16:27:37,029 INFO images_y input [1, 640, 640, 1] UINT8
2026-05-11 16:27:37,029 INFO images_uv input [1, 320, 320, 2] UINT8
2026-05-11 16:27:37,029 INFO output0 output [1, 84, 8400] INT16
2026-05-11 16:27:37,029 INFO The hb_compile completes running.
root@OE-GPU-3-7-0:/data/datasets/runs/detect/runs/detect/yolo11n_coco_check/weights# scp model_output/yolo11n_coco_640x640_nv12.hbm sunrise@192.168.154.92:/app/cdev_demo/bpu/02_detection_sample/02_ultralytics_yolo11