original_float_model.onnx，calibrated_model.onnx，quantized_model.onnx模型区别

usssss · 2023 年12 月 13 日 06:04

1.芯片型号：J5

2.天工开物开发包OpenExplorer版本：J5_OE_1.1.68

3.问题定位：模型转换

4.问题具体描述：您好，请问模型转换过程中生成original_float_model.onnx，calibrated_model.onnx，quantized_model.onnx这几个模型转换过程中分别做了哪些操作？

我们的original_float_model结果与公板onnx结果一致，但calibrated_model模型就有较大偏差，quantized_model.onnx与calibrated_model模型相比也有小部分偏差。

量化过程以及打印的余弦相似度应该是发生在calibrated_model->quantized_model.onnx的吧？那从original_float_model->calibrated_model中发生了什么，进行了哪些操作？

另外quantized_model.onnx与板端部署bin模型的推理结果也有一点点差异，按道理这两个结果应该也是一致的。

各种模型的输入都按照对应要求的格式准备的，推理出来也有相关性所以基本可以排除是输入数据准备错误。

因为模型太大，在尝试一层层对比结果，不过比较困难，除此方法外误差产生原因目前没有思路排查。

几种onnx及bin推理可视化结果见图：

original_float_model.onnx:

calibrated_model.onnx:

quantized_model.onnx:

板端部署bin模型:

颜值即正义 · 2023 年12 月 15 日 08:31

您好，地平线工具链在持续迭代优化，为了给您提供更好的服务，希望您能抽出3分钟左右的时间，将您在使用工具链期间的感受和建议告诉我们，您的宝贵意见对我们很重要，非常感谢！-
问卷链接：地平线算法工具链使用满意度反馈

颜值即正义 · 2023 年12 月 14 日 05:02

你好，original_float会根据yaml文件配置来决定是否在公版onnx浮点模型前端插入数据预处理节点以及该节点行为（其他部分和公版完全相同）；optimized_model会对original_float做算子/结构上的优化；calibrated_model在optimized_model基础上使用提供的校准数据统计并计算量化参数并保存在校准节点（自动创建的节点）中；quantized_model就是使用calibrated_model保存的量化参数对节点进行量化（此时无校准节点了）。详细的可以参考 6.3.4. 模型量化与编译 — Horizon Open Explorer 。-

从可视化效果上看，公版onnx==orginal_float==optimized_model，这个链路必须满足以排除其他问题；从calibrated_model开始出现精度问题，则是量化的问题，calibrated_model和quantized_model理论上不会有太大偏差，出现偏差原因是Conv Sumin位宽不一致（calib是int16；quanti是int8）因此从int16 → int8会出现一点损失。

颜值即正义 · 2023 年12 月 14 日 05:04

量化过程发生在calibrated_model → quantized_model，余弦相似度计算发生在quantized_model，是计算quantized_model和original_float的对应节点输出相似度

颜值即正义 · 2023 年12 月 14 日 05:06

目前阶段问题主要是量化精度调优，bin模型和quantized_model的对齐建议放在精度调优之后，我们提供的工具hb_verifier可以验证

颜值即正义 · 2023 年12 月 14 日 05:15

量化精度调优，首先建议您参考手册 8.3. PTQ模型精度调优 — Horizon Open Explorer 章节，调整校准方式、调整校准数据、尾部算子回退到CPU进行高精度计算、使用校准参数组中optimization参数提供的一些优化选项（参考 6.2.2.2. 模型编译命令（hb_mapper makertbin） — Horizon Open Explorer）等。-

如不达预期，使用PTQ精度Debug工具并参考文中调优建议： PTQ精度Debug工具 (horizon.cc) ，对部分损失较大算子采用int16量化：PTQ精度调优手段—设置Int16量化 (horizon.cc)

颜值即正义 · 2023 年12 月 14 日 05:17

此外，为了定位calibrated_model到quantized_model的差异是否有其他原因，还麻烦您提供一下转换编译的log文件

usssss · 2023 年12 月 15 日 02:50

2023-12-14 10:29:20,516 file: tool_utils.py func: tool_utils line No: 73 log will be stored in /open_explore/samples/streampetr_yu/hb_mapper_makertbin.log

2023-12-14 10:29:20,516 file: hb_mapper.py func: hb_mapper line No: 127 Start hb_mapper…

2023-12-14 10:29:20,516 file: hb_mapper.py func: hb_mapper line No: 128 hbdk version 3.48.6

2023-12-14 10:29:20,516 file: hb_mapper.py func: hb_mapper line No: 129 horizon_nn version 0.21.2

2023-12-14 10:29:20,516 file: hb_mapper.py func: hb_mapper line No: 130 hb_mapper version 1.21.6

2023-12-14 10:29:20,517 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 522 Start Model Convert…

2023-12-14 10:29:20,524 file: mapper_conf_parser.py func: mapper_conf_parser line No: 104 validating model_parameters…

2023-12-14 10:29:20,525 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1360 Using abs path /open_explore/samples/streampetr_yu/streampetr_input_only_img_run_1206.onnx

2023-12-14 10:29:20,525 file: mapper_conf_parser.py func: mapper_conf_parser line No: 259 Using onnx model file: /open_explore/samples/streampetr_yu/streampetr_input_only_img_run_1206.onnx

2023-12-14 10:29:20,631 file: helper.py func: helper line No: 145 Model input names: [‘img’]

2023-12-14 10:29:20,631 file: mapper_conf_parser.py func: mapper_conf_parser line No: 263 Model has 1 inputs according to model file

2023-12-14 10:29:20,631 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1360 Using abs path /open_explore/samples/streampetr_yu/model_output_bin

2023-12-14 10:29:20,631 file: mapper_conf_parser.py func: mapper_conf_parser line No: 452 node_dict: {self.node_dict}

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 118 validating model_parameters finished

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 122 validating input_parameters…

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 550 Model input shape not given in yaml_file, using shape from model file: [[6, 3, 256, 704]]

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 732 Nv12 input layout info received. input type rt ‘0’ is nv12 and layout ‘NCHW’ is not needed.

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 134 validating input_parameters finished

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 138 validating calibration_parameters…

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1360 Using abs path /open_explore/samples/streampetr_yu/calib/img_self

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1020 The calibration dir name suffix is not the same as the value float32 of the parameter cal_data_type, the parameter setting will prevail

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 154 validating calibration_parameters finished

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 158 validating custom_op…

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1089 custom_op does not exist, skipped

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 164 validating custom_op finished

2023-12-14 10:29:20,632 file: mapper_conf_parser.py func: mapper_conf_parser line No: 167 validating compiler_parameters…

2023-12-14 10:29:20,633 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1170 Input node img’s input_source not set, it will be set to pyramid by default

2023-12-14 10:29:20,633 file: mapper_conf_parser.py func: mapper_conf_parser line No: 182 validating compiler_parameters finished

2023-12-14 10:29:20,633 file: mapper_conf_parser.py func: mapper_conf_parser line No: 186 validating deprecated parameters…

2023-12-14 10:29:20,633 file: mapper_conf_parser.py func: mapper_conf_parser line No: 192 validating deprecated parameters finished

2023-12-14 10:29:20,633 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 54 Dump config:

2023-12-14 10:29:20,633 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 55 calibration_parameters:

cal_data_dir: ./calib/img_self

cal_data_type: float32

calibration_type: default

optimization: bias_correction

run_on_cpu: ReduceMean_1737;ReduceMean_1522;ReduceMean_1756;ReduceMean_1288;ReduceMean_1035;ReduceMean_801;ReduceMean_699;ReduceMean_597;ReduceMean_820;ReduceMean_1767;MatMul_1753;MatMul_1753_reshape_output;ReduceMean_1065;MatMul_1285;MatMul_1285_reshape_output;ReduceMean_567;ReduceMean_1054;Slice_1964;Gemm_1261;MatMul_1254;Transpose_1255;Reshape_1260;MatMul_1519_reshape_output;MatMul_1519;Softmax_1619;Concat_1965;Unsqueeze_2334;MatMul_1722;Transpose_1723;Reshape_1728;MatMul_1852;Slice_2367;MatMul_817;MatMul_817_reshape_output;ReduceMean_1401;Gemm_1729;Slice_1874;Concat_1875;Unsqueeze_2333;MatMul_1946;Transpose_1621;Reshape_1626;MatMul_1620;Slice_2054;Gemm_793;ReduceMean_831;Concat_2055;Unsqueeze_2335;Gemm_1627;Transpose_787;Reshape_792;MatMul_786;Concat_2339;Transpose_1021;Reshape_1026;MatMul_1020;ReduceMean_586

compiler_parameters:

advice: 1

compile_mode: latency

debug: true

optimize_level: O3

input_parameters:

input_layout_rt: NCHW

input_layout_train: NCHW

input_name: img

input_shape: ‘’

input_type_rt: nv12

input_type_train: rgb

mean_value: 123.675 116.28 103.53

norm_type: data_mean_and_scale

scale_value: 0.01712475 0.017507 0.01742919

model_parameters:

layer_out_dump: false

march: bayes

onnx_model: ./streampetr_input_only_img_run_1206.onnx

output_model_file_prefix: 1206_cpu_O3_2

working_dir: model_output_bin

2023-12-14 10:29:20,637 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 60 input ‘img’ : original model shape: [6, 3, 256, 704]

2023-12-14 10:29:20,637 file: loader.py func: loader line No: 44 *******************************************

2023-12-14 10:29:20,637 file: loader.py func: loader line No: 45 First calibration picture name: 1.bin

2023-12-14 10:29:20,637 file: loader.py func: loader line No: 47 First calibration picture md5:

2023-12-14 10:29:20,655 file: loader.py func: loader line No: 51 *******************************************

2023-12-14 10:29:20,655 file: loader.py func: loader line No: 125 created RawImageDirLoader of shape:[6, 3, 256, 704]

2023-12-14 10:29:20,655 file: loader.py func: loader line No: 130 Read raw file: /open_explore/samples/streampetr_yu/calib/img_self/1.bin

2023-12-14 10:29:20,804 file: loader.py func: loader line No: 130 Read raw file: /open_explore/samples/streampetr_yu/calib/img_self/2.bin

2023-12-14 10:29:20,943 file: loader.py func: loader line No: 130 Read raw file: /open_explore/samples/streampetr_yu/calib/img_self/3.bin

2023-12-14 10:29:21,082 file: loader.py func: loader line No: 130 Read raw file: /open_explore/samples/streampetr_yu/calib/img_self/4.bin

2023-12-14 10:29:21,220 file: loader.py func: loader line No: 130 Read raw file: /open_explore/samples/streampetr_yu/calib/img_self/5.bin

2023-12-14 10:29:21,357 file: loader.py func: loader line No: 130 Read raw file: /open_explore/samples/streampetr_yu/calib/img_self/6.bin

2023-12-14 10:29:21,498 file: loader.py func: loader line No: 130 Read raw file: /open_explore/samples/streampetr_yu/calib/img_self/7.bin

2023-12-14 10:29:21,637 file: loader.py func: loader line No: 130 Read raw file: /open_explore/samples/streampetr_yu/calib/img_self/8.bin

2023-12-14 10:29:21,777 file: tool_utils.py func: tool_utils line No: 364 num of calibration data: 8

2023-12-14 10:29:21,778 file: tool_utils.py func: tool_utils line No: 365 calibration data shape: (6, 3, 256, 704)

2023-12-14 10:29:21,803 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 511 call build params:

{‘march’: ‘bayes’, ‘save_model’: True, ‘name_prefix’: ‘1206_cpu_O3_2’, ‘input_dict’: {‘img’: {‘input_shape’: [6, 3, 256, 704], ‘expected_input_type’: ‘YUV444_128’, ‘original_input_type’: ‘RGB’, ‘original_input_layout’: ‘NCHW’, ‘means’: array([123.675, 116.28 , 103.53 ], dtype=float32), ‘scales’: array([0.01712475, 0.017507 , 0.01742919], dtype=float32)}}, ‘cali_dict’: {‘calibration_type’: ‘default’, ‘calibration_data’: {‘img’: [array([[[[ -38., -41., -37., …, 59., 58., 58.],

[ -38., -38., -36., …, 60., 58., 58.],

[ -36., -36., -35., …, 62., 59., 58.],

…,

[ 60., 62., 64., …, 27., 27., 27.],

[ 60., 61., 63., …, 27., 27., 27.],

[ 58., 60., 62., …, 27., 27., 27.]],

[[ 1., 1., 1., …, 5., 6., 6.],

[ 1., 1., 1., …, 5., 6., 6.],

[ 1., 1., 1., …, 5., 5., 5.],

…,

[ -2., -2., -2., …, -1., -1., -1.],

[ -2., -2., -2., …, -1., -1., -1.]],

[[ 0., 0., 0., …, -7., -8., -8.],

[ 0., 0., 0., …, -7., -8., -8.],

[ 0., 0., 0., …, -8., -7., -7.],

…,

[ 0., 0., 0., …, 5., 5., 5.],

[ 0., 0., 0., …, 5., 5., 5.]]],

[[[ 71., 71., 72., …, 55., 55., 54.],

[ 71., 71., 72., …, 55., 55., 54.],

[ 71., 71., 72., …, 56., 55., 54.],

…,

[ 21., 19., 14., …, 10., 10., 14.],

[ 21., 17., 13., …, 7., 3., -1.],

[ 19., 14., 13., …, 2., 4., 13.]],

[[ -1., -1., -1., …, 6., 6., 6.],

[ -1., -1., -1., …, 6., 6., 6.],

…,

[ 0., 0., 0., …, -3., -3., -3.],

[ 0., 0., 0., …, -3., -3., -3.]],

[[ -6., -6., -6., …, -1., -1., -1.],

[ -6., -6., -6., …, -1., -1., -1.],

…,

[ 0., 0., -1., …, 0., 0., 0.],

[ 0., 0., 0., …, 0., 0., 0.],

[ 0., 0., 0., …, 0., 0., 0.]]],

[[[ -69., -29., -78., …, 82., 82., 82.],

[ -34., -45., -30., …, 82., 82., 82.],

[ -66., -69., -67., …, 82., 82., 82.],

…,

[ 13., 15., 30., …, -8., -10., -11.],

[ 12., 7., 10., …, -9., -11., -12.],

[ 3., 8., 16., …, -10., -12., -12.]],

[[ -21., -21., -16., …, 5., 5., 5.],

[ -21., -21., -16., …, 5., 5., 5.],

[ -15., -15., -13., …, 5., 5., 5.],

…,

[ 0., 0., 0., …, 3., 4., 4.],

[ 0., 0., 0., …, 3., 4., 4.]],

[[ 1., 1., 1., …, -3., -3., -3.],

[ 1., 1., 1., …, -3., -3., -3.],

[ 1., 1., 2., …, -3., -3., -3.],

…,

[ 0., 0., 0., …, -2., -3., -3.],

[ 0., 0., 0., …, -2., -3., -3.]]],

[[[ 40., 40., 55., …, 100., 101., 98.],

[ 38., 42., 51., …, 97., 100., 100.],

[ 36., 37., 38., …, 101., 26., 42.],

…,

[ -15., -17., -9., …, -32., -35., -37.],

[ -10., -9., -3., …, -32., -35., -36.],

[ -6., -1., 8., …, -30., -33., -36.]],

[[ -3., -3., -3., …, -114., -87., -87.],

[ -3., -3., -3., …, -114., -87., -87.],

[ -3., -3., -3., …, -112., -83., -83.],

…,

[ 1., 1., 1., …, 12., 13., 13.],

[ 1., 1., 1., …, 13., 13., 13.],

[ 1., 1., 1., …, 13., 13., 13.]],

[[ 5., 5., 5., …, 17., 16., 16.],

[ 5., 5., 5., …, 17., 16., 16.],

[ 5., 5., 5., …, 17., 20., 20.],

…,

[ 0., 0., 0., …, -5., -5., -5.],

[ 0., 0., 0., …, -5., -5., -5.]]],

[[[ -59., -58., -58., …, 63., 63., 63.],

[ -59., -58., -58., …, 63., 63., 63.],

…,

[ -65., -65., -64., …, 14., 1., -13.],

[ -65., -65., -64., …, 9., 11., -2.],

[ -65., -65., -65., …, -6., -30., -28.]],

[[ 6., 6., 6., …, 13., 13., 13.],

[ 6., 6., 6., …, 13., 13., 13.],

…,

[ 7., 7., 7., …, 1., 1., 1.],

[ 6., 6., 6., …, 1., 1., 1.],

[ 6., 6., 6., …, 1., 1., 1.]],

[[ -1., -1., -1., …, -5., -5., -5.],

[ -1., -1., -1., …, -5., -5., -5.],

…,

[ 0., 0., 0., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.]]],

[[[ 70., 70., 70., …, -56., -56., -56.],

[ 70., 70., 70., …, -56., -56., -56.],

…,

[ -7., 5., -21., …, -63., -64., -65.],

[ -2., 13., 14., …, -63., -64., -65.],

[ 4., 1., 15., …, -64., -65., -65.]],

[[ 7., 7., 7., …, 6., 6., 6.],

[ 7., 7., 7., …, 6., 6., 6.],

…,

[ 0., 0., 0., …, 9., 9., 9.],

[ 0., 0., 0., …, 9., 9., 9.]],

[[ -4., -4., -4., …, -2., -3., -3.],

[ -4., -4., -4., …, -2., -3., -3.],

…,

[ 0., 0., 0., …, -5., -5., -5.],

[ 0., 0., 0., …, -5., -5., -5.]]]], dtype=float32), array([[[[ 35., 38., 38., …, 2., 6., 55.],

[ 36., 38., 39., …, 91., 91., 96.],

[ 36., 39., 40., …, 3., -12., -14.],

…,

[ 53., 55., 57., …, 31., 31., 31.],

[ 52., 54., 57., …, 31., 31., 31.],

[ 51., 53., 56., …, 31., 31., 31.]],

[[ 4., 4., 4., …, 7., 6., 6.],

[ 4., 4., 4., …, 7., 6., 6.],

[ 4., 4., 4., …, 7., 19., 19.],

…,

[ 0., 0., 0., …, -2., -2., -2.],

[ 0., 0., 0., …, -2., -1., -1.],

[ 0., 0., 0., …, -2., -1., -1.]],

[[ -6., -6., -6., …, 2., -3., -3.],

[ -6., -6., -6., …, 2., -3., -3.],

[ -5., -5., -5., …, 0., 4., 4.],

…,

[ 0., 0., 0., …, 7., 7., 7.],

[ 0., 0., 0., …, 7., 7., 7.]]],

[[[ 71., 72., 72., …, 59., 59., 58.],

[ 72., 73., 72., …, 59., 59., 58.],

[ 72., 73., 73., …, 60., 60., 58.],

…,

[ 34., 29., 27., …, 10., 7., 11.],

[ 31., 28., 25., …, 7., 13., 23.],

[ 30., 27., 23., …, 11., 20., 20.]],

[[ -1., -1., -1., …, 3., 3., 3.],

[ -1., -1., -1., …, 3., 3., 3.],

…,

[ -4., -4., -3., …, 2., 2., 2.],

[ -4., -4., -3., …, 2., 2., 2.]],

[[ -6., -6., -6., …, -1., -1., -1.],

[ -6., -6., -6., …, -1., -1., -1.],

…,

[ 0., 0., 0., …, -1., -1., -1.],

[ 0., 0., 0., …, -1., -1., -1.]]],

[[[ 48., -14., 9., …, 81., 81., 80.],

[ 58., 54., 57., …, 81., 81., 80.],

[ 57., 55., 56., …, 81., 81., 80.],

…,

[ 1., 11., 28., …, 0., -2., -3.],

[ 6., 10., 17., …, -3., -4., -4.],

[ 3., 15., 16., …, -2., -6., -7.]],

[[ 12., 12., 13., …, 5., 5., 5.],

[ 12., 12., 13., …, 5., 5., 5.],

…,

[ 0., 0., 0., …, 2., 2., 2.],

[ 0., 0., 0., …, 3., 2., 2.],

[ 0., 0., 0., …, 3., 2., 2.]],

[[-10., -10., -10., …, -3., -3., -3.],

[-10., -10., -10., …, -3., -3., -3.],

…,

[ 0., 0., 0., …, 0., 0., 0.],

[ 0., 0., 0., …, -1., 0., 0.],

[ 0., 0., 0., …, -1., 0., 0.]]],

[[[ 61., 61., 61., …, 24., 23., 23.],

[ 62., 62., 62., …, 36., 32., 30.],

[ 63., 63., 63., …, 35., 29., 27.],

…,

[-20., -2., 15., …, -29., -31., -33.],

[ -6., 7., 0., …, -32., -34., -39.],

[ -6., -5., -17., …, -33., -39., -48.]],

[[ 6., 6., 6., …, -17., -18., -18.],

[ 6., 6., 6., …, -17., -18., -18.],

[ 6., 6., 6., …, -20., -19., -19.],

…,

[ -3., -3., -3., …, 10., 10., 10.],

[ -3., -3., -3., …, 10., 10., 10.]],

[[ -2., -2., -2., …, 3., -1., -1.],

[ -2., -2., -2., …, 3., -1., -1.],

[ -3., -3., -3., …, 10., 4., 4.],

…,

[ 2., 2., 2., …, -5., -5., -5.],

[ 2., 2., 2., …, -5., -5., -5.]]],

[[[-63., -62., -62., …, 61., 61., 61.],

[-63., -62., -62., …, 60., 61., 61.],

[-63., -62., -62., …, 61., 61., 61.],

…,

[-65., -65., -66., …, -31., -40., -18.],

[-65., -64., -64., …, -13., -34., -18.],

[-65., -65., -64., …, -19., -18., -14.]],

[[ 6., 6., 6., …, 15., 15., 15.],

[ 6., 6., 6., …, 15., 15., 15.],

…,

[ 7., 7., 7., …, 3., 3., 3.],

[ 8., 8., 8., …, 3., 3., 3.],

[ 8., 8., 8., …, 3., 3., 3.]],

[[ -1., -1., -1., …, -4., -4., -4.],

[ -1., -1., -1., …, -4., -4., -4.],

…,

[ 0., 0., 0., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.]]],

[[[-54., -72., -59., …, -56., -56., -56.],

[-57., -74., -57., …, -56., -56., -56.],

[-67., -76., -65., …, -56., -56., -56.],

…,

[-28., -27., -18., …, -73., -73., -73.],

[-28., -35., -22., …, -73., -73., -73.],

[-30., -31., -26., …, -73., -73., -73.]],

[[ -7., -7., -7., …, 7., 6., 6.],

[ -7., -7., -7., …, 7., 6., 6.],

[ -6., -6., -7., …, 7., 6., 6.],

…,

[ 12., 12., 12., …, 9., 10., 10.],

[ 12., 12., 12., …, 10., 10., 10.],

[ 12., 12., 12., …, 10., 10., 10.]],

[[ 4., 4., 4., …, -3., -3., -3.],

[ 4., 4., 4., …, -3., -3., -3.],

…,

[ -5., -5., -5., …, -5., -5., -5.],

[ -5., -5., -5., …, -5., -5., -5.]]]], dtype=float32), array([[[[ 34., 35., 37., …, -12., -18., -19.],

[ 36., 37., 38., …, -18., -22., -23.],

[ 36., 37., 39., …, -23., -22., -22.],

…,

[ 52., 53., 56., …, 27., 27., 27.],

[ 51., 54., 56., …, 27., 27., 27.],

[ 51., 53., 54., …, 27., 27., 27.]],

[[ 6., 6., 6., …, -3., -3., -3.],

[ 6., 6., 6., …, -3., -3., -3.],

[ 6., 6., 6., …, -1., -2., -2.],

…,

[ 1., 1., 1., …, 1., 0., 0.],

[ 0., 0., 0., …, 1., 0., 0.],

[ 0., 0., 0., …, 1., 0., 0.]],

[[ -8., -8., -8., …, 2., 2., 2.],

[ -8., -8., -8., …, 2., 2., 2.],

[ -9., -9., -8., …, 4., 4., 4.],

…,

[ -1., -1., -1., …, 5., 5., 5.],

[ 0., 0., 0., …, 5., 4., 4.],

[ 0., 0., 0., …, 5., 4., 4.]]],

[[[ 68., 68., 69., …, 49., 49., 50.],

[ 68., 69., 71., …, 49., 50., 51.],

[ 67., 67., 66., …, 51., 51., 51.],

…,

[ 18., 16., 9., …, 8., 11., 4.],

[ 16., 14., 8., …, 9., 10., 5.],

[ 16., 12., 7., …, 8., 12., 2.]],

[[ 5., 5., 4., …, -28., -28., -28.],

[ 5., 5., 4., …, -28., -28., -28.],

[ 4., 4., 2., …, -28., -28., -28.],

…,

[ -2., -2., 0., …, 6., 6., 6.],

[ 0., 0., 0., …, 6., 6., 6.],

[ 0., 0., 0., …, 6., 6., 6.]],

[[ -6., -6., -6., …, 12., 12., 12.],

[ -6., -6., -6., …, 12., 12., 12.],

[ -5., -5., -6., …, 12., 12., 12.],

…,

[ 0., 0., 1., …, -3., -3., -3.],

[ 0., 0., 0., …, -3., -3., -3.],

[ 0., 0., 0., …, -3., -3., -3.]]],

[[[ 55., 55., 55., …, 82., 82., 82.],

[ 55., 55., 55., …, 82., 82., 82.],

…,

[ 12., 2., 10., …, -8., -11., -12.],

[ 3., 13., 17., …, -9., -12., -13.],

[ 0., 1., -1., …, -10., -12., -13.]],

[[ 15., 15., 15., …, 5., 5., 5.],

[ 15., 15., 15., …, 5., 5., 5.],

…,

[ -1., -1., -1., …, 4., 4., 4.],

[ -1., -1., -1., …, 4., 4., 4.]],

[[ -8., -8., -8., …, -3., -3., -3.],

[ -8., -8., -8., …, -3., -3., -3.],

…,

[ 0., 0., 0., …, -3., -3., -3.],

[ 0., 0., 0., …, -3., -3., -3.]]],

[[[-25., -30., -36., …, 79., 66., 62.],

[-31., -30., -31., …, 79., 68., 62.],

[-27., -26., -24., …, 69., 70., 62.],

…,

[-13., -9., -3., …, -24., -26., -33.],

[ -9., -23., -10., …, -25., -26., -33.],

[-10., -10., -7., …, -27., -26., -30.]],

[[ 3., 3., 3., …, -3., 3., 3.],

[ 3., 3., 3., …, -3., 3., 3.],

[ 3., 3., 4., …, -1., 1., 1.],

…,

[ -4., -4., -4., …, 10., 10., 10.],

[ -4., -4., -4., …, 10., 10., 10.]],

[[ -3., -3., -3., …, -1., -2., -2.],

[ -3., -3., -3., …, -1., -2., -2.],

[ -3., -3., -3., …, 1., -3., -3.],

…,

[ 2., 2., 2., …, -4., -4., -4.],

[ 2., 2., 2., …, -4., -4., -4.]]],

[[[-62., -62., -60., …, 61., 61., 61.],

[-62., -62., -60., …, 61., 61., 61.],

…,

[-64., -64., -61., …, -5., 4., -13.],

[-64., -64., -63., …, -7., 3., 0.],

[-64., -64., -64., …, -12., 2., -11.]],

[[ 6., 6., 6., …, 15., 15., 15.],

[ 6., 6., 6., …, 15., 15., 15.],

…,

[ 8., 8., 8., …, 2., 2., 2.],

[ 8., 8., 8., …, 2., 2., 2.]],

[[ -1., -1., -1., …, -6., -6., -6.],

[ -1., -1., -1., …, -6., -6., -6.],

…,

[ -1., -1., -1., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.]]],

[[[ 38., 39., 37., …, -67., -67., -68.],

[ 39., 39., 38., …, -67., -67., -68.],

[ 39., 40., 38., …, -67., -68., -68.],

…,

[-21., -7., 14., …, -82., -82., -82.],

[-14., -11., -2., …, -82., -82., -82.],

[ -9., -6., -3., …, -82., -82., -82.]],

[[-28., -28., -29., …, 3., 3., 3.],

[-28., -28., -29., …, 3., 3., 3.],

…,

[ 10., 10., 10., …, 6., 6., 6.],

[ 10., 10., 10., …, 6., 6., 6.]],

[[ 12., 12., 13., …, -1., -1., -1.],

[ 12., 12., 13., …, -1., -1., -1.],

…,

[ -5., -5., -5., …, -1., -1., -1.],

[ -5., -5., -5., …, -1., -1., -1.]]]], dtype=float32), array([[[[ 45., 50., 47., …, -4., -1., -6.],

[ 46., 48., 49., …, 2., -12., -4.],

[ 46., 48., 49., …, -6., -6., -4.],

…,

[ 51., 53., 55., …, 32., 32., 32.],

[ 50., 52., 54., …, 32., 32., 32.],

[ 49., 51., 52., …, 32., 32., 32.]],

[[ 0., 0., 1., …, -5., -5., -5.],

[ 0., 0., 1., …, -5., -5., -5.],

[ 4., 4., 4., …, -5., -3., -3.],

…,

[ -2., -2., -2., …, 1., 1., 1.],

[ -1., -1., -2., …, 1., 1., 1.],

[ -1., -1., -2., …, 1., 1., 1.]],

[[ -6., -6., -6., …, 4., 4., 4.],

[ -6., -6., -6., …, 4., 4., 4.],

[ -6., -6., -6., …, 5., 5., 5.],

…,

[ 2., 2., 2., …, 5., 5., 5.],

[ 1., 1., 2., …, 5., 5., 5.],

[ 1., 1., 2., …, 5., 5., 5.]]],

[[[ 68., 68., 68., …, 56., 56., 56.],

[ 68., 69., 69., …, 56., 56., 56.],

[ 69., 69., 69., …, 57., 57., 57.],

…,

[ 21., 16., 11., …, 20., 14., 5.],

[ 19., 14., 10., …, 19., 14., 4.],

[ 18., 13., 9., …, 15., 10., -2.]],

[[ 4., 4., 4., …, -22., -22., -22.],

[ 4., 4., 4., …, -22., -22., -22.],

…,

[ 0., 0., 0., …, 6., 7., 7.],

[ 0., 0., 0., …, 6., 7., 7.]],

[[ -5., -5., -5., …, 12., 12., 12.],

[ -5., -5., -5., …, 12., 12., 12.],

…,

[ 0., 0., 0., …, -4., -4., -4.],

[ 0., 0., 1., …, -4., -4., -4.],

[ 0., 0., 1., …, -4., -4., -4.]]],

[[[ -83., -118., -122., …, 82., 82., 82.],

[ -80., -94., -80., …, 82., 82., 82.],

[ -82., -84., -78., …, 82., 82., 82.],

…,

[ -57., -59., -49., …, -2., -6., -8.],

[ -19., -26., -34., …, -3., -8., -9.],

[ -13., 7., 10., …, -4., -8., -9.]],

[[ 22., 22., 20., …, 5., 5., 5.],

[ 22., 22., 20., …, 5., 5., 5.],

[ 6., 6., 6., …, 5., 5., 5.],

…,

[ 0., 0., 0., …, 3., 3., 3.],

[ 0., 0., 0., …, 3., 3., 3.]],

[[ -6., -6., -5., …, -3., -3., -3.],

[ -6., -6., -5., …, -3., -3., -3.],

[ -1., -1., -1., …, -3., -3., -3.],

…,

[ 0., 0., 0., …, -3., -3., -3.],

[ 0., 0., 0., …, -3., -3., -3.]]],

[[[ -53., -76., -63., …, -101., -103., -103.],

[ -59., -79., -65., …, -102., -102., -103.],

[ -64., -84., -69., …, -102., -103., -103.],

…,

[ -15., -10., 1., …, -41., -42., -37.],

[ -14., -13., -8., …, -40., -44., -41.],

[ -15., -19., -11., …, -40., -43., -45.]],

[[ 5., 5., 5., …, 2., 2., 2.],

[ 5., 5., 5., …, 2., 2., 2.],

…,

[ -1., -1., -2., …, 12., 12., 12.],

[ -1., -1., -2., …, 12., 12., 12.]],

[[ -3., -3., -3., …, -1., 0., 0.],

[ -3., -3., -3., …, -1., 0., 0.],

…,

[ 1., 1., 2., …, -4., -4., -4.],

[ 1., 1., 2., …, -4., -4., -4.]]],

[[[ -63., -63., -63., …, 63., 60., -39.],

[ -63., -63., -63., …, 63., -8., -119.],

[ -63., -63., -63., …, 10., -121., -115.],

…,

[ -66., -66., -65., …, -65., -68., -69.],

[ -66., -66., -66., …, -65., -68., -69.],

[ -66., -66., -66., …, -64., -68., -70.]],

[[ 6., 6., 6., …, 11., 13., 13.],

[ 6., 6., 6., …, 11., 13., 13.],

[ 6., 6., 6., …, 10., 16., 16.],

…,

[ 8., 8., 8., …, 6., 6., 6.],

[ 8., 8., 8., …, 7., 6., 6.],

[ 8., 8., 8., …, 7., 6., 6.]],

[[ -3., -3., -3., …, -5., -2., -2.],

[ -3., -3., -3., …, -5., -2., -2.],

[ -3., -3., -3., …, -4., -2., -2.],

…,

[ -1., -1., -1., …, -3., -3., -3.],

[ -1., -1., -1., …, -3., -3., -3.]]],

[[[ 7., 8., 8., …, -73., -73., -74.],

[ 11., 12., 13., …, -73., -73., -74.],

[ 13., 14., 14., …, -73., -73., -74.],

…,

[ -1., -3., -17., …, -82., -83., -83.],

[ -7., 5., 1., …, -82., -83., -83.],

[ 1., -5., -7., …, -82., -83., -83.]],

[[ -22., -22., -22., …, 2., 2., 2.],

[ -22., -22., -22., …, 2., 2., 2.],

…,

[ 14., 14., 14., …, 7., 7., 7.],

[ 14., 14., 14., …, 7., 7., 7.]],

[[ 12., 12., 12., …, 0., 0., 0.],

[ 12., 12., 12., …, 0., 0., 0.],

…,

[ -6., -6., -6., …, -1., -1., -1.],

[ -6., -6., -6., …, -1., -1., -1.]]]], dtype=float32), array([[[[ -32., -11., -2., …, -11., -10., -15.],

[ 0., -1., -1., …, -9., -9., -15.],

[ -2., -1., -1., …, -8., -10., -15.],

…,

[ 52., 55., 57., …, 30., 30., 30.],

[ 51., 53., 56., …, 30., 30., 30.],

[ 50., 52., 56., …, 30., 30., 30.]],

[[ 5., 5., 5., …, 1., 1., 1.],

[ 5., 5., 5., …, 1., 1., 1.],

[ 5., 5., 5., …, 1., -1., -1.],

…,

[ -2., -2., -1., …, -1., -1., -1.],

[ -1., -1., -1., …, 1., 1., 1.],

[ -1., -1., -1., …, 1., 1., 1.]],

[[ -5., -5., -5., …, -1., -1., -1.],

[ -5., -5., -5., …, -1., -1., -1.],

[ -5., -5., -5., …, -1., 1., 1.],

…,

[ 2., 2., 1., …, 5., 5., 5.],

[ 1., 1., 1., …, 5., 5., 5.],

[ 1., 1., 1., …, 5., 5., 5.]]],

[[[ 68., 69., 69., …, 47., 25., 42.],

[ 69., 69., 69., …, 38., 23., 53.],

[ 69., 69., 69., …, 29., 25., 53.],

…,

[ 21., 16., 10., …, 27., 22., 14.],

[ 19., 14., 10., …, 21., 22., 13.],

[ 17., 11., 10., …, 20., 26., 10.]],

[[ 2., 2., 2., …, -5., -6., -6.],

[ 2., 2., 2., …, -5., -6., -6.],

[ 2., 2., 2., …, -5., -5., -5.],

…,

[ -2., -2., -2., …, -4., -4., -4.],

[ -2., -2., -2., …, -6., -4., -4.],

[ -2., -2., -2., …, -6., -4., -4.]],

[[ -6., -6., -6., …, 0., 2., 2.],

[ -6., -6., -6., …, 0., 2., 2.],

[ -6., -6., -6., …, 0., 1., 1.],

…,

[ 0., 0., 0., …, 0., 0., 0.],

[ 0., 0., 0., …, -1., 0., 0.],

[ 0., 0., 0., …, -1., 0., 0.]]],

[[[ -93., -90., -84., …, 81., 81., 81.],

[ 58., -90., -107., …, 82., 81., 81.],

[ -77., -87., -28., …, 82., 82., 80.],

…,

[ 16., 16., 13., …, -8., -10., -11.],

[ 10., 13., 12., …, -9., -11., -12.],

[ 2., 8., 18., …, -9., -11., -12.]],

[[ -14., -14., -12., …, 6., 5., 5.],

[ -14., -14., -12., …, 6., 5., 5.],

[ 0., 0., 5., …, 5., 5., 5.],

…,

[ -3., -3., -3., …, 5., 5., 5.],

[ -3., -3., -3., …, 5., 5., 5.]],

[[ -5., -5., -5., …, -5., -5., -5.],

[ -5., -5., -5., …, -5., -5., -5.],

[ -2., -2., -3., …, -5., -5., -5.],

…,

[ 0., 0., 0., …, -3., -3., -3.],

[ 0., 0., 0., …, -3., -3., -3.]]],

[[[ 1., 0., -1., …, -39., -49., -43.],

[ 5., 4., 1., …, -29., -42., -34.],

[ 6., 4., 2., …, -16., -16., 9.],

…,

[ -16., -27., -3., …, -31., -41., -48.],

[ -12., -26., -7., …, -40., -50., -51.],

[ -20., -20., -8., …, -38., -43., -44.]],

[[ 7., 7., 7., …, -7., -7., -7.],

[ 7., 7., 7., …, -7., -7., -7.],

[ 4., 4., 4., …, -7., -7., -7.],

…,

[ 0., 0., 0., …, 13., 14., 14.],

[ 0., 0., 0., …, 13., 14., 14.]],

[[ -5., -5., -5., …, 15., 15., 15.],

[ -5., -5., -5., …, 15., 15., 15.],

[ -5., -5., -5., …, 14., 14., 14.],

…,

[ 0., 0., 0., …, -6., -6., -6.],

[ 0., 0., 0., …, -5., -5., -5.],

[ 0., 0., 0., …, -5., -5., -5.]]],

[[[ -64., -62., -62., …, 64., 64., 63.],

[ -64., -62., -62., …, 51., 54., 58.],

[ -64., -62., -62., …, 1., 1., 0.],

…,

[ -64., -64., -64., …, 15., 16., 14.],

[ -65., -65., -65., …, 10., 9., 0.],

[ -65., -65., -65., …, 15., 11., 0.]],

[[ 6., 6., 6., …, 12., 12., 12.],

[ 6., 6., 6., …, 12., 12., 12.],

[ 6., 6., 6., …, 7., 6., 6.],

…,

[ 9., 9., 9., …, 1., 1., 1.],

[ 10., 10., 10., …, 1., 1., 1.],

[ 10., 10., 10., …, 1., 1., 1.]],

[[ -1., -1., -1., …, -4., -4., -4.],

[ -1., -1., -1., …, -4., -4., -4.],

[ -1., -1., -1., …, -1., -1., -1.],

…,

[ -1., -1., -1., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.]]],

[[[ -11., -14., -13., …, -62., -62., -62.],

[ 21., 20., 21., …, -62., -62., -62.],

[ 28., 29., 28., …, -63., -63., -62.],

…,

[ 10., 3., 8., …, -79., -79., -79.],

[ 12., 0., 7., …, -79., -79., -79.],

[ -11., -8., -12., …, -79., -79., -79.]],

[[ -4., -4., -3., …, 2., 2., 2.],

[ -4., -4., -3., …, 2., 2., 2.],

[ -3., -3., -2., …, 2., 2., 2.],

…,

[ 0., 0., 0., …, 6., 6., 6.],

[ 0., 0., 0., …, 6., 6., 6.]],

[[ 1., 1., 2., …, 1., 2., 2.],

[ 1., 1., 2., …, 1., 2., 2.],

[ 2., 2., 2., …, 1., 0., 0.],

…,

[ 2., 2., 2., …, -1., -1., -1.],

[ 2., 2., 2., …, -1., -1., -1.]]]], dtype=float32), array([[[[ -20., -18., -20., …, -19., -21., -27.],

[ -15., -19., -11., …, -20., -21., -27.],

[ -16., -18., -12., …, -20., -25., -27.],

…,

[ 56., 58., 60., …, 30., 30., 30.],

[ 54., 57., 59., …, 30., 30., 30.],

[ 53., 56., 58., …, 30., 30., 30.]],

[[ -4., -4., -4., …, -3., -4., -4.],

[ -4., -4., -4., …, -3., -4., -4.],

[ -5., -5., -5., …, -3., -4., -4.],

…,

[ 0., 0., 0., …, 0., 0., 0.],

[ 0., 0., 0., …, 0., 0., 0.]],

[[ 1., 1., 1., …, -1., 0., 0.],

[ 1., 1., 1., …, -1., 0., 0.],

[ 2., 2., 2., …, -1., 0., 0.],

…,

[ 0., 0., 0., …, 5., 5., 5.],

[ 0., 0., 0., …, 5., 5., 5.]]],

[[[ 68., 68., 69., …, -10., 74., 19.],

[ 69., 68., 68., …, -27., 14., -12.],

[ 68., 68., 68., …, 1., -15., -2.],

…,

[ 22., 19., 14., …, 10., 0., 2.],

[ 19., 17., 11., …, -1., 15., 2.],

[ 18., 14., 10., …, 7., 2., -15.]],

[[ 2., 2., 2., …, -35., -32., -32.],

[ 2., 2., 2., …, -35., -32., -32.],

[ 2., 2., 2., …, -38., -31., -31.],

…,

[ -3., -3., -1., …, 1., 2., 2.],

[ -1., -1., -2., …, 1., 2., 2.],

[ -1., -1., -2., …, 1., 2., 2.]],

[[ -3., -3., -3., …, 7., 4., 4.],

[ -3., -3., -3., …, 7., 4., 4.],

[ -3., -3., -3., …, 4., 6., 6.],

…,

[ -1., -1., 1., …, 0., 2., 2.],

[ 0., 0., 0., …, 0., 2., 2.],

[ 0., 0., 0., …, 0., 2., 2.]]],

[[[ 14., -33., -9., …, 81., 81., 81.],

[ 51., -25., -18., …, 81., 81., 81.],

[ -23., -11., 11., …, 81., 81., 81.],

…,

[ -6., 15., 14., …, -14., -17., -18.],

[ -49., -1., -12., …, -14., -18., -20.],

[ -30., -5., -27., …, -15., -19., -20.]],

[[ -28., -28., -26., …, 6., 6., 6.],

[ -28., -28., -26., …, 6., 6., 6.],

[ -16., -16., -18., …, 6., 6., 6.],

…,

[ 3., 3., 3., …, 6., 6., 6.],

[ 3., 3., 3., …, 6., 6., 6.]],

[[ 6., 6., 5., …, -2., -2., -2.],

[ 6., 6., 5., …, -2., -2., -2.],

[ 7., 7., 5., …, -2., -2., -2.],

…,

[ 0., 0., 0., …, -2., -2., -2.],

[ 0., 0., 0., …, -2., -2., -2.]]],

[[[ -67., -67., -67., …, -106., -76., -7.],

[ -67., -67., -67., …, -30., 12., -90.],

[ -67., -67., -67., …, -120., -82., -62.],

…,

[ -10., -23., -34., …, -33., -42., -52.],

[ -20., -13., -32., …, -35., -47., -52.],

[ -45., -52., -28., …, -43., -43., -52.]],

[[ 2., 2., 1., …, -14., -9., -9.],

[ 2., 2., 1., …, -14., -9., -9.],

[ 2., 2., 2., …, -16., -12., -12.],

…,

[ 2., 2., 2., …, 15., 15., 15.],

[ 4., 4., 2., …, 15., 15., 15.],

[ 4., 4., 2., …, 15., 15., 15.]],

[[ 2., 2., 2., …, 9., 10., 10.],

[ 2., 2., 2., …, 9., 10., 10.],

[ 2., 2., 2., …, 10., 10., 10.],

…,

[ 2., 2., 2., …, -5., -5., -5.],

[ 3., 3., 2., …, -5., -5., -5.],

[ 3., 3., 2., …, -5., -5., -5.]]],

[[[ -69., -68., -68., …, 57., 55., 55.],

[ -69., -68., -68., …, 58., 62., 49.],

[ -69., -68., -68., …, 61., 48., 53.],

…,

[ -75., -75., -74., …, -57., -15., -24.],

[ -74., -74., -74., …, -15., -57., -45.],

[ -74., -74., -74., …, 54., -70., -46.]],

[[ 8., 8., 8., …, 18., 18., 18.],

[ 8., 8., 8., …, 18., 18., 18.],

…,

[ 14., 14., 14., …, 11., 10., 10.],

[ 12., 12., 12., …, 11., 11., 11.],

[ 12., 12., 12., …, 11., 11., 11.]],

[[ -1., -1., -1., …, -3., -3., -3.],

[ -1., -1., -1., …, -3., -3., -3.],

…,

[ 0., 0., 0., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.]]],

[[[ 66., 67., 69., …, -62., -62., -62.],

[ 65., 67., 67., …, -62., -62., -62.],

[ 67., 67., 67., …, -62., -62., -62.],

…,

[ 21., 14., 36., …, -76., -76., -76.],

[ 28., 41., 22., …, -75., -76., -76.],

[ 19., 16., 17., …, -75., -77., -75.]],

[[ 13., 13., 13., …, 3., 3., 3.],

[ 13., 13., 13., …, 3., 3., 3.],

[ 12., 12., 12., …, 3., 3., 3.],

…,

[ 6., 6., 6., …, 7., 7., 7.],

[ 6., 6., 6., …, 7., 7., 7.]],

[[ -5., -5., -5., …, 0., 0., 0.],

[ -5., -5., -5., …, 0., 0., 0.],

[ -4., -4., -4., …, 0., 0., 0.],

…,

[ 0., 0., 2., …, -1., -1., -1.],

[ 2., 2., 2., …, -1., -1., -1.],

[ 2., 2., 2., …, -1., -1., -1.]]]], dtype=float32), array([[[[-22., -31., -24., …, -15., -24., -22.],

[-25., -29., -28., …, -19., -28., -21.],

[-26., -28., -29., …, -13., -21., -24.],

…,

[ 55., 58., 60., …, 30., 30., 30.],

[ 54., 56., 59., …, 30., 30., 30.],

[ 53., 56., 58., …, 30., 30., 30.]],

[[ -5., -5., -3., …, -3., -3., -3.],

[ -5., -5., -3., …, -3., -3., -3.],

[ -3., -3., -2., …, -3., -4., -4.],

…,

[ -3., -3., -2., …, -1., -1., -1.],

[ -2., -2., -2., …, -1., 1., 1.],

[ -2., -2., -2., …, -1., 1., 1.]],

[[ -1., -1., 0., …, -1., 1., 1.],

[ -1., -1., 0., …, -1., 1., 1.],

[ 0., 0., 0., …, -1., 1., 1.],

…,

[ 0., 0., 0., …, 5., 5., 5.],

[ 0., 0., 0., …, 5., 5., 5.]]],

[[[ 69., 69., 69., …, 26., -4., 13.],

[ 69., 69., 69., …, -67., -60., -63.],

[ 69., 69., 69., …, -55., -42., -56.],

…,

[ 29., 22., 17., …, -1., 17., -20.],

[ 26., 20., 16., …, 1., -12., 27.],

[ 25., 20., 14., …, 11., 25., 10.]],

[[ 1., 1., 1., …, -29., -28., -28.],

[ 1., 1., 1., …, -29., -28., -28.],

[ 1., 1., 1., …, -21., -20., -20.],

…,

[ -2., -2., -1., …, 0., 0., 0.],

[ -1., -1., -3., …, 0., 0., 0.],

[ -1., -1., -3., …, 0., 0., 0.]],

[[ -5., -5., -5., …, 6., 4., 4.],

[ -5., -5., -5., …, 6., 4., 4.],

[ -5., -5., -5., …, 7., 6., 6.],

…,

[ -1., -1., 0., …, 0., 0., 0.],

[ -1., -1., -1., …, 0., 0., 0.],

[ -1., -1., -1., …, 0., 0., 0.]]],

[[[-75., -66., -56., …, 85., 85., 85.],

[-62., -51., -45., …, 85., 85., 85.],

[-84., -70., -92., …, 85., 85., 85.],

…,

[ -2., 8., 48., …, -13., -14., -15.],

[ 5., -22., 22., …, -14., -15., -16.],

[ 22., 22., 14., …, -14., -16., -17.]],

[[-14., -14., -13., …, 2., 2., 2.],

[-14., -14., -13., …, 2., 2., 2.],

[-11., -11., -11., …, 2., 2., 2.],

…,

[ 1., 1., 1., …, 3., 3., 3.],

[ 1., 1., 1., …, 3., 3., 3.]],

[[ 2., 2., 0., …, -1., -1., -1.],

[ 2., 2., 0., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.],

…,

[ -1., -1., -1., …, -3., -3., -3.],

[ -1., -1., -1., …, -3., -3., -3.]]],

[[[ 13., -2., -92., …, -74., -75., -76.],

[ 19., 5., -16., …, -76., -76., -76.],

[ 4., -45., -16., …, -74., -73., -72.],

…,

[ -4., -2., -18., …, -58., -61., -52.],

[-46., -41., -22., …, -52., -61., -44.],

[-26., -33., -50., …, -52., -57., -49.]],

[[-12., -12., -21., …, 12., 12., 12.],

[-12., -12., -21., …, 12., 12., 12.],

[-10., -10., -19., …, 12., 12., 12.],

…,

[ 4., 4., 3., …, 16., 16., 16.],

[ 4., 4., 3., …, 15., 15., 15.],

[ 4., 4., 3., …, 15., 15., 15.]],

[[ 2., 2., -1., …, -6., -6., -6.],

[ 2., 2., -1., …, -6., -6., -6.],

[ 0., 0., -2., …, -6., -6., -6.],

…,

[ 2., 2., 2., …, -6., -6., -6.],

[ 2., 2., 2., …, -5., -5., -5.],

[ 2., 2., 2., …, -5., -5., -5.]]],

[[[-69., -69., -67., …, 58., 54., 50.],

[-69., -69., -67., …, 59., 58., 44.],

[-69., -69., -67., …, 65., 55., 32.],

…,

[-75., -74., -73., …, -39., 25., -41.],

[-76., -75., -75., …, -10., -15., -20.],

[-78., -76., -75., …, 2., -44., -23.]],

[[ 6., 6., 6., …, 15., 15., 15.],

[ 6., 6., 6., …, 15., 15., 15.],

[ 6., 6., 6., …, 14., 14., 14.],

…,

[ 10., 10., 10., …, 6., 8., 8.],

[ 10., 10., 10., …, 6., 8., 8.]],

[[ -1., -1., -1., …, -3., -3., -3.],

[ -1., -1., -1., …, -3., -3., -3.],

…,

[ 0., 0., 0., …, -1., -1., -1.],

[ 0., 0., 0., …, -1., -1., -1.]]],

[[[ 69., 69., 69., …, -69., -70., -70.],

[ 69., 69., 69., …, -69., -70., -70.],

…,

[-37., -13., -9., …, -74., -74., -74.],

[-25., -31., 7., …, -74., -74., -74.],

[ 1., -13., -19., …, -74., -74., -74.]],

[[ 14., 14., 14., …, 6., 6., 6.],

[ 14., 14., 14., …, 6., 6., 6.],

…,

[ 7., 7., 7., …, 10., 10., 10.],

[ 7., 7., 7., …, 10., 10., 10.]],

[[ -3., -3., -3., …, -1., -1., -1.],

[ -3., -3., -3., …, -1., -1., -1.],

…,

[ -1., -1., -1., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.]]]], dtype=float32), array([[[[ -34., -34., -32., …, -32., -31., -24.],

[ -32., -36., -33., …, -31., -34., -35.],

[ -27., -21., -34., …, -32., -34., -33.],

…,

[ 58., 61., 61., …, 29., 29., 29.],

[ 57., 60., 60., …, 29., 29., 29.],

[ 56., 56., 59., …, 29., 29., 29.]],

[[ 0., 0., 0., …, -1., 0., 0.],

[ 0., 0., 0., …, -1., 0., 0.],

[ 0., 0., 0., …, -1., -1., -1.],

…,

[ -2., -2., -2., …, 0., 1., 1.],

[ -1., -1., -1., …, 1., 1., 1.],

[ -1., -1., -1., …, 1., 1., 1.]],

[[ 0., 0., 0., …, 0., 0., 0.],

[ 0., 0., 0., …, 0., 0., 0.],

…,

[ 0., 0., 0., …, 5., 5., 5.],

[ 2., 2., 2., …, 5., 5., 5.],

[ 2., 2., 2., …, 5., 5., 5.]]],

[[[ 66., 67., 68., …, 30., 25., 22.],

[ 66., 67., 68., …, 27., 16., 22.],

[ 66., 67., 68., …, 7., -2., -3.],

…,

[ 24., 18., 14., …, -35., -23., -7.],

[ 23., 17., 13., …, -8., 3., -5.],

[ 19., 15., 10., …, -12., -26., -21.]],

[[ 2., 2., 3., …, -32., -29., -29.],

[ 2., 2., 3., …, -32., -29., -29.],

[ 2., 2., 3., …, -36., -34., -34.],

…,

[ 0., 0., 0., …, 2., 2., 2.],

[ 0., 0., 0., …, 2., 2., 2.]],

[[ -3., -3., -3., …, 6., 6., 6.],

[ -3., -3., -3., …, 6., 6., 6.],

[ -3., -3., -3., …, 5., 5., 5.],

…,

[ 0., 0., 0., …, 0., 0., 0.],

[ 0., 0., 0., …, 0., 0., 0.]]],

[[[ -79., -74., -63., …, 83., 83., 83.],

[ -47., -41., -30., …, 82., 83., 83.],

[ -50., -99., -44., …, 83., 83., 82.],

…,

[ -16., 11., 9., …, -14., -15., -15.],

[ -17., -20., 2., …, -15., -16., -17.],

[ 4., 5., 16., …, -15., -16., -17.]],

[[ -8., -8., -14., …, 4., 6., 6.],

[ -8., -8., -14., …, 4., 6., 6.],

[ -11., -11., -13., …, 3., 3., 3.],

…,

[ 1., 1., 1., …, 5., 5., 5.],

[ 1., 1., 1., …, 5., 5., 5.]],

[[ -1., -1., -2., …, 0., -1., -1.],

[ -1., -1., -2., …, 0., -1., -1.],

[ -1., -1., -3., …, -1., -1., -1.],

…,

[ -1., -1., -1., …, -3., -3., -3.],

[ -1., -1., -1., …, -3., -3., -3.]]],

[[[ -52., -56., -91., …, -33., 28., -97.],

[ -51., -58., -98., …, -97., -118., -55.],

[ -47., -53., -96., …, -39., -114., -70.],

…,

[ -26., -43., -6., …, -36., -41., -46.],

[ -43., -34., -14., …, -30., -46., -62.],

[ -19., -12., -8., …, -44., -42., -67.]],

[[ -7., -7., -10., …, -20., -13., -13.],

[ -7., -7., -10., …, -20., -13., -13.],

[ -6., -6., -10., …, -17., -7., -7.],

…,

[ 4., 4., 3., …, 16., 16., 16.],

[ 6., 6., 3., …, 16., 16., 16.],

[ 6., 6., 3., …, 16., 16., 16.]],

[[ 5., 5., 5., …, -4., 0., 0.],

[ 5., 5., 5., …, -4., 0., 0.],

[ 5., 5., 4., …, -3., -2., -2.],

…,

[ 2., 2., 2., …, -6., -6., -6.],

[ 1., 1., 2., …, -6., -6., -6.],

[ 1., 1., 2., …, -6., -6., -6.]]],

[[[ -69., -69., -69., …, -26., -31., -48.],

[ -69., -69., -69., …, -55., -17., -28.],

[ -69., -69., -69., …, -39., -30., -10.],

…,

[ -74., -74., -72., …, -43., -37., -39.],

[ -75., -75., -74., …, -9., -4., -8.],

[ -73., -73., -72., …, -45., -26., -28.]],

[[ 9., 9., 9., …, 1., 2., 2.],

[ 9., 9., 9., …, 1., 2., 2.],

[ 9., 9., 9., …, -7., -9., -9.],

…,

[ 11., 11., 11., …, 9., 9., 9.],

[ 11., 11., 11., …, 9., 9., 9.]],

[[ -2., -2., -2., …, 0., 2., 2.],

[ -2., -2., -2., …, 0., 2., 2.],

[ -2., -2., -2., …, -1., -1., -1.],

…,

[ -1., -1., -1., …, -1., -1., -1.],

[ -1., -1., -1., …, -1., -1., -1.]]],

[[[ -64., -43., -3., …, -69., -70., -70.],

[ -54., -25., -1., …, -69., -70., -70.],

[ 17., -81., 1., …, -69., -70., -70.],

…,

[ -59., -25., -1., …, -78., -78., -78.],

[ -25., -15., -8., …, -78., -78., -78.],

[ -26., -26., -3., …, -78., -78., -78.]],

[[ -11., -11., -12., …, 6., 7., 7.],

[ -11., -11., -12., …, 6., 7., 7.],

[ -26., -26., -20., …, 6., 7., 7.],

…,

[ 10., 10., 10., …, 12., 12., 12.],

[ 10., 10., 10., …, 12., 12., 12.]],

[[ 3., 3., 2., …, 0., 0., 0.],

[ 3., 3., 2., …, 0., 0., 0.],

[ 2., 2., 4., …, 0., 0., 0.],

…,

[ 0., 0., 0., …, -2., -2., -2.],

[ 0., 0., 0., …, -2., -2., -2.]]]], dtype=float32)]}}, ‘hbdk_dict’: {‘hbdk_pass_through_params’: '–O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 ', ‘input-source’: {‘img’: ‘pyramid’, ‘_default_value’: ‘ddr’}}, ‘node_dict’: {‘ReduceMean_1737’: {‘ON’: ‘CPU’}, ‘ReduceMean_1522’: {‘ON’: ‘CPU’}, ‘ReduceMean_1756’: {‘ON’: ‘CPU’}, ‘ReduceMean_1288’: {‘ON’: ‘CPU’}, ‘ReduceMean_1035’: {‘ON’: ‘CPU’}, ‘ReduceMean_801’: {‘ON’: ‘CPU’}, ‘ReduceMean_699’: {‘ON’: ‘CPU’}, ‘ReduceMean_597’: {‘ON’: ‘CPU’}, ‘ReduceMean_820’: {‘ON’: ‘CPU’}, ‘ReduceMean_1767’: {‘ON’: ‘CPU’}, ‘MatMul_1753’: {‘ON’: ‘CPU’}, ‘MatMul_1753_reshape_output’: {‘ON’: ‘CPU’}, ‘ReduceMean_1065’: {‘ON’: ‘CPU’}, ‘MatMul_1285’: {‘ON’: ‘CPU’}, ‘MatMul_1285_reshape_output’: {‘ON’: ‘CPU’}, ‘ReduceMean_567’: {‘ON’: ‘CPU’}, ‘ReduceMean_1054’: {‘ON’: ‘CPU’}, ‘Slice_1964’: {‘ON’: ‘CPU’}, ‘Gemm_1261’: {‘ON’: ‘CPU’}, ‘MatMul_1254’: {‘ON’: ‘CPU’}, ‘Transpose_1255’: {‘ON’: ‘CPU’}, ‘Reshape_1260’: {‘ON’: ‘CPU’}, ‘MatMul_1519_reshape_output’: {‘ON’: ‘CPU’}, ‘MatMul_1519’: {‘ON’: ‘CPU’}, ‘Softmax_1619’: {‘ON’: ‘CPU’}, ‘Concat_1965’: {‘ON’: ‘CPU’}, ‘Unsqueeze_2334’: {‘ON’: ‘CPU’}, ‘MatMul_1722’: {‘ON’: ‘CPU’}, ‘Transpose_1723’: {‘ON’: ‘CPU’}, ‘Reshape_1728’: {‘ON’: ‘CPU’}, ‘MatMul_1852’: {‘ON’: ‘CPU’}, ‘Slice_2367’: {‘ON’: ‘CPU’}, ‘MatMul_817’: {‘ON’: ‘CPU’}, ‘MatMul_817_reshape_output’: {‘ON’: ‘CPU’}, ‘ReduceMean_1401’: {‘ON’: ‘CPU’}, ‘Gemm_1729’: {‘ON’: ‘CPU’}, ‘Slice_1874’: {‘ON’: ‘CPU’}, ‘Concat_1875’: {‘ON’: ‘CPU’}, ‘Unsqueeze_2333’: {‘ON’: ‘CPU’}, ‘MatMul_1946’: {‘ON’: ‘CPU’}, ‘Transpose_1621’: {‘ON’: ‘CPU’}, ‘Reshape_1626’: {‘ON’: ‘CPU’}, ‘MatMul_1620’: {‘ON’: ‘CPU’}, ‘Slice_2054’: {‘ON’: ‘CPU’}, ‘Gemm_793’: {‘ON’: ‘CPU’}, ‘ReduceMean_831’: {‘ON’: ‘CPU’}, ‘Concat_2055’: {‘ON’: ‘CPU’}, ‘Unsqueeze_2335’: {‘ON’: ‘CPU’}, ‘Gemm_1627’: {‘ON’: ‘CPU’}, ‘Transpose_787’: {‘ON’: ‘CPU’}, ‘Reshape_792’: {‘ON’: ‘CPU’}, ‘MatMul_786’: {‘ON’: ‘CPU’}, ‘Concat_2339’: {‘ON’: ‘CPU’}, ‘Transpose_1021’: {‘ON’: ‘CPU’}, ‘Reshape_1026’: {‘ON’: ‘CPU’}, ‘MatMul_1020’: {‘ON’: ‘CPU’}, ‘ReduceMean_586’: {‘ON’: ‘CPU’}}, ‘check_mode’: False, ‘optimization’: [‘bias_correction’]}

2023-12-14 10:29:21,813 file: build.py func: build line No: 32 [Thu Dec 14 10:29:21 2023] Start to Horizon NN Model Convert.

2023-12-14 10:29:21,813 file: build.py func: build line No: 92 HorizonNN version: 0.21.2

2023-12-14 10:29:21,814 file: build.py func: build line No: 102 HBDK version: 3.48.6

2023-12-14 10:29:21,814 file: model_debug.py func: model_debug line No: 61 Loading horizon_nn debug methods:

2023-12-14 10:29:21,814 file: cali_dict_parser.py func: cali_dict_parser line No: 38 Parsing the calibration parameter

2023-12-14 10:29:21,814 file: node_attribute.py func: node_attribute line No: 32 There are 57 nodes designated to run on the cpu: [‘ReduceMean_1737’, ‘ReduceMean_1522’, ‘ReduceMean_1756’, ‘ReduceMean_1288’, ‘ReduceMean_1035’, ‘ReduceMean_801’, ‘ReduceMean_699’, ‘ReduceMean_597’, ‘ReduceMean_820’, ‘ReduceMean_1767’, ‘MatMul_1753’, ‘MatMul_1753_reshape_output’, ‘ReduceMean_1065’, ‘MatMul_1285’, ‘MatMul_1285_reshape_output’, ‘ReduceMean_567’, ‘ReduceMean_1054’, ‘Slice_1964’, ‘Gemm_1261’, ‘MatMul_1254’, ‘Transpose_1255’, ‘Reshape_1260’, ‘MatMul_1519_reshape_output’, ‘MatMul_1519’, ‘Softmax_1619’, ‘Concat_1965’, ‘Unsqueeze_2334’, ‘MatMul_1722’, ‘Transpose_1723’, ‘Reshape_1728’, ‘MatMul_1852’, ‘Slice_2367’, ‘MatMul_817’, ‘MatMul_817_reshape_output’, ‘ReduceMean_1401’, ‘Gemm_1729’, ‘Slice_1874’, ‘Concat_1875’, ‘Unsqueeze_2333’, ‘MatMul_1946’, ‘Transpose_1621’, ‘Reshape_1626’, ‘MatMul_1620’, ‘Slice_2054’, ‘Gemm_793’, ‘ReduceMean_831’, ‘Concat_2055’, ‘Unsqueeze_2335’, ‘Gemm_1627’, ‘Transpose_787’, ‘Reshape_792’, ‘MatMul_786’, ‘Concat_2339’, ‘Transpose_1021’, ‘Reshape_1026’, ‘MatMul_1020’, ‘ReduceMean_586’].

2023-12-14 10:29:21,814 file: hbdk_dict_parser.py func: hbdk_dict_parser line No: 36 Parsing the hbdk parameter:{‘hbdk_pass_through_params’: '–O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 ', ‘input-source’: {‘img’: ‘pyramid’, ‘_default_value’: ‘ddr’}}

2023-12-14 10:29:21,814 file: input_dict_parser.py func: input_dict_parser line No: 228 input img is from pyramid. Its layout is set to NHWC

2023-12-14 10:29:21,814 file: build.py func: build line No: 149 The specified model compilation architecture: bayes.

2023-12-14 10:29:21,815 file: build.py func: build line No: 151 The specified model compilation optimization parameters: [‘bias_correction’].

2023-12-14 10:29:21,815 file: build.py func: build line No: 32 [Thu Dec 14 10:29:21 2023] Start to parse the onnx model.

2023-12-14 10:29:21,815 file: tool_utils.py func: tool_utils line No: 322 Using optimization configuration: bias_correction

2023-12-14 10:29:22,266 file: onnx_parser.py func: onnx_parser line No: 125 Input ONNX model infomation:

ONNX IR version: 6

Opset version: [11, 1]

Producer: pytorch1.12.1

Domain: none

Input name: img, [6, 3, 256, 704]

Output name: …s_scores, [6, 1, 900, 10]

Output name: …ox_preds, [6, 1, 900, 10]

2023-12-14 10:29:22,556 file: build.py func: build line No: 35 [Thu Dec 14 10:29:22 2023] End to parse the onnx model.

2023-12-14 10:29:23,255 file: build.py func: build line No: 200 Saving model: 1206_cpu_O3_2_original_float_model.onnx.

2023-12-14 10:29:23,257 file: build.py func: build line No: 32 [Thu Dec 14 10:29:23 2023] Start to optimize the model.

2023-12-14 10:29:30,997 file: build.py func: build line No: 35 [Thu Dec 14 10:29:30 2023] End to optimize the model.

2023-12-14 10:29:31,210 file: build.py func: build line No: 200 Saving model: 1206_cpu_O3_2_optimized_float_model.onnx.

2023-12-14 10:29:31,211 file: build.py func: build line No: 32 [Thu Dec 14 10:29:31 2023] Start to calibrate the model.

2023-12-14 10:29:31,743 file: calibration_data_set.py func: calibration_data_set line No: 89 input name: img, number_of_samples: 8

2023-12-14 10:29:31,743 file: calibration_data_set.py func: calibration_data_set line No: 100 There are 8 samples in the calibration data set.

2023-12-14 10:29:33,830 file: default_calibrater.py func: default_calibrater line No: 209 Run calibration model with default calibration method.

2023-12-14 10:29:39,865 file: calibrater.py func: calibrater line No: 208 Calibration using batch 1

2023-12-14 10:32:20,662 file: calibrater.py func: calibrater line No: 208 Calibration using batch 1

2023-12-14 10:32:36,941 file: calibrater.py func: calibrater line No: 208 Calibration using batch 1

2023-12-14 10:33:40,069 file: default_calibrater.py func: default_calibrater line No: 248 Select max-percentile:percentile=0.99995 method.

2023-12-14 10:33:40,070 file: default_calibrater.py func: default_calibrater line No: 249 Perchannel quantization is enabled.

2023-12-14 10:33:40,106 file: bias_correction.py func: bias_correction line No: 322 Run calibration model with bias correction method with bias samples:1

2023-12-14 11:16:08,149 file: calibration_data_set.py func: calibration_data_set line No: 89 input name: img, number_of_samples: 1

2023-12-14 11:16:08,149 file: calibration_data_set.py func: calibration_data_set line No: 100 There are 1 samples in the calibration data set.

2023-12-14 11:16:40,013 file: node_info.py func: node_info line No: 57 The converted model node information:

=============Bias_Correction_Info(cosine-similarity)=============

Node Before-Bias-Correlation After-Bias-Correlation

-----------------------------------------------------------------

all_cls_scores 0.994775 0.993868

all_bbox_preds 0.996729 0.996285

2023-12-14 11:17:19,043 file: font_manager.py func: font_manager line No: 1329 findfont: Matching sans\-serif:style=normal:variant=normal:weight=normal:stretch=normal:size=10.0.

2023-12-14 11:17:19,043 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerifDisplay.ttf’, name=‘DejaVu Serif Display’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmtt10.ttf’, name=‘cmtt10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizThreeSymBol.ttf’, name=‘STIXSizeThreeSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizTwoSymBol.ttf’, name=‘STIXSizeTwoSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniBolIta.ttf’, name=‘STIXNonUnicode’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-BoldItalic.ttf’, name=‘DejaVu Serif’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmex10.ttf’, name=‘cmex10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniIta.ttf’, name=‘STIXNonUnicode’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFiveSymReg.ttf’, name=‘STIXSizeFiveSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneral.ttf’, name=‘STIXGeneral’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralBolIta.ttf’, name=‘STIXGeneral’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralBol.ttf’, name=‘STIXGeneral’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizTwoSymReg.ttf’, name=‘STIXSizeTwoSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,044 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmmi10.ttf’, name=‘cmmi10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-BoldOblique.ttf’, name=‘DejaVu Sans’, style=‘oblique’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 1.335

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansDisplay.ttf’, name=‘DejaVu Sans Display’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizOneSymReg.ttf’, name=‘STIXSizeOneSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-BoldOblique.ttf’, name=‘DejaVu Sans Mono’, style=‘oblique’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmsy10.ttf’, name=‘cmsy10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizThreeSymReg.ttf’, name=‘STIXSizeThreeSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniBol.ttf’, name=‘STIXNonUnicode’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-Oblique.ttf’, name=‘DejaVu Sans Mono’, style=‘oblique’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizOneSymBol.ttf’, name=‘STIXSizeOneSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-Italic.ttf’, name=‘DejaVu Serif’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmb10.ttf’, name=‘cmb10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-Oblique.ttf’, name=‘DejaVu Sans’, style=‘oblique’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 1.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUni.ttf’, name=‘STIXNonUnicode’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFourSymBol.ttf’, name=‘STIXSizeFourSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralItalic.ttf’, name=‘STIXGeneral’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-Bold.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,045 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFourSymReg.ttf’, name=‘STIXSizeFourSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-Bold.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 0.33499999999999996

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmss10.ttf’, name=‘cmss10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmr10.ttf’, name=‘cmr10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-Bold.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 0.05

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Regular.ttf’, name=‘Liberation Sans Narrow’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘condensed’, size=‘scalable’)) = 10.25

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Bold.ttf’, name=‘Liberation Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSerif-Bold.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Italic.ttf’, name=‘Liberation Serif’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSerif.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Bold.ttf’, name=‘Liberation Sans Narrow’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘condensed’, size=‘scalable’)) = 10.535

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-BoldItalic.ttf’, name=‘Liberation Sans Narrow’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘condensed’, size=‘scalable’)) = 11.535

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSansMono.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Bold.ttf’, name=‘Liberation Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSansMono-Bold.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-BoldItalic.ttf’, name=‘Liberation Serif’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Bold.ttf’, name=‘Liberation Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,046 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Italic.ttf’, name=‘Liberation Sans’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Regular.ttf’, name=‘Liberation Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Italic.ttf’, name=‘Liberation Sans Narrow’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘condensed’, size=‘scalable’)) = 11.25

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-BoldItalic.ttf’, name=‘Liberation Mono’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSans.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 0.05

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Regular.ttf’, name=‘Liberation Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSans-Bold.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 0.33499999999999996

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Italic.ttf’, name=‘Liberation Mono’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-BoldItalic.ttf’, name=‘Liberation Sans’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Regular.ttf’, name=‘Liberation Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,047 file: font_manager.py func: font_manager line No: 1367 findfont: Matching sans\-serif:style=normal:variant=normal:weight=normal:stretch=normal:size=10.0 to DejaVu Sans (‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf’) with score of 0.050000.

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1329 findfont: Matching sans\-serif:style=normal:variant=normal:weight=normal:stretch=normal:size=12.0.

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerifDisplay.ttf’, name=‘DejaVu Serif Display’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmtt10.ttf’, name=‘cmtt10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizThreeSymBol.ttf’, name=‘STIXSizeThreeSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizTwoSymBol.ttf’, name=‘STIXSizeTwoSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniBolIta.ttf’, name=‘STIXNonUnicode’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-BoldItalic.ttf’, name=‘DejaVu Serif’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmex10.ttf’, name=‘cmex10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniIta.ttf’, name=‘STIXNonUnicode’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFiveSymReg.ttf’, name=‘STIXSizeFiveSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneral.ttf’, name=‘STIXGeneral’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,059 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralBolIta.ttf’, name=‘STIXGeneral’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralBol.ttf’, name=‘STIXGeneral’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizTwoSymReg.ttf’, name=‘STIXSizeTwoSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmmi10.ttf’, name=‘cmmi10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-BoldOblique.ttf’, name=‘DejaVu Sans’, style=‘oblique’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 1.335

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansDisplay.ttf’, name=‘DejaVu Sans Display’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizOneSymReg.ttf’, name=‘STIXSizeOneSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-BoldOblique.ttf’, name=‘DejaVu Sans Mono’, style=‘oblique’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmsy10.ttf’, name=‘cmsy10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizThreeSymReg.ttf’, name=‘STIXSizeThreeSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniBol.ttf’, name=‘STIXNonUnicode’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-Oblique.ttf’, name=‘DejaVu Sans Mono’, style=‘oblique’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizOneSymBol.ttf’, name=‘STIXSizeOneSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-Italic.ttf’, name=‘DejaVu Serif’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmb10.ttf’, name=‘cmb10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,060 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-Oblique.ttf’, name=‘DejaVu Sans’, style=‘oblique’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 1.05

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUni.ttf’, name=‘STIXNonUnicode’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFourSymBol.ttf’, name=‘STIXSizeFourSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralItalic.ttf’, name=‘STIXGeneral’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-Bold.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFourSymReg.ttf’, name=‘STIXSizeFourSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-Bold.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 0.33499999999999996

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmss10.ttf’, name=‘cmss10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmr10.ttf’, name=‘cmr10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-Bold.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 0.05

2023-12-14 11:17:19,061 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Regular.ttf’, name=‘Liberation Sans Narrow’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘condensed’, size=‘scalable’)) = 10.25

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Bold.ttf’, name=‘Liberation Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSerif-Bold.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Italic.ttf’, name=‘Liberation Serif’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSerif.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Bold.ttf’, name=‘Liberation Sans Narrow’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘condensed’, size=‘scalable’)) = 10.535

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-BoldItalic.ttf’, name=‘Liberation Sans Narrow’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘condensed’, size=‘scalable’)) = 11.535

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSansMono.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Bold.ttf’, name=‘Liberation Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSansMono-Bold.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-BoldItalic.ttf’, name=‘Liberation Serif’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Bold.ttf’, name=‘Liberation Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Italic.ttf’, name=‘Liberation Sans’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Regular.ttf’, name=‘Liberation Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Italic.ttf’, name=‘Liberation Sans Narrow’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘condensed’, size=‘scalable’)) = 11.25

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-BoldItalic.ttf’, name=‘Liberation Mono’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSans.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 0.05

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Regular.ttf’, name=‘Liberation Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSans-Bold.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 0.33499999999999996

2023-12-14 11:17:19,062 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Italic.ttf’, name=‘Liberation Mono’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,063 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-BoldItalic.ttf’, name=‘Liberation Sans’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,063 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Regular.ttf’, name=‘Liberation Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,063 file: font_manager.py func: font_manager line No: 1367 findfont: Matching sans\-serif:style=normal:variant=normal:weight=normal:stretch=normal:size=12.0 to DejaVu Sans (‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf’) with score of 0.050000.

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1329 findfont: Matching sans\-serif:style=normal:variant=normal:weight=normal:stretch=normal:size=10.0.

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerifDisplay.ttf’, name=‘DejaVu Serif Display’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmtt10.ttf’, name=‘cmtt10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizThreeSymBol.ttf’, name=‘STIXSizeThreeSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizTwoSymBol.ttf’, name=‘STIXSizeTwoSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniBolIta.ttf’, name=‘STIXNonUnicode’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-BoldItalic.ttf’, name=‘DejaVu Serif’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmex10.ttf’, name=‘cmex10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniIta.ttf’, name=‘STIXNonUnicode’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFiveSymReg.ttf’, name=‘STIXSizeFiveSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneral.ttf’, name=‘STIXGeneral’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralBolIta.ttf’, name=‘STIXGeneral’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,072 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralBol.ttf’, name=‘STIXGeneral’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizTwoSymReg.ttf’, name=‘STIXSizeTwoSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmmi10.ttf’, name=‘cmmi10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-BoldOblique.ttf’, name=‘DejaVu Sans’, style=‘oblique’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 1.335

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansDisplay.ttf’, name=‘DejaVu Sans Display’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizOneSymReg.ttf’, name=‘STIXSizeOneSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-BoldOblique.ttf’, name=‘DejaVu Sans Mono’, style=‘oblique’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmsy10.ttf’, name=‘cmsy10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizThreeSymReg.ttf’, name=‘STIXSizeThreeSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUniBol.ttf’, name=‘STIXNonUnicode’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-Oblique.ttf’, name=‘DejaVu Sans Mono’, style=‘oblique’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizOneSymBol.ttf’, name=‘STIXSizeOneSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-Italic.ttf’, name=‘DejaVu Serif’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmb10.ttf’, name=‘cmb10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-Oblique.ttf’, name=‘DejaVu Sans’, style=‘oblique’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 1.05

2023-12-14 11:17:19,073 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXNonUni.ttf’, name=‘STIXNonUnicode’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFourSymBol.ttf’, name=‘STIXSizeFourSym’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXGeneralItalic.ttf’, name=‘STIXGeneral’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono-Bold.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/STIXSizFourSymReg.ttf’, name=‘STIXSizeFourSym’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSansMono.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans-Bold.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 0.33499999999999996

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmss10.ttf’, name=‘cmss10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/cmr10.ttf’, name=‘cmr10’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSerif-Bold.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 0.05

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Regular.ttf’, name=‘Liberation Sans Narrow’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘condensed’, size=‘scalable’)) = 10.25

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Bold.ttf’, name=‘Liberation Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSerif-Bold.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Italic.ttf’, name=‘Liberation Serif’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,074 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSerif.ttf’, name=‘DejaVu Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Bold.ttf’, name=‘Liberation Sans Narrow’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘condensed’, size=‘scalable’)) = 10.535

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-BoldItalic.ttf’, name=‘Liberation Sans Narrow’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘condensed’, size=‘scalable’)) = 11.535

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSansMono.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Bold.ttf’, name=‘Liberation Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSansMono-Bold.ttf’, name=‘DejaVu Sans Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-BoldItalic.ttf’, name=‘Liberation Serif’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Bold.ttf’, name=‘Liberation Mono’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 10.335

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Italic.ttf’, name=‘Liberation Sans’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSerif-Regular.ttf’, name=‘Liberation Serif’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSansNarrow-Italic.ttf’, name=‘Liberation Sans Narrow’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘condensed’, size=‘scalable’)) = 11.25

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-BoldItalic.ttf’, name=‘Liberation Mono’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSans.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 0.05

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-Regular.ttf’, name=‘Liberation Sans’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/dejavu/DejaVuSans-Bold.ttf’, name=‘DejaVu Sans’, style=‘normal’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 0.33499999999999996

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Italic.ttf’, name=‘Liberation Mono’, style=‘italic’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 11.05

2023-12-14 11:17:19,075 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationSans-BoldItalic.ttf’, name=‘Liberation Sans’, style=‘italic’, variant=‘normal’, weight=700, stretch=‘normal’, size=‘scalable’)) = 11.335

2023-12-14 11:17:19,076 file: font_manager.py func: font_manager line No: 1341 findfont: score(FontEntry(fname=‘/usr/share/fonts/truetype/liberation/LiberationMono-Regular.ttf’, name=‘Liberation Mono’, style=‘normal’, variant=‘normal’, weight=400, stretch=‘normal’, size=‘scalable’)) = 10.05

2023-12-14 11:17:19,076 file: font_manager.py func: font_manager line No: 1367 findfont: Matching sans\-serif:style=normal:variant=normal:weight=normal:stretch=normal:size=10.0 to DejaVu Sans (‘/usr/local/lib/python3.8/dist-packages/matplotlib/mpl-data/fonts/ttf/DejaVuSans.ttf’) with score of 0.050000.

2023-12-14 11:19:11,014 file: accumulation_error.py func: accumulation_error line No: 298 Result has been saved as ./bias_correction/conv_accumulate_err_of_qmodel_mean-diff-error.png

2023-12-14 11:19:41,966 file: build.py func: build line No: 35 [Thu Dec 14 11:19:41 2023] End to calibrate the model.

2023-12-14 11:19:42,182 file: build.py func: build line No: 200 Saving model: 1206_cpu_O3_2_calibrated_model.onnx.

2023-12-14 11:19:42,182 file: build.py func: build line No: 32 [Thu Dec 14 11:19:42 2023] Start to quantize the model.

2023-12-14 11:20:08,261 file: build.py func: build line No: 35 [Thu Dec 14 11:20:08 2023] End to quantize the model.

2023-12-14 11:20:09,365 file: build.py func: build line No: 200 Saving model: 1206_cpu_O3_2_quantized_model.onnx.

2023-12-14 11:20:12,639 file: build.py func: build line No: 32 [Thu Dec 14 11:20:12 2023] Start to compile the model with march bayes.

2023-12-14 11:20:12,639 file: build.py func: build line No: 35 [Thu Dec 14 11:20:12 2023] End to compile the model with march bayes.

2023-12-14 11:20:14,151 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_0

2023-12-14 11:20:15,377 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘pyramid’]

2023-12-14 11:20:15,377 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_0.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_0.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source pyramid

2023-12-14 11:24:11,451 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache7403.json

2023-12-14 11:24:12,997 file: tool_utils.py func: tool_utils line No: 322 consumed time 237.568

2023-12-14 11:24:13,238 file: tool_utils.py func: tool_utils line No: 322 FPS=429.98, latency = 13954.0 us, DDR = 18474565 bytes (see torch_jit_subgraph_0.html)

2023-12-14 11:24:13,250 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_1

2023-12-14 11:24:13,620 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:24:13,620 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_1.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_1.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:24:13,710 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “UNIT_CONV_FOR_Add_247” becomes slow (0ms → 0.022ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:24:13,710 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “UNIT_CONV_FOR_Add_477” becomes slow (0ms → 0.022ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:24:13,819 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_228” becomes slow (0.014ms → 0.028ms). Output is aligned from 1x1x4224x256 to 1x2x4224x256 (+100%).

2023-12-14 11:24:13,820 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_231” becomes slow (0ms → 0.001ms). Output is aligned from 1x1x4224x1 to 1x2x4224x8 (+1500%).

2023-12-14 11:24:13,820 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_235_mul” becomes slow (0.014ms → 0.028ms). Output is aligned from 1x1x4224x256 to 1x2x4224x256 (+100%).

2023-12-14 11:24:13,820 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_246” becomes slow (0.014ms → 0.028ms). Output is aligned from 1x1x4224x256 to 1x2x4224x256 (+100%).

2023-12-14 11:24:13,821 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_246” becomes slow (0.014ms → 0.028ms). Output is aligned from 1x1x4224x256 to 1x2x4224x256 (+100%).

2023-12-14 11:24:13,821 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_257” becomes slow (0.014ms → 0.028ms). Output is aligned from 1x1x4224x256 to 1x2x4224x256 (+100%).

2023-12-14 11:24:13,822 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_546” becomes slow (0.014ms → 0.056ms). Output is aligned from 1x8x4224x32 to 1x8x4224x256 (+700%).

2023-12-14 11:24:13,822 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_783” becomes slow (0.014ms → 0.056ms). Output is aligned from 1x8x32x4224 to 1x8x256x4224 (+700%).

2023-12-14 11:24:13,822 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_1017” becomes slow (0.014ms → 0.056ms). Output is aligned from 1x8x32x4224 to 1x8x256x4224 (+700%).

2023-12-14 11:24:13,823 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_1251” becomes slow (0.014ms → 0.056ms). Output is aligned from 1x8x32x4224 to 1x8x256x4224 (+700%).

2023-12-14 11:24:13,823 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_1482” becomes slow (0.014ms → 0.056ms). Output is aligned from 1x8x4224x32 to 1x8x4224x256 (+700%).

2023-12-14 11:24:13,823 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_1485” becomes slow (0.014ms → 0.056ms). Output is aligned from 1x8x32x4224 to 1x8x256x4224 (+700%).

2023-12-14 11:24:13,823 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_1719” becomes slow (0.014ms → 0.056ms). Output is aligned from 1x8x32x4224 to 1x8x256x4224 (+700%).

2023-12-14 11:24:19,565 file: tool_utils.py func: tool_utils line No: 322 consumed time 5.89484

2023-12-14 11:24:19,747 file: tool_utils.py func: tool_utils line No: 322 FPS=108.66, latency = 55218.1 us, DDR = 77580213 bytes (see torch_jit_subgraph_1.html)

2023-12-14 11:24:19,765 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_2

2023-12-14 11:24:19,930 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:24:19,930 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_2.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_2.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:24:19,993 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_566” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:19,994 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_566” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:21,183 file: tool_utils.py func: tool_utils line No: 322 consumed time 1.20284

2023-12-14 11:24:21,285 file: tool_utils.py func: tool_utils line No: 322 FPS=65.86, latency = 15183.9 us, DDR = 148233728 bytes (see torch_jit_subgraph_2.html)

2023-12-14 11:24:21,291 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_3

2023-12-14 11:24:21,494 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:24:21,494 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_3.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_3.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:24:21,572 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_568” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:24:21,572 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_568” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:21,573 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_568” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:21,573 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_571” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:24:21,574 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_571” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:24:21,574 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_575_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:24:21,575 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_575_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:21,575 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_576” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:21,576 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_576” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:21,576 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_577” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:21,576 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_585” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:21,577 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_585” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:27,239 file: tool_utils.py func: tool_utils line No: 322 consumed time 5.69503

2023-12-14 11:24:27,318 file: tool_utils.py func: tool_utils line No: 322 FPS=385.28, latency = 2595.5 us, DDR = 8127552 bytes (see torch_jit_subgraph_3.html)

2023-12-14 11:24:27,321 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_4

2023-12-14 11:24:27,495 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:24:27,495 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_4.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_4.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:24:27,565 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_587” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:24:27,566 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_587” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:27,567 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_590” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:24:27,567 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_590” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:24:27,568 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_594_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:24:27,568 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_594_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:27,568 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_595” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:27,569 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_595” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:27,569 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_596” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:27,570 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_608” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:24:27,570 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_678” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:24:27,570 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_680_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:24:27,571 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_680_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:24:27,571 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_680_mul_onnx::MatMul_1212_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:25:38,068 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache20286.json

2023-12-14 11:25:38,836 file: tool_utils.py func: tool_utils line No: 322 consumed time 71.2915

2023-12-14 11:25:38,951 file: tool_utils.py func: tool_utils line No: 322 FPS=136.69, latency = 7315.9 us, DDR = 54970624 bytes (see torch_jit_subgraph_4.html)

2023-12-14 11:25:38,960 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_5

2023-12-14 11:25:39,119 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr’]

2023-12-14 11:25:39,119 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_5.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_5.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr

2023-12-14 11:25:39,182 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_698” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:25:40,043 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.871254

2023-12-14 11:25:40,111 file: tool_utils.py func: tool_utils line No: 322 FPS=345.86, latency = 2891.3 us, DDR = 16837888 bytes (see torch_jit_subgraph_5.html)

2023-12-14 11:25:40,113 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_6

2023-12-14 11:25:40,285 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr’]

2023-12-14 11:25:40,285 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_6.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_6.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr

2023-12-14 11:25:40,349 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_700” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:25:40,350 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_700” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:25:40,350 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_703” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:25:40,351 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_703” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:25:40,351 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_707_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:25:40,351 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_707_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:25:40,352 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_707_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:25:40,352 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_708” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:25:40,353 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_708” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:25:40,353 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_709” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:25:40,354 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_710” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:25:40,354 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_782_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:25:40,355 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_782_mul_onnx::MatMul_1314_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:26:49,932 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache87811.json

2023-12-14 11:26:51,481 file: tool_utils.py func: tool_utils line No: 322 consumed time 71.1468

2023-12-14 11:26:51,615 file: tool_utils.py func: tool_utils line No: 322 FPS=58.9, latency = 16976.8 us, DDR = 175628352 bytes (see torch_jit_subgraph_6.html)

2023-12-14 11:26:51,627 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_7

2023-12-14 11:26:51,780 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:26:51,780 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_7.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_7.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:26:51,836 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_800” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:26:51,837 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_800” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:26:52,956 file: tool_utils.py func: tool_utils line No: 322 consumed time 1.12641

2023-12-14 11:26:53,033 file: tool_utils.py func: tool_utils line No: 322 FPS=22860.8, latency = 39368.7 us, DDR = 13330 bytes (see torch_jit_subgraph_7.html)

2023-12-14 11:26:53,038 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_8

2023-12-14 11:26:53,215 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:26:53,215 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_8.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_8.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:26:53,282 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_802” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:26:53,282 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_802” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:26:53,283 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_802” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:26:53,283 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_805” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:26:53,283 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_805” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:26:53,284 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_809_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:26:53,284 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_809_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:26:53,285 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_810” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:26:53,285 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_811” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:26:53,286 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_811” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:00,278 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache90676.json

2023-12-14 11:27:00,687 file: tool_utils.py func: tool_utils line No: 322 consumed time 7.42273

2023-12-14 11:27:00,780 file: tool_utils.py func: tool_utils line No: 322 FPS=111.31, latency = 8984.3 us, DDR = 37306176 bytes (see torch_jit_subgraph_8.html)

2023-12-14 11:27:00,787 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_9

2023-12-14 11:27:00,939 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr’]

2023-12-14 11:27:00,939 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_9.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_9.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr

2023-12-14 11:27:00,995 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “MatMul_817_transpose_0” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x256 to 1x900x256x256 (+25500%).

2023-12-14 11:27:01,417 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.427974

2023-12-14 11:27:01,482 file: tool_utils.py func: tool_utils line No: 322 FPS=444.36, latency = 2250.4 us, DDR = 463872 bytes (see torch_jit_subgraph_9.html)

2023-12-14 11:27:01,484 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_10

2023-12-14 11:27:01,639 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:27:01,639 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_10.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_10.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:27:01,695 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_819” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:01,696 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_819” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:01,979 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.289674

2023-12-14 11:27:02,040 file: tool_utils.py func: tool_utils line No: 322 FPS=3167.1, latency = 315.7 us, DDR = 707840 bytes (see torch_jit_subgraph_10.html)

2023-12-14 11:27:02,041 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_11

2023-12-14 11:27:02,216 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:27:02,216 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_11.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_11.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:27:02,288 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_821” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:27:02,289 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_821” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:02,290 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_824” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:27:02,290 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_824” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:27:02,291 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_828_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:27:02,291 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_828_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:02,292 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_829” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:02,292 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_830” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:02,293 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_830” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:02,293 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_842” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:27:02,293 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_912” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:27:02,294 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_914_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:27:02,294 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_914_mul_onnx::MatMul_1446_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:28:13,411 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache66466.json

2023-12-14 11:28:14,176 file: tool_utils.py func: tool_utils line No: 322 consumed time 71.9087

2023-12-14 11:28:14,291 file: tool_utils.py func: tool_utils line No: 322 FPS=136.69, latency = 7315.9 us, DDR = 54970624 bytes (see torch_jit_subgraph_11.html)

2023-12-14 11:28:14,299 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_12

2023-12-14 11:28:14,470 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr,ddr’]

2023-12-14 11:28:14,471 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_12.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_12.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr,ddr

2023-12-14 11:28:14,541 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_932” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:14,542 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_932” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:14,542 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_934” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:14,543 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_934” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:14,543 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_937” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:28:14,543 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_937” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:28:14,544 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_941_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:14,544 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_941_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:14,545 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_942” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:14,545 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_943” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:14,546 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_944” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:14,546 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1016_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:28:14,547 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1016_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:28:14,547 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1016_mul_onnx::MatMul_1548_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:28:20,168 file: tool_utils.py func: tool_utils line No: 322 consumed time 5.64724

2023-12-14 11:28:20,301 file: tool_utils.py func: tool_utils line No: 322 FPS=50.89, latency = 19648.7 us, DDR = 194324288 bytes (see torch_jit_subgraph_12.html)

2023-12-14 11:28:20,313 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_13

2023-12-14 11:28:20,471 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:28:20,471 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_13.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_13.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:28:20,529 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1034” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:20,530 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1034” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:21,218 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.697095

2023-12-14 11:28:21,288 file: tool_utils.py func: tool_utils line No: 322 FPS=292375.97, latency = 3078.2 us, DDR = 5213 bytes (see torch_jit_subgraph_13.html)

2023-12-14 11:28:21,291 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_14

2023-12-14 11:28:21,494 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:28:21,494 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_14.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_14.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:28:21,572 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1036” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:21,572 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1036” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:21,573 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1039” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:28:21,573 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1039” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:28:21,574 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1043_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:21,574 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1043_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:21,575 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1044” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:21,575 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1045” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:21,576 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1045” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:21,576 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1053” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:27,267 file: tool_utils.py func: tool_utils line No: 322 consumed time 5.72352

2023-12-14 11:28:27,346 file: tool_utils.py func: tool_utils line No: 322 FPS=385.28, latency = 2595.5 us, DDR = 8127552 bytes (see torch_jit_subgraph_14.html)

2023-12-14 11:28:27,350 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_15

2023-12-14 11:28:27,525 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:28:27,526 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_15.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_15.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:28:27,597 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1055” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:27,597 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1055” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:27,598 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1058” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:28:27,598 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1058” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:28:27,598 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1062_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:27,599 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1062_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:27,599 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1063” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:27,600 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1063” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:27,600 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1064” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:27,601 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1076” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:27,601 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_1146” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:28:27,601 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1148_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:28:27,602 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1148_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:28:27,602 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1148_mul_onnx::MatMul_1680_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:28:31,273 file: tool_utils.py func: tool_utils line No: 322 consumed time 3.69746

2023-12-14 11:28:31,384 file: tool_utils.py func: tool_utils line No: 322 FPS=136.69, latency = 7315.9 us, DDR = 54970624 bytes (see torch_jit_subgraph_15.html)

2023-12-14 11:28:31,392 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_16

2023-12-14 11:28:31,564 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr,ddr’]

2023-12-14 11:28:31,564 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_16.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_16.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr,ddr

2023-12-14 11:28:31,636 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1166” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:31,637 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1168” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:31,637 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1171” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:28:31,638 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1171” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:28:31,638 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1175_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:31,639 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1175_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:31,639 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1176” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:31,640 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1176” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:31,640 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1177” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:31,640 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1178” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:31,641 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1178” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:31,641 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1250_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:28:31,642 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1250_mul_onnx::MatMul_1782_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:28:37,277 file: tool_utils.py func: tool_utils line No: 322 consumed time 5.66221

2023-12-14 11:28:37,410 file: tool_utils.py func: tool_utils line No: 322 FPS=50.89, latency = 19648.7 us, DDR = 194324288 bytes (see torch_jit_subgraph_16.html)

2023-12-14 11:28:37,423 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_17

2023-12-14 11:28:37,601 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:28:37,601 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_17.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_17.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:28:37,671 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1268” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:37,672 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1270” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:37,672 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1273” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:28:37,673 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1273” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:28:37,673 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1277_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:37,673 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1277_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:37,674 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1277_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:37,674 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1278” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:37,675 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1279” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:50,450 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache86592.json

2023-12-14 11:28:51,430 file: tool_utils.py func: tool_utils line No: 322 consumed time 13.7784

2023-12-14 11:28:51,534 file: tool_utils.py func: tool_utils line No: 322 FPS=18803.77, latency = 47862.7 us, DDR = 56846 bytes (see torch_jit_subgraph_17.html)

2023-12-14 11:28:51,544 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_18

2023-12-14 11:28:51,699 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr’]

2023-12-14 11:28:51,699 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_18.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_18.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr

2023-12-14 11:28:51,756 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “MatMul_1285_transpose_0” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x256 to 1x900x256x256 (+25500%).

2023-12-14 11:28:52,163 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.413214

2023-12-14 11:28:52,228 file: tool_utils.py func: tool_utils line No: 322 FPS=444.36, latency = 2250.4 us, DDR = 463872 bytes (see torch_jit_subgraph_18.html)

2023-12-14 11:28:52,230 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_19

2023-12-14 11:28:52,386 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:28:52,386 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_19.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_19.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:28:52,442 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1287” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:52,443 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1287” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:52,730 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.293919

2023-12-14 11:28:52,793 file: tool_utils.py func: tool_utils line No: 322 FPS=3167.1, latency = 315.7 us, DDR = 707840 bytes (see torch_jit_subgraph_19.html)

2023-12-14 11:28:52,794 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_20

2023-12-14 11:28:52,970 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:28:52,970 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_20.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_20.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:28:53,048 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1289” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:53,049 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1289” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,049 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1292” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:28:53,050 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1292” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:28:53,050 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1296_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:53,050 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1296_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,051 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1296_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,051 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1297” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,052 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1298” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,052 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1300” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,053 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1300” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,053 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1303” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:28:53,053 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1303” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:28:53,054 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1307_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:28:53,054 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1307_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,055 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1308” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,055 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1309” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,055 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1310” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,056 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1310” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:28:53,056 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Transpose_1380” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:28:53,056 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1382_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:28:53,057 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1382_mul_onnx::MatMul_1914_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:28:59,928 file: tool_utils.py func: tool_utils line No: 322 consumed time 6.90682

2023-12-14 11:29:00,047 file: tool_utils.py func: tool_utils line No: 322 FPS=108.84, latency = 9187.8 us, DDR = 68720704 bytes (see torch_jit_subgraph_20.html)

2023-12-14 11:29:00,057 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_21

2023-12-14 11:29:00,220 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr’]

2023-12-14 11:29:00,220 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_21.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_21.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr

2023-12-14 11:29:00,280 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1400” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:29:01,153 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.88331

2023-12-14 11:29:01,222 file: tool_utils.py func: tool_utils line No: 322 FPS=345.86, latency = 2891.3 us, DDR = 16837888 bytes (see torch_jit_subgraph_21.html)

2023-12-14 11:29:01,224 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_22

2023-12-14 11:29:01,393 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr’]

2023-12-14 11:29:01,393 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_22.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_22.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr

2023-12-14 11:29:01,459 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1402” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:29:01,459 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1402” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:29:01,460 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1402” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:29:01,460 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1405” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:29:01,460 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1405” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:29:01,461 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1409_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:29:01,461 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1409_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:29:01,462 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1409_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:29:01,462 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1410” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:29:01,463 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1411” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:29:01,463 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1412” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:29:01,464 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1484_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:29:01,464 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1484_mul_onnx::MatMul_2016_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:30:11,672 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache68.json

2023-12-14 11:30:13,231 file: tool_utils.py func: tool_utils line No: 322 consumed time 71.7874

2023-12-14 11:30:13,364 file: tool_utils.py func: tool_utils line No: 322 FPS=58.9, latency = 16976.8 us, DDR = 175628352 bytes (see torch_jit_subgraph_22.html)

2023-12-14 11:30:13,377 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_23

2023-12-14 11:30:13,559 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr’]

2023-12-14 11:30:13,559 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_23.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_23.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr

2023-12-14 11:30:13,634 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1502” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:13,635 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1502” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:13,635 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1504” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:13,636 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1504” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:13,636 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1507” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:13,637 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1507” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:13,637 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1511_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:13,637 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1511_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:13,638 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1511_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:13,638 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1512” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:13,638 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1513” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:13,639 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1513” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:18,432 file: tool_utils.py func: tool_utils line No: 322 consumed time 4.82056

2023-12-14 11:30:18,531 file: tool_utils.py func: tool_utils line No: 322 FPS=41.52, latency = 24085.2 us, DDR = 188267840 bytes (see torch_jit_subgraph_23.html)

2023-12-14 11:30:18,540 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_24

2023-12-14 11:30:18,694 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr’]

2023-12-14 11:30:18,694 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_24.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_24.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr

2023-12-14 11:30:18,750 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “MatMul_1519_transpose_0” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x256 to 1x900x256x256 (+25500%).

2023-12-14 11:30:19,188 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.443801

2023-12-14 11:30:19,253 file: tool_utils.py func: tool_utils line No: 322 FPS=444.36, latency = 2250.4 us, DDR = 463872 bytes (see torch_jit_subgraph_24.html)

2023-12-14 11:30:19,255 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_25

2023-12-14 11:30:19,410 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:30:19,410 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_25.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_25.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:30:19,467 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1521” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:19,750 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.289652

2023-12-14 11:30:19,812 file: tool_utils.py func: tool_utils line No: 322 FPS=3167.1, latency = 315.7 us, DDR = 707840 bytes (see torch_jit_subgraph_25.html)

2023-12-14 11:30:19,813 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_26

2023-12-14 11:30:19,991 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:30:19,991 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_26.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_26.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:30:20,066 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1523” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:20,067 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1523” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,068 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1526” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:20,068 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1526” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:20,068 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1530_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:20,069 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1530_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,069 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1531” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,070 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1531” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,070 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1532” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,070 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1534” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,071 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1534” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,071 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1537” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:20,071 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1537” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:20,072 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1541_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:20,072 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1541_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,072 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1542” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,073 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1542” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,073 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1543” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,073 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1544” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,074 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1544” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:20,074 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1616_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:30:20,074 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1616_mul_onnx::MatMul_2148_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:30:27,200 file: tool_utils.py func: tool_utils line No: 322 consumed time 7.15931

2023-12-14 11:30:27,316 file: tool_utils.py func: tool_utils line No: 322 FPS=107.38, latency = 9312.9 us, DDR = 69381440 bytes (see torch_jit_subgraph_26.html)

2023-12-14 11:30:27,325 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_27

2023-12-14 11:30:27,495 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr’]

2023-12-14 11:30:27,495 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_27.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_27.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr

2023-12-14 11:30:27,562 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1634” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:27,563 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1634” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:27,563 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1636” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:27,564 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1636” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:27,564 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1639” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:27,565 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1639” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:27,565 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1643_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:27,565 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1643_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:27,566 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1644” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:27,566 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1645” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:27,567 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1646” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:27,567 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1718_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x900x8x32 to 1x900x16x32 (+100%).

2023-12-14 11:30:27,568 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1718_mul_onnx::MatMul_2250_Transpose” becomes slow (0.003ms → 0.012ms). Output is aligned from 1x8x900x32 to 1x8x900x256 (+700%).

2023-12-14 11:30:39,279 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache88327.json

2023-12-14 11:30:41,437 file: tool_utils.py func: tool_utils line No: 322 consumed time 13.8925

2023-12-14 11:30:41,581 file: tool_utils.py func: tool_utils line No: 322 FPS=16057.44, latency = 56048.8 us, DDR = 210537 bytes (see torch_jit_subgraph_27.html)

2023-12-14 11:30:41,599 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_28

2023-12-14 11:30:41,754 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:30:41,754 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_28.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_28.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:30:41,811 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1736” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:41,812 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1736” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:42,937 file: tool_utils.py func: tool_utils line No: 322 consumed time 1.1317

2023-12-14 11:30:43,015 file: tool_utils.py func: tool_utils line No: 322 FPS=22860.8, latency = 39368.7 us, DDR = 13330 bytes (see torch_jit_subgraph_28.html)

2023-12-14 11:30:43,019 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_29

2023-12-14 11:30:43,202 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:30:43,202 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_29.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_29.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:30:43,269 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1738” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:43,270 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1738” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:43,271 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1741” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:43,271 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1741” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:43,271 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1745_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:43,272 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1745_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:43,272 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1746” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:43,273 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1746” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:43,273 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1747” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:50,347 file: tool_utils.py func: tool_utils line No: 322 /open_explore/samples/streampetr_yu/model_output_bin/cache42328.json

2023-12-14 11:30:50,732 file: tool_utils.py func: tool_utils line No: 322 consumed time 7.48002

2023-12-14 11:30:50,826 file: tool_utils.py func: tool_utils line No: 322 FPS=111.31, latency = 8984.3 us, DDR = 37306176 bytes (see torch_jit_subgraph_29.html)

2023-12-14 11:30:50,833 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_30

2023-12-14 11:30:50,985 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr’]

2023-12-14 11:30:50,986 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_30.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_30.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr

2023-12-14 11:30:51,042 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “MatMul_1753_transpose_0” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x256 to 1x900x256x256 (+25500%).

2023-12-14 11:30:51,465 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.429176

2023-12-14 11:30:51,531 file: tool_utils.py func: tool_utils line No: 322 FPS=444.36, latency = 2250.4 us, DDR = 463872 bytes (see torch_jit_subgraph_30.html)

2023-12-14 11:30:51,533 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_31

2023-12-14 11:30:51,687 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:30:51,687 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_31.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_31.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:30:51,745 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1755” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:52,030 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.291044

2023-12-14 11:30:52,092 file: tool_utils.py func: tool_utils line No: 322 FPS=3167.1, latency = 315.7 us, DDR = 707840 bytes (see torch_jit_subgraph_31.html)

2023-12-14 11:30:52,093 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_32

2023-12-14 11:30:52,248 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr’]

2023-12-14 11:30:52,248 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_32.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_32.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr

2023-12-14 11:30:52,305 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1757” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:52,306 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1757” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:52,306 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1760” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:52,307 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1760” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:52,307 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1764_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:52,308 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1764_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:52,308 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1765” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:52,309 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1765” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:52,309 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1766” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,351 file: tool_utils.py func: tool_utils line No: 322 consumed time 2.053

2023-12-14 11:30:54,428 file: tool_utils.py func: tool_utils line No: 322 FPS=649.96, latency = 1538.5 us, DDR = 7043904 bytes (see torch_jit_subgraph_32.html)

2023-12-14 11:30:54,432 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_33

2023-12-14 11:30:54,671 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr,ddr,ddr,ddr,ddr,ddr,ddr,ddr,ddr,ddr’]

2023-12-14 11:30:54,671 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_33.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_33.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr,ddr,ddr,ddr,ddr,ddr,ddr,ddr,ddr,ddr

2023-12-14 11:30:54,746 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1824-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,746 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1839-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,747 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1914-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,747 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1929-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,748 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2004-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,748 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2019-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,748 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2094-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,749 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2109-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,749 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2184-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,749 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2199-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,749 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2274-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,750 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2289-conv” becomes slow (0ms → 0.006ms). input & output channels per group is 1, recommend multiples of 4 & 8

2023-12-14 11:30:54,930 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_598” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:54,931 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_598” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,932 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_601” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:54,932 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_601” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:54,932 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_605_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:54,933 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_605_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,933 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_606” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,934 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_606” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,934 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_607” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,935 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_832” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:54,935 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_832” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,935 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_835” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:54,936 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_835” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:54,936 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_839_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:54,936 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_839_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,937 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_840” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,937 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_841” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,938 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1066” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:54,938 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1066” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,938 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1069” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:54,939 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1069” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:54,939 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1073_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:54,939 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1073_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,940 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1074” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,940 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1075” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,941 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1768” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:54,941 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1768” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,941 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1771” becomes slow (0.024ms → 0.384ms). Output is aligned from 1x900x1x1 to 1x900x128x1 (+12700%).

2023-12-14 11:30:54,942 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “ReduceMean_1771” becomes slow (0ms → 0.002ms). Output is aligned from 1x900x1x1 to 1x900x16x8 (+12700%).

2023-12-14 11:30:54,942 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1775_mul” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x1x8 to 1x900x256x8 (+25500%).

2023-12-14 11:30:54,942 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1775_mul” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,943 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_1776” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,943 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Add_1777” becomes slow (0.003ms → 0.048ms). Output is aligned from 1x900x1x256 to 1x900x16x256 (+1500%).

2023-12-14 11:30:54,944 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_1811_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,944 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1816” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,944 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1823_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,945 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1823_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,945 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1831” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,945 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1838_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,946 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1838_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,946 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_1846_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,946 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_1901_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,946 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1906” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,947 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1906” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,947 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1913_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,947 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1921” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,948 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1921” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,948 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_1928_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,948 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_1936_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,949 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_1991_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,949 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_1996” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,950 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2003_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,950 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_2011” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,950 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2018_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,951 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2018_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,951 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_2026_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,951 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Slice_2042_NCHW2NHWC_LayoutConvert_Input0” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x10x1 to 1x900x256x1 (+2460%).

2023-12-14 11:30:54,952 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_2081_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,952 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_2086” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,952 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2093_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,953 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2093_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,953 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_2101” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,953 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2108_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,954 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2108_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,954 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_2116_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,954 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Slice_2132_NCHW2NHWC_LayoutConvert_Input0” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x10x1 to 1x900x256x1 (+2460%).

2023-12-14 11:30:54,954 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_2171_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,955 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_2176” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,955 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2183_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,956 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_2191” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,956 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2198_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,957 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_2206_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,957 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Slice_2222_NCHW2NHWC_LayoutConvert_Input0” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x10x1 to 1x900x256x1 (+2460%).

2023-12-14 11:30:54,957 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_2261_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,958 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_2266” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,958 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2273_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,959 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Sub_2281” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,959 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2288_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,960 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Div_2288_mul” becomes slow (0.003ms → 0.006ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,960 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Gather_2296_NHWC2NCHW_LayoutConvert_Output0” becomes slow (0.012ms → 0.024ms). Output is aligned from 1x1x900x256 to 1x2x912x256 (+102%).

2023-12-14 11:30:54,960 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Slice_2312_NCHW2NHWC_LayoutConvert_Input0” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x10x1 to 1x900x256x1 (+2460%).

2023-12-14 11:31:10,742 file: tool_utils.py func: tool_utils line No: 322 consumed time 16.0213

2023-12-14 11:31:10,904 file: tool_utils.py func: tool_utils line No: 322 FPS=27.92, latency = 35816.5 us, DDR = 116080640 bytes (see torch_jit_subgraph_33.html)

2023-12-14 11:31:10,926 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_34

2023-12-14 11:31:11,079 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr’]

2023-12-14 11:31:11,079 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_34.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_34.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr

2023-12-14 11:31:11,139 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Slice_1862_NCHW2NHWC_LayoutConvert_Input0” becomes slow (0.001ms → 0.002ms). Output is aligned from 1x900x10x1 to 1x900x256x1 (+2460%).

2023-12-14 11:31:11,452 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.322853

2023-12-14 11:31:11,518 file: tool_utils.py func: tool_utils line No: 322 FPS=7144.05, latency = 140.0 us, DDR = 478336 bytes (see torch_jit_subgraph_34.html)

2023-12-14 11:31:11,519 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_35

2023-12-14 11:31:11,672 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr’]

2023-12-14 11:31:11,672 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_35.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_35.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr

2023-12-14 11:31:12,044 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.321979

2023-12-14 11:31:12,111 file: tool_utils.py func: tool_utils line No: 322 FPS=8419.16, latency = 118.8 us, DDR = 159872 bytes (see torch_jit_subgraph_35.html)

2023-12-14 11:31:12,113 file: hybrid_build.py func: hybrid_build line No: 134 Compile submodel: torch_jit_subgraph_36

2023-12-14 11:31:12,267 file: hbdk_cc.py func: hbdk_cc line No: 115 hbdk-cc parameters:[‘–O3’, ‘–cache’, ‘/open_explore/samples/streampetr_yu/model_output_bin/cache.json’, ‘–debug’, ‘–core-num’, ‘1’, ‘–fast’, ‘–advice’, ‘1’, ‘–input-layout’, ‘NHWC’, ‘–output-layout’, ‘NHWC’, ‘–input-source’, ‘ddr’]

2023-12-14 11:31:12,267 file: hbdk_cc.py func: hbdk_cc line No: 116 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmp_f07jory/torch_jit_subgraph_36.hbir -o /tmp/tmp_f07jory/torch_jit_subgraph_36.hbm --march bayes --progressbar --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 --input-layout NHWC --output-layout NHWC --input-source ddr

2023-12-14 11:31:12,324 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2356” becomes slow (0ms → 0.005ms). Output is aligned from 6x900x3x1 to 6x900x16x4 (+2033%).

2023-12-14 11:31:12,324 file: tool_utils.py func: tool_utils line No: 322 advice: Layer “Mul_2356” becomes slow (0ms → 0.009ms). Output is aligned from 6x900x3x1 to 6x900x16x8 (+4166%).

2023-12-14 11:31:12,601 file: tool_utils.py func: tool_utils line No: 322 consumed time 0.283866

2023-12-14 11:31:12,667 file: tool_utils.py func: tool_utils line No: 322 FPS=22318.94, latency = 268.8 us, DDR = 28928 bytes (see torch_jit_subgraph_36.html)

2023-12-14 11:31:20,796 file: node_info.py func: node_info line No: 57 The converted model node information:

==========================================================================================================================

Node ON Subgraph Type Cosine Similarity Threshold In/Out DataType

---------------------------------------------------------------------------------------------------------------------------

HZ_PREPROCESS_FOR_img BPU id(0) HzPreprocess 0.999977 127.000000 int8/int8

Conv_0 BPU id(0) Conv 0.999945 3.257760 int8/int8

MaxPool_2 BPU id(0) MaxPool 0.999783 4.624975 int8/int8

Conv_3 BPU id(0) Conv 0.999647 4.624975 int8/int8

Conv_5 BPU id(0) Conv 0.999301 1.911393 int8/int8

Conv_7 BPU id(0) Conv 0.999328 1.598190 int8/int8

Conv_8 BPU id(0) Conv 0.999499 4.624975 int8/int8

Conv_11 BPU id(0) Conv 0.998793 2.241488 int8/int8

Conv_13 BPU id(0) Conv 0.998037 1.418002 int8/int8

Conv_15 BPU id(0) Conv 0.994136 1.608524 int8/int8

Conv_18 BPU id(0) Conv 0.996524 2.211155 int8/int8

Conv_20 BPU id(0) Conv 0.990370 1.379471 int8/int8

Conv_22 BPU id(0) Conv 0.989648 1.535634 int8/int8

Conv_25 BPU id(0) Conv 0.995023 2.210547 int8/int8

Conv_27 BPU id(0) Conv 0.994177 1.582342 int8/int8

Conv_29 BPU id(0) Conv 0.992790 1.686599 int8/int8

Conv_30 BPU id(0) Conv 0.996900 2.210547 int8/int8

Conv_33 BPU id(0) Conv 0.998117 2.392112 int8/int8

Conv_35 BPU id(0) Conv 0.998526 1.217185 int8/int8

Conv_37 BPU id(0) Conv 0.997126 2.384086 int8/int8

Conv_40 BPU id(0) Conv 0.996047 2.912169 int8/int8

Conv_42 BPU id(0) Conv 0.994332 1.707031 int8/int8

Conv_44 BPU id(0) Conv 0.995535 1.770006 int8/int8

Conv_47 BPU id(0) Conv 0.996054 2.948433 int8/int8

Conv_49 BPU id(0) Conv 0.994387 1.486307 int8/int8

Conv_51 BPU id(0) Conv 0.995918 1.666834 int8/int8

Conv_54 BPU id(0) Conv 0.996458 2.904571 int8/int8

Conv_56 BPU id(0) Conv 0.995982 2.019373 int8/int8

Conv_58 BPU id(0) Conv 0.996060 2.001907 int8/int8

Conv_59 BPU id(0) Conv 0.996887 2.904571 int8/int8

Conv_62 BPU id(0) Conv 0.997921 3.046378 int8/int8

Conv_64 BPU id(0) Conv 0.998332 2.254668 int8/int8

Conv_66 BPU id(0) Conv 0.997800 1.872522 int8/int8

Conv_69 BPU id(0) Conv 0.997995 2.930081 int8/int8

Conv_71 BPU id(0) Conv 0.997827 2.173419 int8/int8

Conv_73 BPU id(0) Conv 0.996971 1.738957 int8/int8

Conv_76 BPU id(0) Conv 0.997971 3.060249 int8/int8

Conv_78 BPU id(0) Conv 0.998362 1.828951 int8/int8

Conv_80 BPU id(0) Conv 0.997592 2.393042 int8/int8

Conv_83 BPU id(0) Conv 0.998296 3.191977 int8/int8

Conv_85 BPU id(0) Conv 0.998579 2.141722 int8/int8

Conv_87 BPU id(0) Conv 0.998035 1.934135 int8/int8

Conv_90 BPU id(0) Conv 0.998277 3.569755 int8/int8

Conv_92 BPU id(0) Conv 0.998267 2.213034 int8/int8

Conv_94 BPU id(0) Conv 0.998421 2.222372 int8/int8

Conv_97 BPU id(0) Conv 0.998087 3.887839 int8/int8

Conv_99 BPU id(0) Conv 0.997136 2.174457 int8/int8

Conv_101 BPU id(0) Conv 0.997088 3.090500 int8/int8

Conv_102 BPU id(0) Conv 0.997386 3.887839 int8/int8

Conv_105 BPU id(0) Conv 0.997776 11.282421 int8/int8

Conv_107 BPU id(0) Conv 0.998091 4.300011 int8/int8

Conv_109 BPU id(0) Conv 0.997846 4.908925 int8/int8

Conv_112 BPU id(0) Conv 0.997504 17.899069 int8/int8

Conv_114 BPU id(0) Conv 0.997939 5.838736 int8/int8

Conv_116 BPU id(0) Conv 0.998308 4.680732 int8/int8

Conv_120 BPU id(0) Conv 0.994817 26.640320 int8/int32

Transpose_129 BPU id(0) Transpose 0.994816 – int8/int32

Flatten_130 CPU – Reshape 0.994816 – float/float

Gather_135 CPU – Gather 0.994823 – float/float

Reshape_139 CPU – Reshape 0.994823 – float/float

Transpose_140 CPU – Transpose 0.994822 – float/float

ScatterND_195 CPU – ScatterND 0.994507 – float/float

Conv_119 BPU id(1) Conv 0.997985 3.887839 int8/int8

Conv_197 BPU id(1) Conv 0.995576 77.588326 int8/int8

Reshape_209 BPU id(1) Reshape 0.995576 377.841522 int8/int8

Transpose_213 BPU id(1) Transpose 0.995579 377.841522 int8/int8

Reshape_218 BPU id(1) Reshape 0.995579 377.841522 int8/int8

MatMul_221 BPU id(1) Conv 0.996142 377.841522 int8/int8

MatMul_225 BPU id(1) Conv 0.993578 896.229858 int8/int8

ReduceMean_227 BPU id(1) ReduceMean 0.987481 3009.933350 int8/int8

Sub_228 BPU id(1) Sub 0.993089 3009.933350 int8/int8

Pow_230 BPU id(1) Pow 0.967744 3011.221680 int8/int8

ReduceMean_231 BPU id(1) ReduceMean 0.984027 9067456.000000 int8/int8

Div_235_reciprocal BPU id(1) HzRsqrt 0.931651 606354.375000 int8/int8

Div_235_mul BPU id(1) Mul 0.875951 3011.221680 int8/int8

Mul_246 BPU id(1) Mul 0.847755 1.257329 int8/int8

UNIT_CONV_FOR_Add_247 BPU id(1) Conv 0.847755 1.996263 int8/int8

Add_247onnx::MatMul_779_Reshape_0 BPU id(1) Reshape 0.819597 2.449575 int8/int8

MatMul_249_reshape_input BPU id(1) Reshape 0.819597 2.449575 int8/int8

MatMul_249 BPU id(1) Conv 0.834324 2.449575 int8/int8

MatMul_253 BPU id(1) Conv 0.924487 3.173399 int8/int8

Sigmoid_255 BPU id(1) Sigmoid 0.986546 5.498970 int8/int8

Mul_257 BPU id(1) Mul 0.995419 349.683594 int8/int8

Transpose_367_reshape BPU id(1) Reshape 0.819597 2.449575 int8/int8

UNIT_CONV_FOR_Add_477 BPU id(1) Conv 0.819231 2.449575 int8/int8

MatMul_520 BPU id(1) Conv 0.997522 209.217926 int8/int8

MatMul_520_reshape_output BPU id(1) Reshape 0.997516 704.833618 int8/int8

MatMul_523 BPU id(1) Conv 0.816066 2.449575 int8/int8

MatMul_523_reshape_output BPU id(1) Reshape 0.816068 2.669880 int8/int8

Transpose_546 BPU id(1) Transpose 0.816066 2.669880 int8/int8

Transpose_549 BPU id(1) Transpose 0.997522 704.833618 int8/int8

MatMul_550 BPU id(1) MatMul 0.997634 2.290242 int8/int32

Softmax_551 CPU – Softmax 0.244621 – float/float

MatMul_552 BPU id(2) MatMul 0.712913 0.604599 int8/int8

Transpose_553 BPU id(2) Transpose 0.712913 1.997375 int8/int8

Reshape_558 BPU id(2) Reshape 0.712913 1.997375 int8/int8

Gemm_559 BPU id(2) Conv 0.725353 1.997375 int8/int8

Add_566 BPU id(2) Add 0.768571 6.838676 int8/int8

ReduceMean_567 CPU – ReduceMean 0.145967 8.085852 float/float

Sub_568 BPU id(3) Sub 0.768593 8.085852 int8/int8

Pow_570 BPU id(3) Pow 0.917498 8.080852 int8/int8

ReduceMean_571 BPU id(3) ReduceMean 0.991963 65.300163 int8/int8

Div_575_reciprocal BPU id(3) HzRsqrt 0.998096 0.695029 int8/int8

Div_575_mul BPU id(3) Mul 0.769613 8.080852 int8/int8

Mul_576 BPU id(3) Mul 0.743760 12.621420 int8/int8

Add_577 BPU id(3) Add 0.764198 7.274933 int8/int8

MatMul_579_reshape_input BPU id(3) Reshape 0.764505 8.141244 int8/int8

MatMul_579 BPU id(3) Conv 0.847403 8.141244 int8/int8

MatMul_583 BPU id(3) Conv 0.388375 2.084887 int8/int8

MatMul_583_reshape_output BPU id(3) Reshape 0.388375 11.939111 int8/int8

Add_585 BPU id(3) Add 0.659600 8.141244 int8/int8

ReduceMean_586 CPU – ReduceMean 0.617650 14.616415 float/float

Sub_587 BPU id(4) Sub 0.659315 14.616415 int8/int8

Pow_589 BPU id(4) Pow 0.636997 14.560791 int8/int8

ReduceMean_590 BPU id(4) ReduceMean 0.919215 212.016632 int8/int8

Div_594_reciprocal BPU id(4) HzRsqrt 0.955892 2.752608 int8/int8

Div_594_mul BPU id(4) Mul 0.687039 14.560791 int8/int8

Mul_595 BPU id(4) Mul 0.652657 11.523854 int8/int8

Add_596 BPU id(4) Add 0.677695 8.275185 int8/int8

ReduceMean_597 CPU – ReduceMean 0.807406 9.175642 float/float

Sub_598 BPU id(33) Sub 0.677451 9.175642 int8/int8

Pow_600 BPU id(33) Pow 0.817617 9.161063 int8/int8

ReduceMean_601 BPU id(33) ReduceMean 0.974594 83.925079 int8/int8

Div_605_reciprocal BPU id(33) HzRsqrt 0.992735 0.627634 int8/int8

Div_605_mul BPU id(33) Mul 0.694923 9.161063 int8/int8

Mul_606 BPU id(33) Mul 0.651862 12.680150 int8/int8

Add_607 BPU id(33) Add 0.656538 5.913920 int8/int8

Add_608 BPU id(4) Add 0.860301 9.175642 int8/int8

MatMul_649_reshape_input BPU id(4) Reshape 0.860301 6.167968 int8/int8

MatMul_649 BPU id(4) Conv 0.890755 6.167968 int8/int8

MatMul_649_reshape_output BPU id(4) Reshape 0.890758 11.272490 int8/int8

MatMul_652 BPU id(4) Conv 0.932600 6.167968 int8/int8

MatMul_652_reshape_output BPU id(4) Reshape 0.932593 15.130128 int8/int8

MatMul_655_reshape_input BPU id(4) Reshape 0.678002 9.175642 int8/int8

MatMul_655 BPU id(4) Conv 0.479682 9.175642 int8/int8

MatMul_655_reshape_output BPU id(4) Reshape 0.479682 2.797364 int8/int8

Transpose_678 BPU id(4) Transpose 0.479682 2.797364 int8/int8

Div_680_mul BPU id(4) Mul 0.890737 11.272490 int8/int8

Div_680_mul_onnx::MatMul_1212_Transpose BPU id(4) Transpose 0.890736 1.913926 int8/int8

Transpose_681 BPU id(4) Transpose 0.932600 15.130128 int8/int8

MatMul_682 BPU id(4) MatMul 0.953818 1.913926 int8/int32

Softmax_683 CPU – Softmax 0.543618 – float/float

MatMul_684 BPU id(5) MatMul 0.463159 0.323441 int8/int8

Transpose_685 BPU id(5) Transpose 0.463159 2.490511 int8/int8

Reshape_690 BPU id(5) Reshape 0.463159 2.490511 int8/int8

Gemm_691 BPU id(5) Conv 0.519687 2.490511 int8/int8

Add_698 BPU id(5) Add 0.614848 9.175642 int8/int8

ReduceMean_699 CPU – ReduceMean 0.316424 10.004807 float/float

Sub_700 BPU id(6) Sub 0.614884 10.004807 int8/int8

Pow_702 BPU id(6) Pow 0.771414 10.015985 int8/int8

ReduceMean_703 BPU id(6) ReduceMean 0.995028 100.319962 int8/int8

Div_707_reciprocal BPU id(6) HzRsqrt 0.998635 0.978124 int8/int8

Div_707_mul BPU id(6) Mul 0.617930 10.015985 int8/int8

Mul_708 BPU id(6) Mul 0.624142 11.683125 int8/int8

Add_709 BPU id(6) Add 0.658867 8.511517 int8/int8

Add_710 BPU id(6) Add 0.848155 9.196544 int8/int8

MatMul_751_reshape_input BPU id(6) Reshape 0.848155 7.169745 int8/int8

MatMul_751 BPU id(6) Conv 0.921657 7.169745 int8/int8

MatMul_751_reshape_output BPU id(6) Reshape 0.921657 12.831240 int8/int8

MatMul_754 BPU id(1) Conv 0.997804 209.217926 int8/int8

MatMul_754_reshape_output BPU id(1) Reshape 0.997807 492.885345 int8/int8

MatMul_757 BPU id(1) Conv 0.815500 2.449575 int8/int32

MatMul_757_reshape_output CPU – Reshape 0.815501 – float/float

Transpose_780 CPU – Transpose 0.815500 – float/float

Div_782_mul BPU id(6) Mul 0.921894 12.831240 int8/int8

Div_782_mul_onnx::MatMul_1314_Transpose BPU id(6) Transpose 0.921894 2.231273 int8/int8

Transpose_783 BPU id(1) Transpose 0.997804 492.885345 int8/int8

MatMul_784 BPU id(6) MatMul 0.969303 2.231273 int8/int32

Softmax_785 CPU – Softmax 0.163626 – float/float

MatMul_786 CPU – MatMul 0.531344 – float/float

Transpose_787 CPU – Transpose 0.531344 – float/float

Reshape_792 CPU – Reshape 0.531344 – float/float

Gemm_793 CPU – Conv 0.551261 – float/float

Gemm_793_reshape_output BPU id(7) Reshape 0.551261 1.467772 int8/int8

Add_800 BPU id(7) Add 0.634235 9.196544 int8/int8

ReduceMean_801 CPU – ReduceMean 0.129521 9.629774 float/float

Sub_802 BPU id(8) Sub 0.634238 9.629774 int8/int8

Pow_804 BPU id(8) Pow 0.685676 9.616563 int8/int8

ReduceMean_805 BPU id(8) ReduceMean 0.998534 92.478279 int8/int8

Div_809_reciprocal BPU id(8) HzRsqrt 0.999628 0.926540 int8/int8

Div_809_mul BPU id(8) Mul 0.634331 9.616563 int8/int8

Mul_810 BPU id(8) Mul 0.644053 11.238144 int8/int8

Add_811 BPU id(8) Add 0.678320 9.446274 int8/int8

MatMul_813_reshape_input BPU id(8) Reshape 0.678607 10.153898 int8/int8

MatMul_813 BPU id(8) Conv 0.870612 10.153898 int8/int32

Relu_815 CPU – Relu float/float

MatMul_817 CPU – Conv 0.543345 – float/float

MatMul_817_transpose_0 BPU id(9) Transpose 0.543344 6.051942 int8/int8

MatMul_817_reshape_output CPU – Reshape 0.543344 6.051942 float/float

Add_819 BPU id(10) Add 0.684195 10.153898 int8/int8

ReduceMean_820 CPU – ReduceMean 0.365578 13.690140 float/float

Sub_821 BPU id(11) Sub 0.684179 13.690140 int8/int8

Pow_823 BPU id(11) Pow 0.737292 13.681301 int8/int8

ReduceMean_824 BPU id(11) ReduceMean 0.961239 187.177994 int8/int8

Div_828_reciprocal BPU id(11) HzRsqrt 0.988287 1.968105 int8/int8

Div_828_mul BPU id(11) Mul 0.689020 13.681301 int8/int8

Mul_829 BPU id(11) Mul 0.712597 12.006905 int8/int8

Add_830 BPU id(11) Add 0.721360 10.763601 int8/int8

ReduceMean_831 CPU – ReduceMean 0.426657 11.369173 float/float

Sub_832 BPU id(33) Sub 0.721330 11.369173 int8/int8

Pow_834 BPU id(33) Pow 0.875347 11.355466 int8/int8

ReduceMean_835 BPU id(33) ReduceMean 0.989073 128.946609 int8/int8

Div_839_reciprocal BPU id(33) HzRsqrt 0.998176 0.785875 int8/int8

Div_839_mul BPU id(33) Mul 0.721168 11.355466 int8/int8

Mul_840 BPU id(33) Mul 0.684260 13.178996 int8/int8

Add_841 BPU id(33) Add 0.687835 6.146578 int8/int8

Add_842 BPU id(11) Add 0.888153 11.369173 int8/int8

MatMul_883_reshape_input BPU id(11) Reshape 0.888153 6.438416 int8/int8

MatMul_883 BPU id(11) Conv 0.927163 6.438416 int8/int8

MatMul_883_reshape_output BPU id(11) Reshape 0.927164 10.467304 int8/int8

MatMul_886 BPU id(11) Conv 0.964007 6.438416 int8/int8

MatMul_886_reshape_output BPU id(11) Reshape 0.964006 14.416010 int8/int8

MatMul_889_reshape_input BPU id(11) Reshape 0.721774 11.369173 int8/int8

MatMul_889 BPU id(11) Conv 0.532008 11.369173 int8/int8

MatMul_889_reshape_output BPU id(11) Reshape 0.532008 2.789529 int8/int8

Transpose_912 BPU id(11) Transpose 0.532008 2.789529 int8/int8

Div_914_mul BPU id(11) Mul 0.927055 10.467304 int8/int8

Div_914_mul_onnx::MatMul_1446_Transpose BPU id(11) Transpose 0.927057 1.775475 int8/int8

Transpose_915 BPU id(11) Transpose 0.964007 14.416010 int8/int8

MatMul_916 BPU id(11) MatMul 0.978238 1.775475 int8/int32

Softmax_917 CPU – Softmax 0.591985 – float/float

MatMul_918 BPU id(12) MatMul 0.530804 0.478704 int8/int8

Transpose_919 BPU id(12) Transpose 0.530805 2.583132 int8/int8

Reshape_924 BPU id(12) Reshape 0.530805 2.583132 int8/int8

Gemm_925 BPU id(12) Conv 0.500994 2.583132 int8/int8

Add_932 BPU id(12) Add 0.676281 11.369173 int8/int8

ReduceMean_933 BPU id(12) ReduceMean 0.818848 11.790940 int8/int8

Sub_934 BPU id(12) Sub 0.675908 11.790940 int8/int8

Pow_936 BPU id(12) Pow 0.828644 11.767942 int8/int8

ReduceMean_937 BPU id(12) ReduceMean 0.991511 138.484467 int8/int8

Div_941_reciprocal BPU id(12) HzRsqrt 0.998544 0.942558 int8/int8

Div_941_mul BPU id(12) Mul 0.676161 11.767942 int8/int8

Mul_942 BPU id(12) Mul 0.702377 12.650784 int8/int8

Add_943 BPU id(12) Add 0.729725 9.627655 int8/int8

Add_944 BPU id(12) Add 0.891357 10.077240 int8/int8

MatMul_985_reshape_input BPU id(12) Reshape 0.891357 6.148572 int8/int8

MatMul_985 BPU id(12) Conv 0.976367 6.148572 int8/int8

MatMul_985_reshape_output BPU id(12) Reshape 0.976370 13.703076 int8/int8

MatMul_988 BPU id(1) Conv 0.997901 209.217926 int8/int8

MatMul_988_reshape_output BPU id(1) Reshape 0.997890 512.987915 int8/int8

MatMul_991 BPU id(1) Conv 0.781140 2.449575 int8/int32

MatMul_991_reshape_output CPU – Reshape 0.781142 – float/float

Transpose_1014 CPU – Transpose 0.781141 – float/float

Div_1016_mul BPU id(12) Mul 0.976479 13.703076 int8/int8

Div_1016_mul_onnx::MatMul_1548_Transpose BPU id(12) Transpose 0.976479 2.363777 int8/int8

Transpose_1017 BPU id(1) Transpose 0.997901 512.987915 int8/int8

MatMul_1018 BPU id(12) MatMul 0.993386 2.363777 int8/int32

Softmax_1019 CPU – Softmax 0.176559 – float/float

MatMul_1020 CPU – MatMul 0.504377 – float/float

Transpose_1021 CPU – Transpose 0.504376 1.184936 float/float

Reshape_1026 CPU – Reshape 0.504376 1.184936 float/float

Gemm_1027 BPU id(13) Conv 0.498965 1.184936 int8/int8

Add_1034 BPU id(13) Add 0.684240 10.077240 int8/int8

ReduceMean_1035 CPU – ReduceMean -0.335839 10.343003 float/float

Sub_1036 BPU id(14) Sub 0.684284 10.343003 int8/int8

Pow_1038 BPU id(14) Pow 0.819476 10.342925 int8/int8

ReduceMean_1039 BPU id(14) ReduceMean 0.997604 106.976097 int8/int8

Div_1043_reciprocal BPU id(14) HzRsqrt 0.999356 0.784818 int8/int8

Div_1043_mul BPU id(14) Mul 0.684633 10.342925 int8/int8

Mul_1044 BPU id(14) Mul 0.702749 12.371898 int8/int8

Add_1045 BPU id(14) Add 0.727261 10.034276 int8/int8

MatMul_1047_reshape_input BPU id(14) Reshape 0.727452 10.484550 int8/int8

MatMul_1047 BPU id(14) Conv 0.936086 10.484550 int8/int8

MatMul_1051 BPU id(14) Conv 0.287487 1.854988 int8/int8

MatMul_1051_reshape_output BPU id(14) Reshape 0.287487 3.944753 int8/int8

Add_1053 BPU id(14) Add 0.692237 10.484550 int8/int8

ReduceMean_1054 CPU – ReduceMean 0.254279 13.060668 float/float

Sub_1055 BPU id(15) Sub 0.692221 13.060668 int8/int8

Pow_1057 BPU id(15) Pow 0.819986 13.050056 int8/int8

ReduceMean_1058 BPU id(15) ReduceMean 0.964321 170.303955 int8/int8

Div_1062_reciprocal BPU id(15) HzRsqrt 0.994376 1.322705 int8/int8

Div_1062_mul BPU id(15) Mul 0.700395 13.050056 int8/int8

Mul_1063 BPU id(15) Mul 0.719533 12.781201 int8/int8

Add_1064 BPU id(15) Add 0.719471 9.821319 int8/int8

ReduceMean_1065 CPU – ReduceMean 0.616087 10.109152 float/float

Sub_1066 BPU id(33) Sub 0.719366 10.109152 int8/int8

Pow_1068 BPU id(33) Pow 0.881109 10.099996 int8/int8

ReduceMean_1069 BPU id(33) ReduceMean 0.997391 102.009911 int8/int8

Div_1073_reciprocal BPU id(33) HzRsqrt 0.999558 0.630825 int8/int8

Div_1073_mul BPU id(33) Mul 0.718313 10.099996 int8/int8

Mul_1074 BPU id(33) Mul 0.679996 13.097954 int8/int8

Add_1075 BPU id(33) Add 0.683907 6.108780 int8/int8

Add_1076 BPU id(15) Add 0.892936 10.109152 int8/int8

MatMul_1117_reshape_input BPU id(15) Reshape 0.892936 6.123517 int8/int8

MatMul_1117 BPU id(15) Conv 0.938177 6.123517 int8/int8

MatMul_1117_reshape_output BPU id(15) Reshape 0.938179 12.125121 int8/int8

MatMul_1120 BPU id(15) Conv 0.972651 6.123517 int8/int8

MatMul_1120_reshape_output BPU id(15) Reshape 0.972649 16.880409 int8/int8

MatMul_1123_reshape_input BPU id(15) Reshape 0.719731 10.109152 int8/int8

MatMul_1123 BPU id(15) Conv 0.478522 10.109152 int8/int8

MatMul_1123_reshape_output BPU id(15) Reshape 0.478521 2.580981 int8/int8

Transpose_1146 BPU id(15) Transpose 0.478521 2.580981 int8/int8

Div_1148_mul BPU id(15) Mul 0.938503 12.125121 int8/int8

Div_1148_mul_onnx::MatMul_1680_Transpose BPU id(15) Transpose 0.938504 2.112085 int8/int8

Transpose_1149 BPU id(15) Transpose 0.972651 16.880409 int8/int8

MatMul_1150 BPU id(15) MatMul 0.987841 2.112085 int8/int32

Softmax_1151 CPU – Softmax 0.643105 – float/float

MatMul_1152 BPU id(16) MatMul 0.427479 0.414806 int8/int8

Transpose_1153 BPU id(16) Transpose 0.427479 2.544678 int8/int8

Reshape_1158 BPU id(16) Reshape 0.427479 2.544678 int8/int8

Gemm_1159 BPU id(16) Conv 0.462399 2.544678 int8/int8

Add_1166 BPU id(16) Add 0.690015 10.109152 int8/int8

ReduceMean_1167 BPU id(16) ReduceMean 0.809905 10.252619 int8/int8

Sub_1168 BPU id(16) Sub 0.689699 10.252619 int8/int8

Pow_1170 BPU id(16) Pow 0.840263 10.240211 int8/int8

ReduceMean_1171 BPU id(16) ReduceMean 0.993645 104.861931 int8/int8

Div_1175_reciprocal BPU id(16) HzRsqrt 0.998765 0.771877 int8/int8

Div_1175_mul BPU id(16) Mul 0.690571 10.240211 int8/int8

Mul_1176 BPU id(16) Mul 0.702943 12.721540 int8/int8

Add_1177 BPU id(16) Add 0.721749 9.500463 int8/int8

Add_1178 BPU id(16) Add 0.883799 9.762945 int8/int8

MatMul_1219_reshape_input BPU id(16) Reshape 0.883799 6.116485 int8/int8

MatMul_1219 BPU id(16) Conv 0.981019 6.116485 int8/int8

MatMul_1219_reshape_output BPU id(16) Reshape 0.981020 15.699268 int8/int8

MatMul_1222 BPU id(1) Conv 0.997831 209.217926 int8/int8

MatMul_1222_reshape_output BPU id(1) Reshape 0.997824 637.153381 int8/int8

MatMul_1225 BPU id(1) Conv 0.813354 2.449575 int8/int32

MatMul_1225_reshape_output CPU – Reshape 0.813354 – float/float

Transpose_1248 CPU – Transpose 0.813354 – float/float

Div_1250_mul BPU id(16) Mul 0.981100 15.699268 int8/int8

Div_1250_mul_onnx::MatMul_1782_Transpose BPU id(16) Transpose 0.981098 2.736587 int8/int8

Transpose_1251 BPU id(1) Transpose 0.997831 637.153381 int8/int8

MatMul_1252 BPU id(16) MatMul 0.993747 2.736587 int8/int32

Softmax_1253 CPU – Softmax 0.161898 – float/float

MatMul_1254 CPU – MatMul 0.622311 – float/float

Transpose_1255 CPU – Transpose 0.622311 – float/float

Reshape_1260 CPU – Reshape 0.622311 – float/float

Gemm_1261 CPU – Conv 0.610956 – float/float

Gemm_1261_reshape_output BPU id(17) Reshape 0.610956 1.032369 int8/int8

Add_1268 BPU id(17) Add 0.685516 9.762945 int8/int8

ReduceMean_1269 BPU id(17) ReduceMean 0.796325 9.841258 int8/int8

Sub_1270 BPU id(17) Sub 0.685365 9.841258 int8/int8

Pow_1272 BPU id(17) Pow 0.810691 9.836107 int8/int8

ReduceMean_1273 BPU id(17) ReduceMean 0.998282 96.749008 int8/int8

Div_1277_reciprocal BPU id(17) HzRsqrt 0.999511 0.782849 int8/int8

Div_1277_mul BPU id(17) Mul 0.686300 9.836107 int8/int8

Mul_1278 BPU id(17) Mul 0.691735 12.106347 int8/int8

Add_1279 BPU id(17) Add 0.707567 8.532913 int8/int8

MatMul_1281_reshape_input BPU id(17) Reshape 0.707896 8.765702 int8/int8

MatMul_1281 BPU id(17) Conv 0.939047 8.765702 int8/int32

Relu_1283 CPU – Relu float/float

MatMul_1285 CPU – Conv 0.383016 – float/float

MatMul_1285_transpose_0 BPU id(18) Transpose 0.383017 1.666418 int8/int8

MatMul_1285_reshape_output CPU – Reshape 0.383017 1.666418 float/float

Add_1287 BPU id(19) Add 0.705236 8.765702 int8/int8

ReduceMean_1288 CPU – ReduceMean 0.132304 8.663477 float/float

Sub_1289 BPU id(20) Sub 0.705235 8.663477 int8/int8

Pow_1291 BPU id(20) Pow 0.816375 8.664617 int8/int8

ReduceMean_1292 BPU id(20) ReduceMean 0.980967 75.075577 int8/int8

Div_1296_reciprocal BPU id(20) HzRsqrt 0.995851 1.063203 int8/int8

Div_1296_mul BPU id(20) Mul 0.709648 8.664617 int8/int8

Mul_1297 BPU id(20) Mul 0.738908 11.815351 int8/int8

Add_1298 BPU id(20) Add 0.739016 11.493877 int8/int8

ReduceMean_1299 BPU id(20) ReduceMean 0.800920 11.853214 int8/int8

Sub_1300 BPU id(20) Sub 0.738860 11.853214 int8/int8

Pow_1302 BPU id(20) Pow 0.868551 11.840851 int8/int8

ReduceMean_1303 BPU id(20) ReduceMean 0.998060 140.205750 int8/int8

Div_1307_reciprocal BPU id(20) HzRsqrt 0.999640 0.860362 int8/int8

Div_1307_mul BPU id(20) Mul 0.736332 11.840851 int8/int8

Mul_1308 BPU id(20) Mul 0.700040 12.967838 int8/int8

Add_1309 BPU id(20) Add 0.704550 6.048095 int8/int8

Add_1310 BPU id(20) Add 0.882932 11.853214 int8/int8

MatMul_1351_reshape_input BPU id(20) Reshape 0.882932 6.874304 int8/int8

MatMul_1351 BPU id(20) Conv 0.886181 6.874304 int8/int8

MatMul_1351_reshape_output BPU id(20) Reshape 0.886181 8.550491 int8/int8

MatMul_1354 BPU id(20) Conv 0.930765 6.874304 int8/int8

MatMul_1354_reshape_output BPU id(20) Reshape 0.930764 13.020204 int8/int8

MatMul_1357_reshape_input BPU id(20) Reshape 0.740153 11.853214 int8/int8

MatMul_1357 BPU id(20) Conv 0.514575 11.853214 int8/int8

MatMul_1357_reshape_output BPU id(20) Reshape 0.514575 2.157943 int8/int8

Transpose_1380 BPU id(20) Transpose 0.514574 2.157943 int8/int8

Div_1382_mul BPU id(20) Mul 0.886102 8.550491 int8/int8

Div_1382_mul_onnx::MatMul_1914_Transpose BPU id(20) Transpose 0.886101 1.461266 int8/int8

Transpose_1383 BPU id(20) Transpose 0.930765 13.020204 int8/int8

MatMul_1384 BPU id(20) MatMul 0.939726 1.461266 int8/int32

Softmax_1385 CPU – Softmax 0.562928 – float/float

MatMul_1386 BPU id(21) MatMul 0.446692 0.922536 int8/int8

Transpose_1387 BPU id(21) Transpose 0.446692 1.474946 int8/int8

Reshape_1392 BPU id(21) Reshape 0.446692 1.474946 int8/int8

Gemm_1393 BPU id(21) Conv 0.477562 1.474946 int8/int8

Add_1400 BPU id(21) Add 0.737372 11.853214 int8/int8

ReduceMean_1401 CPU – ReduceMean 0.792870 11.699005 float/float

Sub_1402 BPU id(22) Sub 0.737100 11.699005 int8/int8

Pow_1404 BPU id(22) Pow 0.859584 11.686236 int8/int8

ReduceMean_1405 BPU id(22) ReduceMean 0.997571 136.568115 int8/int8

Div_1409_reciprocal BPU id(22) HzRsqrt 0.999547 0.884774 int8/int8

Div_1409_mul BPU id(22) Mul 0.735612 11.686236 int8/int8

Mul_1410 BPU id(22) Mul 0.736489 12.865999 int8/int8

Add_1411 BPU id(22) Add 0.748616 9.612616 int8/int8

Add_1412 BPU id(22) Add 0.888486 9.781368 int8/int8

MatMul_1453_reshape_input BPU id(22) Reshape 0.888486 5.994973 int8/int8

MatMul_1453 BPU id(22) Conv 0.979146 5.994973 int8/int8

MatMul_1453_reshape_output BPU id(22) Reshape 0.979147 18.111277 int8/int8

MatMul_1456 BPU id(1) Conv 0.997809 209.217926 int8/int8

MatMul_1456_reshape_output BPU id(1) Reshape 0.997833 653.314941 int8/int8

MatMul_1459 BPU id(1) Conv 0.822336 2.449575 int8/int8

MatMul_1459_reshape_output BPU id(1) Reshape 0.822337 1.310285 int8/int8

Transpose_1482 BPU id(1) Transpose 0.822337 1.310285 int8/int8

Div_1484_mul BPU id(22) Mul 0.979161 18.111277 int8/int8

Div_1484_mul_onnx::MatMul_2016_Transpose BPU id(22) Transpose 0.979161 3.092891 int8/int8

Transpose_1485 BPU id(1) Transpose 0.997809 653.314941 int8/int8

MatMul_1486 BPU id(22) MatMul 0.994069 3.092891 int8/int32

Softmax_1487 CPU – Softmax 0.116262 – float/float

MatMul_1488 BPU id(23) MatMul 0.584810 0.887974 int8/int8

Transpose_1489 BPU id(23) Transpose 0.584809 0.923911 int8/int8

Reshape_1494 BPU id(23) Reshape 0.584809 0.923911 int8/int8

Gemm_1495 BPU id(23) Conv 0.590427 0.923911 int8/int8

Add_1502 BPU id(23) Add 0.735515 9.781368 int8/int8

ReduceMean_1503 BPU id(23) ReduceMean 0.658434 9.745282 int8/int8

Sub_1504 BPU id(23) Sub 0.735442 9.745282 int8/int8

Pow_1506 BPU id(23) Pow 0.839379 9.742207 int8/int8

ReduceMean_1507 BPU id(23) ReduceMean 0.999450 94.910591 int8/int8

Div_1511_reciprocal BPU id(23) HzRsqrt 0.999851 0.753509 int8/int8

Div_1511_mul BPU id(23) Mul 0.735413 9.742207 int8/int8

Mul_1512 BPU id(23) Mul 0.740254 12.466434 int8/int8

Add_1513 BPU id(23) Add 0.750952 9.216607 int8/int8

MatMul_1515_reshape_input BPU id(23) Reshape 0.751753 9.372499 int8/int8

MatMul_1515 BPU id(23) Conv 0.954351 9.372499 int8/int32

Relu_1517 CPU – Relu float/float

MatMul_1519 CPU – Conv 0.376146 – float/float

MatMul_1519_transpose_0 BPU id(24) Transpose 0.376146 1.381660 int8/int8

MatMul_1519_reshape_output CPU – Reshape 0.376146 1.381660 float/float

Add_1521 BPU id(25) Add 0.744587 9.372499 int8/int8

ReduceMean_1522 CPU – ReduceMean -0.035936 9.472244 float/float

Sub_1523 BPU id(26) Sub 0.744604 9.472244 int8/int8

Pow_1525 BPU id(26) Pow 0.839880 9.466434 int8/int8

ReduceMean_1526 BPU id(26) ReduceMean 0.994167 89.613365 int8/int8

Div_1530_reciprocal BPU id(26) HzRsqrt 0.998654 0.822205 int8/int8

Div_1530_mul BPU id(26) Mul 0.745080 9.466434 int8/int8

Mul_1531 BPU id(26) Mul 0.760488 12.208372 int8/int8

Add_1532 BPU id(26) Add 0.753843 10.457104 int8/int8

ReduceMean_1533 BPU id(26) ReduceMean 0.808126 10.630326 int8/int8

Sub_1534 BPU id(26) Sub 0.753694 10.630326 int8/int8

Pow_1536 BPU id(26) Pow 0.863113 10.620488 int8/int8

ReduceMean_1537 BPU id(26) ReduceMean 0.998762 112.794769 int8/int8

Div_1541_reciprocal BPU id(26) HzRsqrt 0.999782 0.687772 int8/int8

Div_1541_mul BPU id(26) Mul 0.752031 10.620488 int8/int8

Mul_1542 BPU id(26) Mul 0.719014 12.933210 int8/int8

Add_1543 BPU id(26) Add 0.722673 6.031945 int8/int8

Add_1544 BPU id(26) Add 0.898651 10.630326 int8/int8

MatMul_1585_reshape_input BPU id(26) Reshape 0.898651 6.042082 int8/int8

MatMul_1585 BPU id(26) Conv 0.900717 6.042082 int8/int8

MatMul_1585_reshape_output BPU id(26) Reshape 0.900718 11.125583 int8/int8

MatMul_1588 BPU id(26) Conv 0.948696 6.042082 int8/int8

MatMul_1588_reshape_output BPU id(26) Reshape 0.948690 15.456502 int8/int8

MatMul_1591_reshape_input BPU id(26) Reshape 0.754409 10.630326 int8/int8

MatMul_1591 BPU id(26) Conv 0.530603 10.630326 int8/int32

MatMul_1591_reshape_output CPU – Reshape 0.530603 – float/float

Transpose_1614 CPU – Transpose 0.530603 – float/float

Div_1616_mul BPU id(26) Mul 0.900783 11.125583 int8/int8

Div_1616_mul_onnx::MatMul_2148_Transpose BPU id(26) Transpose 0.900784 1.925057 int8/int8

Transpose_1617 BPU id(26) Transpose 0.948696 15.456502 int8/int8

MatMul_1618 BPU id(26) MatMul 0.968578 1.925057 int8/int32

Softmax_1619 CPU – Softmax 0.586952 – float/float

MatMul_1620 CPU – MatMul 0.527663 – float/float

Transpose_1621 CPU – Transpose 0.527663 – float/float

Reshape_1626 CPU – Reshape 0.527663 – float/float

Gemm_1627 CPU – Conv 0.513492 – float/float

Gemm_1627_reshape_output BPU id(27) Reshape 0.513492 0.548258 int8/int8

Add_1634 BPU id(27) Add 0.754138 10.630326 int8/int8

ReduceMean_1635 BPU id(27) ReduceMean 0.847946 10.551713 int8/int8

Sub_1636 BPU id(27) Sub 0.753898 10.551713 int8/int8

Pow_1638 BPU id(27) Pow 0.864731 10.539601 int8/int8

ReduceMean_1639 BPU id(27) ReduceMean 0.998769 111.083199 int8/int8

Div_1643_reciprocal BPU id(27) HzRsqrt 0.999782 0.692768 int8/int8

Div_1643_mul BPU id(27) Mul 0.752421 10.539601 int8/int8

Mul_1644 BPU id(27) Mul 0.746846 12.803594 int8/int8

Add_1645 BPU id(27) Add 0.756194 9.908237 int8/int8

Add_1646 BPU id(27) Add 0.881979 10.041206 int8/int8

MatMul_1687_reshape_input BPU id(27) Reshape 0.881979 6.191454 int8/int8

MatMul_1687 BPU id(27) Conv 0.978037 6.191454 int8/int8

MatMul_1687_reshape_output BPU id(27) Reshape 0.978032 19.097679 int8/int8

MatMul_1690 BPU id(1) Conv 0.997842 209.217926 int8/int8

MatMul_1690_reshape_output BPU id(1) Reshape 0.997847 639.415649 int8/int8

MatMul_1693 BPU id(1) Conv 0.809372 2.449575 int8/int32

MatMul_1693_reshape_output CPU – Reshape 0.809372 – float/float

Transpose_1716 CPU – Transpose 0.809372 – float/float

Div_1718_mul BPU id(27) Mul 0.978026 19.097679 int8/int8

Div_1718_mul_onnx::MatMul_2250_Transpose BPU id(27) Transpose 0.978027 3.332790 int8/int8

Transpose_1719 BPU id(1) Transpose 0.997842 639.415649 int8/int8

MatMul_1720 BPU id(27) MatMul 0.992169 3.332790 int8/int32

Softmax_1721 CPU – Softmax 0.153752 – float/float

MatMul_1722 CPU – MatMul 0.606204 – float/float

Transpose_1723 CPU – Transpose 0.606203 – float/float

Reshape_1728 CPU – Reshape 0.606203 – float/float

Gemm_1729 CPU – Conv 0.647168 – float/float

Gemm_1729_reshape_output BPU id(28) Reshape 0.647168 0.394229 int8/int8

Add_1736 BPU id(28) Add 0.757011 10.041206 int8/int8

ReduceMean_1737 CPU – ReduceMean -0.782414 10.010317 float/float

Sub_1738 BPU id(29) Sub 0.757168 10.010317 int8/int8

Pow_1740 BPU id(29) Pow 0.848443 10.013098 int8/int8

ReduceMean_1741 BPU id(29) ReduceMean 0.999495 100.262123 int8/int8

Div_1745_reciprocal BPU id(29) HzRsqrt 0.999881 0.794541 int8/int8

Div_1745_mul BPU id(29) Mul 0.757718 10.013098 int8/int8

Mul_1746 BPU id(29) Mul 0.771035 12.308630 int8/int8

Add_1747 BPU id(29) Add 0.782263 9.768904 int8/int8

MatMul_1749_reshape_input BPU id(29) Reshape 0.783318 9.907617 int8/int8

MatMul_1749 BPU id(29) Conv 0.969936 9.907617 int8/int32

Relu_1751 CPU – Relu float/float

MatMul_1753 CPU – Conv 0.422219 – float/float

MatMul_1753_transpose_0 BPU id(30) Transpose 0.422218 0.845307 int8/int8

MatMul_1753_reshape_output CPU – Reshape 0.422218 0.845307 float/float

Add_1755 BPU id(31) Add 0.778423 9.907617 int8/int8

ReduceMean_1756 CPU – ReduceMean -0.598610 9.860429 float/float

Sub_1757 BPU id(32) Sub 0.778509 9.860429 int8/int8

Pow_1759 BPU id(32) Pow 0.860508 9.861353 int8/int8

ReduceMean_1760 BPU id(32) ReduceMean 0.998319 97.246284 int8/int8

Div_1764_reciprocal BPU id(32) HzRsqrt 0.999678 0.772026 int8/int8

Div_1764_mul BPU id(32) Mul 0.779246 9.861353 int8/int8

Mul_1765 BPU id(32) Mul 0.783886 12.274683 int8/int8

Add_1766 BPU id(32) Add 0.775342 9.901650 int8/int8

ReduceMean_1767 CPU – ReduceMean 0.416371 9.982325 float/float

Sub_1768 BPU id(33) Sub 0.775315 9.982325 int8/int8

Pow_1770 BPU id(33) Pow 0.873668 9.977983 int8/int8

ReduceMean_1771 BPU id(33) ReduceMean 0.999261 99.560158 int8/int8

Div_1775_reciprocal BPU id(33) HzRsqrt 0.999890 0.605528 int8/int8

Div_1775_mul BPU id(33) Mul 0.774770 9.977983 int8/int8

Mul_1776 BPU id(33) Mul 0.742702 12.904049 int8/int8

Add_1777 BPU id(33) Add 0.746275 6.018344 int8/int8

Unsqueeze_1778 BPU id(33) Reshape 0.656538 5.825645 int8/int8

Unsqueeze_1779 BPU id(33) Reshape 0.687835 5.825645 int8/int8

Unsqueeze_1780 BPU id(33) Reshape 0.683907 5.825645 int8/int8

Unsqueeze_1781 BPU id(20) Reshape 0.704550 5.825645 int8/int8

Unsqueeze_1782 BPU id(26) Reshape 0.722673 5.825645 int8/int8

Unsqueeze_1783 BPU id(33) Reshape 0.746275 5.825645 int8/int8

Concat_1784 BPU id(33) Concat 0.699202 5.825645 int8/int8

Gather_1811 BPU id(33) Gather 0.656538 5.825645 int8/int8

MatMul_1813 BPU id(33) Conv 0.639435 5.825645 int8/int8

ReduceMean_1815 BPU id(33) ReduceMean 0.846830 3.571495 int8/int8

Sub_1816 BPU id(33) Sub 0.637007 3.571495 int8/int8

Pow_1818 BPU id(33) Pow 0.566670 3.646500 int8/int8

ReduceMean_1819 BPU id(33) ReduceMean 0.960904 13.296963 int8/int8

Div_1823_reciprocal BPU id(33) HzRsqrt 0.990025 1.085072 int8/int8

Div_1823_mul BPU id(33) Mul 0.650589 3.646500 int8/int8

Mul_1824 BPU id(33) Conv 0.694692 4.246462 int8/int8

MatMul_1828 BPU id(33) Conv 0.844849 3.264831 int8/int8

ReduceMean_1830 BPU id(33) ReduceMean 0.923044 4.312796 int8/int8

Sub_1831 BPU id(33) Sub 0.844406 4.312796 int8/int8

Pow_1833 BPU id(33) Pow 0.802769 4.243617 int8/int8

ReduceMean_1834 BPU id(33) ReduceMean 0.981276 18.008286 int8/int8

Div_1838_reciprocal BPU id(33) HzRsqrt 0.995351 1.183524 int8/int8

Div_1838_mul BPU id(33) Mul 0.847999 4.243617 int8/int8

Mul_1839 BPU id(33) Conv 0.868404 4.634079 int8/int8

MatMul_1843 BPU id(33) Conv 0.989613 2.713654 int8/int32

Gather_1846 BPU id(33) Gather 0.656538 5.825645 int8/int8

MatMul_1848 BPU id(33) Conv 0.814649 5.825645 int8/int32

Relu_1850 CPU – Relu float/float

MatMul_1852 CPU – Conv 0.844940 – float/float

Relu_1854 CPU – Relu float/float

MatMul_1856 BPU id(34) Conv 0.823685 2.179076 int8/int8

Slice_1862 BPU id(34) Slice 0.867028 8.394401 int8/int8

UNIT_CONV_FOR_Add_1868 BPU id(34) Conv 0.867028 8.394401 int8/int8

Sigmoid_1869 BPU id(34) Sigmoid 0.988609 5.498970 int8/int8

Slice_1874 CPU – Slice 0.809307 8.394401 float/float

Slice_1874onnx::Concat_2406_Reshape_0 CPU – Reshape 0.809307 8.394401 float/float

Concat_1875 CPU – Concat 0.806529 0.995926 float/float

Gather_1901 BPU id(33) Gather 0.687835 5.825645 int8/int8

MatMul_1903 BPU id(33) Conv 0.692817 5.825645 int8/int8

ReduceMean_1905 BPU id(33) ReduceMean 0.955956 3.158982 int8/int8

Sub_1906 BPU id(33) Sub 0.682560 3.158982 int8/int8

Pow_1908 BPU id(33) Pow 0.631121 3.238024 int8/int8

ReduceMean_1909 BPU id(33) ReduceMean 0.987927 10.484797 int8/int8

Div_1913_reciprocal BPU id(33) HzRsqrt 0.996670 1.077928 int8/int8

Div_1913_mul BPU id(33) Mul 0.676853 3.238024 int8/int8

Mul_1914 BPU id(33) Conv 0.723836 3.955397 int8/int8

MatMul_1918 BPU id(33) Conv 0.850042 3.022326 int8/int8

ReduceMean_1920 BPU id(33) ReduceMean 0.908934 4.494515 int8/int8

Sub_1921 BPU id(33) Sub 0.849483 4.494515 int8/int8

Pow_1923 BPU id(33) Pow 0.832684 4.382494 int8/int8

ReduceMean_1924 BPU id(33) ReduceMean 0.990258 19.206253 int8/int8

Div_1928_reciprocal BPU id(33) HzRsqrt 0.997283 1.309663 int8/int8

Div_1928_mul BPU id(33) Mul 0.845896 4.382494 int8/int8

Mul_1929 BPU id(33) Conv 0.874344 4.632936 int8/int8

MatMul_1933 BPU id(33) Conv 0.989029 2.673060 int8/int32

Gather_1936 BPU id(33) Gather 0.687835 5.825645 int8/int8

MatMul_1938 BPU id(33) Conv 0.901662 5.825645 int8/int8

MatMul_1942 BPU id(33) Conv 0.770465 2.936551 int8/int32

Relu_1944 CPU – Relu float/float

MatMul_1946 CPU – Conv 0.838807 – float/float

MatMul_1946_transpose_0 BPU id(35) Transpose 0.838806 7.764243 int8/int8

Slice_1952 BPU id(35) Slice 0.892942 7.764243 int8/int8

UNIT_CONV_FOR_Add_1958 BPU id(35) Conv 0.892942 7.764243 int8/int8

Sigmoid_1959 BPU id(35) Sigmoid 0.990152 5.498970 int8/int8

Slice_1964 CPU – Slice 0.819556 7.764243 float/float

Slice_1964onnx::Concat_2496_Reshape_0 CPU – Reshape 0.819556 7.764243 float/float

Concat_1965 CPU – Concat 0.796196 0.995926 float/float

Gather_1991 BPU id(33) Gather 0.683907 5.825645 int8/int8

MatMul_1993 BPU id(33) Conv 0.709530 5.825645 int8/int8

ReduceMean_1995 BPU id(33) ReduceMean 0.971104 3.454377 int8/int8

Sub_1996 BPU id(33) Sub 0.699811 3.454377 int8/int8

Pow_1998 BPU id(33) Pow 0.660411 3.447735 int8/int8

ReduceMean_1999 BPU id(33) ReduceMean 0.988012 11.886875 int8/int8

Div_2003_reciprocal BPU id(33) HzRsqrt 0.996951 1.167118 int8/int8

Div_2003_mul BPU id(33) Mul 0.697240 3.447735 int8/int8

Mul_2004 BPU id(33) Conv 0.744308 4.008721 int8/int8

MatMul_2008 BPU id(33) Conv 0.853522 2.823528 int8/int8

ReduceMean_2010 BPU id(33) ReduceMean 0.940747 4.776608 int8/int8

Sub_2011 BPU id(33) Sub 0.852584 4.776608 int8/int8

Pow_2013 BPU id(33) Pow 0.826841 4.660595 int8/int8

ReduceMean_2014 BPU id(33) ReduceMean 0.988109 21.721146 int8/int8

Div_2018_reciprocal BPU id(33) HzRsqrt 0.996520 1.314034 int8/int8

Div_2018_mul BPU id(33) Mul 0.852560 4.660595 int8/int8

Mul_2019 BPU id(33) Conv 0.882306 4.710001 int8/int8

MatMul_2023 BPU id(33) Conv 0.988322 2.694540 int8/int32

Gather_2026 BPU id(33) Gather 0.683907 5.825645 int8/int8

MatMul_2028 BPU id(33) Conv 0.844901 5.825645 int8/int8

MatMul_2032 BPU id(33) Conv 0.797055 3.197071 int8/int8

MatMul_2036 BPU id(33) Conv 0.803688 2.383161 int8/int8

Slice_2042 BPU id(33) Slice 0.917753 4.647340 int8/int8

UNIT_CONV_FOR_Add_2048 BPU id(33) Conv 0.917753 4.647340 int8/int8

Sigmoid_2049 BPU id(33) Sigmoid 0.992856 5.498970 int8/int8

Slice_2054 CPU – Slice 0.755865 4.647340 float/float

Slice_2054onnx::Concat_2586_Reshape_0 CPU – Reshape 0.755865 4.647340 float/float

Concat_2055 CPU – Concat 0.747223 0.995926 float/float

Gather_2081 BPU id(33) Gather 0.704550 5.825645 int8/int8

MatMul_2083 BPU id(33) Conv 0.740606 5.825645 int8/int8

ReduceMean_2085 BPU id(33) ReduceMean 0.966016 3.602196 int8/int8

Sub_2086 BPU id(33) Sub 0.730144 3.602196 int8/int8

Pow_2088 BPU id(33) Pow 0.672085 3.504535 int8/int8

ReduceMean_2089 BPU id(33) ReduceMean 0.982065 12.281764 int8/int8

Div_2093_reciprocal BPU id(33) HzRsqrt 0.994623 1.269747 int8/int8

Div_2093_mul BPU id(33) Mul 0.729790 3.504535 int8/int8

Mul_2094 BPU id(33) Conv 0.773739 4.058559 int8/int8

MatMul_2098 BPU id(33) Conv 0.872259 2.779575 int8/int8

ReduceMean_2100 BPU id(33) ReduceMean 0.964388 4.793671 int8/int8

Sub_2101 BPU id(33) Sub 0.871052 4.793671 int8/int8

Pow_2103 BPU id(33) Pow 0.839142 4.679130 int8/int8

ReduceMean_2104 BPU id(33) ReduceMean 0.984938 21.894258 int8/int8

Div_2108_reciprocal BPU id(33) HzRsqrt 0.994343 1.336018 int8/int8

Div_2108_mul BPU id(33) Mul 0.871951 4.679130 int8/int8

Mul_2109 BPU id(33) Conv 0.897781 4.669953 int8/int8

MatMul_2113 BPU id(33) Conv 0.990370 2.692161 int8/int32

Gather_2116 BPU id(33) Gather 0.704550 5.825645 int8/int8

MatMul_2118 BPU id(33) Conv 0.865143 5.825645 int8/int8

MatMul_2122 BPU id(33) Conv 0.848673 3.237696 int8/int8

MatMul_2126 BPU id(33) Conv 0.829482 2.407668 int8/int8

Slice_2132 BPU id(33) Slice 0.909046 2.635547 int8/int8

UNIT_CONV_FOR_Add_2138 BPU id(33) Conv 0.909084 2.635547 int8/int8

Sigmoid_2139 BPU id(33) Sigmoid 0.992887 5.498970 int8/int8

Slice_2144 BPU id(33) Slice 0.794935 2.635547 int8/int8

onnx::Concat_2671_calibrated_Requantize BPU id(33) HzRequantize int8/int8

onnx::Concat_2676_calibrated_Requantize BPU id(33) HzRequantize int8/int8

Concat_2145 BPU id(33) Concat 0.776388 0.995926 int8/int8

Gather_2171 BPU id(33) Gather 0.722673 5.825645 int8/int8

MatMul_2173 BPU id(33) Conv 0.748231 5.825645 int8/int8

ReduceMean_2175 BPU id(33) ReduceMean 0.964228 3.698142 int8/int8

Sub_2176 BPU id(33) Sub 0.738083 3.698142 int8/int8

Pow_2178 BPU id(33) Pow 0.680843 3.578132 int8/int8

ReduceMean_2179 BPU id(33) ReduceMean 0.981065 12.803026 int8/int8

Div_2183_reciprocal BPU id(33) HzRsqrt 0.994450 1.331040 int8/int8

Div_2183_mul BPU id(33) Mul 0.737082 3.578132 int8/int8

Mul_2184 BPU id(33) Conv 0.776733 4.156536 int8/int8

MatMul_2188 BPU id(33) Conv 0.872126 2.853239 int8/int8

ReduceMean_2190 BPU id(33) ReduceMean 0.967214 4.646420 int8/int8

Sub_2191 BPU id(33) Sub 0.870790 4.646420 int8/int8

Pow_2193 BPU id(33) Pow 0.840063 4.539297 int8/int8

ReduceMean_2194 BPU id(33) ReduceMean 0.986418 20.605219 int8/int8

Div_2198_reciprocal BPU id(33) HzRsqrt 0.995461 1.320676 int8/int8

Div_2198_mul BPU id(33) Mul 0.870624 4.539297 int8/int8

Mul_2199 BPU id(33) Conv 0.896154 4.639453 int8/int8

MatMul_2203 BPU id(33) Conv 0.989878 2.672813 int8/int32

Gather_2206 BPU id(33) Gather 0.722673 5.825645 int8/int8

MatMul_2208 BPU id(33) Conv 0.879301 5.825645 int8/int8

MatMul_2212 BPU id(33) Conv 0.848472 3.312447 int8/int8

MatMul_2216 BPU id(33) Conv 0.838590 2.480574 int8/int8

Slice_2222 BPU id(33) Slice 0.924258 2.516155 int8/int8

UNIT_CONV_FOR_Add_2228 BPU id(33) Conv 0.924308 2.516155 int8/int8

Sigmoid_2229 BPU id(33) Sigmoid 0.994121 5.498970 int8/int8

Slice_2234 BPU id(33) Slice 0.801392 2.516155 int8/int8

onnx::Concat_2761_calibrated_Requantize BPU id(33) HzRequantize int8/int8

onnx::Concat_2766_calibrated_Requantize BPU id(33) HzRequantize int8/int8

Concat_2235 BPU id(33) Concat 0.781003 0.995926 int8/int8

Gather_2261 BPU id(33) Gather 0.746275 5.825645 int8/int8

MatMul_2263 BPU id(33) Conv 0.766493 5.825645 int8/int8

ReduceMean_2265 BPU id(33) ReduceMean 0.961718 3.611552 int8/int8

Sub_2266 BPU id(33) Sub 0.757102 3.611552 int8/int8

Pow_2268 BPU id(33) Pow 0.699740 3.530492 int8/int8

ReduceMean_2269 BPU id(33) ReduceMean 0.976964 12.464371 int8/int8

Div_2273_reciprocal BPU id(33) HzRsqrt 0.993047 1.414378 int8/int8

Div_2273_mul BPU id(33) Mul 0.756864 3.530492 int8/int8

Mul_2274 BPU id(33) Conv 0.793611 4.151907 int8/int8

MatMul_2278 BPU id(33) Conv 0.877888 2.913109 int8/int8

ReduceMean_2280 BPU id(33) ReduceMean 0.973640 4.673010 int8/int8

Sub_2281 BPU id(33) Sub 0.876498 4.673010 int8/int8

Pow_2283 BPU id(33) Pow 0.844322 4.559095 int8/int8

ReduceMean_2284 BPU id(33) ReduceMean 0.986465 20.785347 int8/int8

Div_2288_reciprocal BPU id(33) HzRsqrt 0.995401 1.356977 int8/int8

Div_2288_mul BPU id(33) Mul 0.876583 4.559095 int8/int8

Mul_2289 BPU id(33) Conv 0.901387 4.633268 int8/int8

MatMul_2293 BPU id(33) Conv 0.990139 2.691806 int8/int32

Gather_2296 BPU id(33) Gather 0.746275 5.825645 int8/int8

MatMul_2298 BPU id(33) Conv 0.891338 5.825645 int8/int8

MatMul_2302 BPU id(33) Conv 0.880741 3.429862 int8/int8

MatMul_2306 BPU id(33) Conv 0.847089 2.460078 int8/int8

Slice_2312 BPU id(33) Slice 0.927966 2.902778 int8/int8

UNIT_CONV_FOR_Add_2318 BPU id(33) Conv 0.927979 2.902778 int8/int8

Sigmoid_2319 BPU id(33) Sigmoid 0.994519 5.498970 int8/int8

Slice_2324 BPU id(33) Slice 0.811060 2.902778 int8/int8

onnx::Concat_2851_calibrated_Requantize BPU id(33) HzRequantize int8/int8

onnx::Concat_2856_calibrated_Requantize BPU id(33) HzRequantize int8/int8

Concat_2325 BPU id(33) Concat 0.791702 0.995926 int8/int8

Concat_2332 CPU – Concat 0.989469 – float/float

Concat_2332_all_cls_scores_Transpose CPU – Transpose 0.989469 – float/float

Unsqueeze_2333 CPU – Reshape 0.806529 0.999998 float/float

Unsqueeze_2334 CPU – Reshape 0.796196 0.999998 float/float

Unsqueeze_2335 CPU – Reshape 0.747223 0.999998 float/float

Unsqueeze_2336 BPU id(33) Reshape 0.776388 0.999998 int8/int8

Unsqueeze_2337 BPU id(33) Reshape 0.781003 0.999998 int8/int8

Unsqueeze_2338 BPU id(33) Reshape 0.791702 0.999998 int8/int8

Concat_2339 CPU – Concat 0.782994 0.999998 float/float

Slice_2344 BPU id(36) Slice 0.992192 0.999998 int8/int8

Mul_2356 BPU id(36) Mul 0.998470 0.999998 int8/int8

Add_2362 CPU – Add 0.994086 99.999763 float/float

Slice_2367 CPU – Slice 0.737770 0.999998 float/float

Concat_2368 CPU – Concat 0.993212 0.999998 float/float

2023-12-14 11:31:20,798 file: build.py func: build line No: 408 The quantify model output:

==============================================================================

Node Cosine Similarity L1 Distance L2 Distance Chebyshev Distance

------------------------------------------------------------------------------

Concat_2332 0.989469 0.914993 0.005578 8.186812

Concat_2368 0.993212 0.694925 0.005863 14.805149

2023-12-14 11:31:20,803 file: build.py func: build line No: 35 [Thu Dec 14 11:31:20 2023] End to Horizon NN Model Convert.

2023-12-14 11:31:21,216 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 593 start convert to *.bin file…

2023-12-14 11:31:21,269 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4281 ONNX model output num : 2

2023-12-14 11:31:22,630 file: layout_util.py func: layout_util line No: 15 set_featuremap_layout start

2023-12-14 11:31:22,630 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4015 model_deps_info: {‘hb_mapper_version’: ‘1.21.6’, ‘hbdk_version’: ‘3.48.6’, ‘hbdk_runtime_version’: ’ 3.15.40.0’, ‘horizon_nn_version’: ‘0.21.2’, ‘onnx_model’: ‘/open_explore/samples/streampetr_yu/streampetr_input_only_img_run_1206.onnx’, ‘march’: ‘bayes’, ‘layer_out_dump’: False, ‘log_level’: ‘DEBUG’, ‘working_dir’: ‘/open_explore/samples/streampetr_yu/model_output_bin’, ‘model_prefix’: ‘1206_cpu_O3_2’, ‘input_names’: [‘img’], ‘input_type_rt’: [‘nv12’], ‘input_space_and_range’: [‘regular’], ‘input_type_train’: [‘rgb’], ‘input_layout_rt’: [‘NCHW’], ‘input_layout_train’: [‘NCHW’], ‘norm_type’: [‘data_mean_and_scale’], ‘scale_value’: [‘0.01712475,0.017507,0.01742919,’], ‘mean_value’: [‘123.675,116.28,103.53,’], ‘input_shape’: [‘6x3x256x704’], ‘input_batch’: , ‘cal_dir’: [‘/open_explore/samples/streampetr_yu/calib/img_self’], ‘cal_data_type’: [‘float32’], ‘preprocess_on’: False, ‘calibration_type’: ‘default’, ‘per_channel’: ‘False’, ‘optimization’: [‘bias_correction’], ‘run_on_cpu’: [‘ReduceMean_1737’, ‘ReduceMean_1522’, ‘ReduceMean_1756’, ‘ReduceMean_1288’, ‘ReduceMean_1035’, ‘ReduceMean_801’, ‘ReduceMean_699’, ‘ReduceMean_597’, ‘ReduceMean_820’, ‘ReduceMean_1767’, ‘MatMul_1753’, ‘MatMul_1753_reshape_output’, ‘ReduceMean_1065’, ‘MatMul_1285’, ‘MatMul_1285_reshape_output’, ‘ReduceMean_567’, ‘ReduceMean_1054’, ‘Slice_1964’, ‘Gemm_1261’, ‘MatMul_1254’, ‘Transpose_1255’, ‘Reshape_1260’, ‘MatMul_1519_reshape_output’, ‘MatMul_1519’, ‘Softmax_1619’, ‘Concat_1965’, ‘Unsqueeze_2334’, ‘MatMul_1722’, ‘Transpose_1723’, ‘Reshape_1728’, ‘MatMul_1852’, ‘Slice_2367’, ‘MatMul_817’, ‘MatMul_817_reshape_output’, ‘ReduceMean_1401’, ‘Gemm_1729’, ‘Slice_1874’, ‘Concat_1875’, ‘Unsqueeze_2333’, ‘MatMul_1946’, ‘Transpose_1621’, ‘Reshape_1626’, ‘MatMul_1620’, ‘Slice_2054’, ‘Gemm_793’, ‘ReduceMean_831’, ‘Concat_2055’, ‘Unsqueeze_2335’, ‘Gemm_1627’, ‘Transpose_787’, ‘Reshape_792’, ‘MatMul_786’, ‘Concat_2339’, ‘Transpose_1021’, ‘Reshape_1026’, ‘MatMul_1020’, ‘ReduceMean_586’], ‘hbdk_params’: {‘hbdk_pass_through_params’: '–O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1 ', ‘input-source’: {‘img’: ‘pyramid’, ‘_default_value’: ‘ddr’}}, ‘debug’: True, ‘compile_mode’: ‘latency’}

2023-12-14 11:31:22,630 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4138 ############# model deps info #############

2023-12-14 11:31:22,630 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4139 hb_mapper version : 1.21.6

2023-12-14 11:31:22,630 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4142 hbdk version : 3.48.6

2023-12-14 11:31:22,630 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4144 hbdk runtime version: 3.15.40.0

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4147 horizon_nn version : 0.21.2

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4151 ############# model_parameters info #############

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4157 onnx_model : /open_explore/samples/streampetr_yu/streampetr_input_only_img_run_1206.onnx

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4158 BPU march : bayes

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4159 layer_out_dump : False

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4160 log_level : DEBUG

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4161 working dir : /open_explore/samples/streampetr_yu/model_output_bin

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4162 output_model_file_prefix: 1206_cpu_O3_2

2023-12-14 11:31:22,631 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4183 ############# input_parameters info #############

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4201 ------------------------------------------

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4203 ---------input info : img ---------

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4204 input_name : img

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4205 input_type_rt : nv12

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4207 input_space&range : regular

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4209 input_layout_rt : NCHW

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4210 input_type_train : rgb

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4211 input_layout_train : NCHW

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4212 norm_type : data_mean_and_scale

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4213 input_shape : 6x3x256x704

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4219 mean_value : 123.675,116.28,103.53,

2023-12-14 11:31:22,632 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4221 scale_value : 0.01712475,0.017507,0.01742919,

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4223 cal_data_dir : /open_explore/samples/streampetr_yu/calib/img_self

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4225 cal_data_type : float32

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4226 ---------input info : img end -------

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4227 ------------------------------------------

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4229 ############# calibration_parameters info #############

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4230 preprocess_on : False

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4231 calibration_type: : default

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4233 optimization : bias_correction;

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4239 per_channel : False

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4241 run_on_cpu : ReduceMean_1737;ReduceMean_1522;ReduceMean_1756;ReduceMean_1288;ReduceMean_1035;ReduceMean_801;ReduceMean_699;ReduceMean_597;ReduceMean_820;ReduceMean_1767;MatMul_1753;MatMul_1753_reshape_output;ReduceMean_1065;MatMul_1285;MatMul_1285_reshape_output;ReduceMean_567;ReduceMean_1054;Slice_1964;Gemm_1261;MatMul_1254;Transpose_1255;Reshape_1260;MatMul_1519_reshape_output;MatMul_1519;Softmax_1619;Concat_1965;Unsqueeze_2334;MatMul_1722;Transpose_1723;Reshape_1728;MatMul_1852;Slice_2367;MatMul_817;MatMul_817_reshape_output;ReduceMean_1401;Gemm_1729;Slice_1874;Concat_1875;Unsqueeze_2333;MatMul_1946;Transpose_1621;Reshape_1626;MatMul_1620;Slice_2054;Gemm_793;ReduceMean_831;Concat_2055;Unsqueeze_2335;Gemm_1627;Transpose_787;Reshape_792;MatMul_786;Concat_2339;Transpose_1021;Reshape_1026;MatMul_1020;ReduceMean_586;

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4258 ############# compiler_parameters info #############

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4260 debug : True

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4262 compile_mode : latency

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4265 hbdk_pass_through_params: --O3 --cache /open_explore/samples/streampetr_yu/model_output_bin/cache.json --debug --core-num 1 --fast --advice 1

2023-12-14 11:31:22,633 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4265 input-source : {‘img’: ‘pyramid’, ‘_default_value’: ‘ddr’}

2023-12-14 11:31:22,774 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 774 Convert to runtime bin file successfully!

2023-12-14 11:31:22,774 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 775 End Model Convert

usssss · 2023 年12 月 15 日 02:52

非常感谢详细的解答，我们再及根据精度调优手段试一试。编译的log放在评论了

颜值即正义 · 2023 年12 月 15 日 09:10

从log来看这个模型是int8模型，不存在int16量化的节点，calibrated和quantized模型的差异不是位宽不一致回退导致的，条件允许的话可以跑评测数据看看，两个模型的指标应该是不会有太大的差距的，如果差异过大可以及时向我们反馈。-

精度调优建议先设置optimization: "set_all_nodes_int16"看下能不能改善精度（ 6.2.2.2. 模型编译命令（hb_mapper makertbin） — Horizon Open Explorer ），节省调优成本，如果该参数都解决不了精度问题，那大概率PTQ是不适合这个模型