BlogDocs

chore(bench): update CodSpeed/action to v2(#54)

Merged
Merging
adriencaccia:patch-1
into
main
-58%
IMPROVEMENTS
1
REGRESSIONS
9
UNTOUCHED
139
NEW
0
DROPPED
0
IGNORED
0

Benchmarks

Failing

test_rtree_nms[float32]Regression
bindings/tests/test_speed.py::test_rtree_nms[float32]
-29%
91.9 µs
128.9 µs
test_rtree_nms[float64]Regression
bindings/tests/test_speed.py::test_rtree_nms[float64]
-29%
93.9 µs
132 µs
test_rtree_nms[int16]Regression
bindings/tests/test_speed.py::test_rtree_nms[int16]
-28%
88.3 µs
122.7 µs
test_rtree_nms[int32]Regression
bindings/tests/test_speed.py::test_rtree_nms[int32]
-28%
90.5 µs
125.1 µs
test_rtree_nms[int64]Regression
bindings/tests/test_speed.py::test_rtree_nms[int64]
-27%
94.1 µs
128.9 µs
test_rtree_nms_many_boxes[10000]Regression
bindings/tests/test_speed.py::test_rtree_nms_many_boxes[10000]
-55%
7.5 ms
16.8 ms
test_rtree_nms_many_boxes[1000]Regression
bindings/tests/test_speed.py::test_rtree_nms_many_boxes[1000]
-52%
632.5 µs
1,306.8 µs
test_rtree_nms_many_boxes[20000]Regression
bindings/tests/test_speed.py::test_rtree_nms_many_boxes[20000]
-58%
15.8 ms
37.2 ms
test_rtree_nms_many_boxes[5000]Regression
bindings/tests/test_speed.py::test_rtree_nms_many_boxes[5000]
-56%
3.5 ms
7.9 ms

Passing

test_box_convert_cxcywh_xywh[float32]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[float32]
+1%
36.7 µs
36.4 µs
test_box_convert_cxcywh_xywh[float64]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[float64]
+1%
40.7 µs
40.4 µs
test_box_convert_cxcywh_xywh[int16]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[int16]
+3%
35.6 µs
34.6 µs
test_box_convert_cxcywh_xywh[int32]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[int32]
+2%
37 µs
36.3 µs
test_box_convert_cxcywh_xywh[int64]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[int64]
+1%
40.8 µs
40.6 µs
test_box_convert_cxcywh_xywh[uint16]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[uint16]
+2%
35.9 µs
35.1 µs
test_box_convert_cxcywh_xywh[uint32]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[uint32]
+2%
36.9 µs
36.1 µs
test_box_convert_cxcywh_xywh[uint64]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[uint64]
+1%
40.8 µs
40.3 µs
test_box_convert_cxcywh_xywh[uint8]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xywh[uint8]
+5%
35.5 µs
33.9 µs
test_box_convert_cxcywh_xyxy[float32]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[float32]
0%
38.2 µs
38.2 µs
test_box_convert_cxcywh_xyxy[float64]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[float64]
+1%
40.6 µs
40.3 µs
test_box_convert_cxcywh_xyxy[int16]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[int16]
+4%
35.9 µs
34.4 µs
test_box_convert_cxcywh_xyxy[int32]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[int32]
+2%
36.8 µs
36.2 µs
test_box_convert_cxcywh_xyxy[int64]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[int64]
+2%
41.1 µs
40.3 µs
test_box_convert_cxcywh_xyxy[uint16]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[uint16]
+4%
35.6 µs
34.4 µs
test_box_convert_cxcywh_xyxy[uint32]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[uint32]
+2%
37.2 µs
36.4 µs
test_box_convert_cxcywh_xyxy[uint64]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[uint64]
+1%
40.9 µs
40.5 µs
test_box_convert_cxcywh_xyxy[uint8]
bindings/tests/test_speed.py::test_box_convert_cxcywh_xyxy[uint8]
+2%
35.4 µs
34.6 µs
test_box_convert_xywh_cxcywh[float32]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[float32]
+1%
36.8 µs
36.5 µs
test_box_convert_xywh_cxcywh[float64]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[float64]
+1%
40.7 µs
40.2 µs
test_box_convert_xywh_cxcywh[int16]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[int16]
+4%
36 µs
34.6 µs
test_box_convert_xywh_cxcywh[int32]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[int32]
+1%
37 µs
36.5 µs
test_box_convert_xywh_cxcywh[int64]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[int64]
0%
40.9 µs
40.7 µs
test_box_convert_xywh_cxcywh[uint16]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[uint16]
+5%
36.1 µs
34.4 µs
test_box_convert_xywh_cxcywh[uint32]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[uint32]
+1%
36.7 µs
36.3 µs
test_box_convert_xywh_cxcywh[uint64]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[uint64]
+1%
40.8 µs
40.5 µs
test_box_convert_xywh_cxcywh[uint8]
bindings/tests/test_speed.py::test_box_convert_xywh_cxcywh[uint8]
+1%
35.1 µs
34.6 µs
test_box_convert_xywh_xyxy[float32]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[float32]
+1%
36.7 µs
36.2 µs
test_box_convert_xywh_xyxy[float64]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[float64]
0%
40.6 µs
40.6 µs
test_box_convert_xywh_xyxy[int16]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[int16]
+2%
35.7 µs
35 µs
test_box_convert_xywh_xyxy[int32]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[int32]
+2%
36.7 µs
35.9 µs
test_box_convert_xywh_xyxy[int64]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[int64]
+1%
40.8 µs
40.5 µs
test_box_convert_xywh_xyxy[uint16]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[uint16]
+2%
35.7 µs
34.9 µs
test_box_convert_xywh_xyxy[uint32]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[uint32]
0%
37.3 µs
37.2 µs
test_box_convert_xywh_xyxy[uint64]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[uint64]
0%
40.7 µs
40.8 µs
test_box_convert_xywh_xyxy[uint8]
bindings/tests/test_speed.py::test_box_convert_xywh_xyxy[uint8]
+2%
35.2 µs
34.4 µs
test_box_convert_xyxy_cxcywh[float32]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[float32]
0%
36.8 µs
36.6 µs
test_box_convert_xyxy_cxcywh[float64]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[float64]
0%
40.8 µs
40.6 µs
test_box_convert_xyxy_cxcywh[int16]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[int16]
+2%
36 µs
35.3 µs
test_box_convert_xyxy_cxcywh[int32]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[int32]
+2%
36.9 µs
36.3 µs
test_box_convert_xyxy_cxcywh[int64]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[int64]
+1%
41.1 µs
40.5 µs
test_box_convert_xyxy_cxcywh[uint16]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[uint16]
+4%
36 µs
34.5 µs
test_box_convert_xyxy_cxcywh[uint32]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[uint32]
+1%
36.8 µs
36.3 µs
test_box_convert_xyxy_cxcywh[uint64]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[uint64]
+1%
41.1 µs
40.6 µs
test_box_convert_xyxy_cxcywh[uint8]
bindings/tests/test_speed.py::test_box_convert_xyxy_cxcywh[uint8]
+3%
35.6 µs
34.6 µs
test_box_convert_xyxy_xywh[float32]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[float32]
0%
36.6 µs
36.6 µs
test_box_convert_xyxy_xywh[float64]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[float64]
0%
43.6 µs
43.5 µs
test_box_convert_xyxy_xywh[int16]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[int16]
+2%
35.5 µs
34.9 µs
test_box_convert_xyxy_xywh[int32]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[int32]
+1%
36.6 µs
36.2 µs
test_box_convert_xyxy_xywh[int64]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[int64]
+1%
40.8 µs
40.4 µs
test_box_convert_xyxy_xywh[uint16]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[uint16]
+2%
35.8 µs
35 µs
test_box_convert_xyxy_xywh[uint32]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[uint32]
+1%
36.8 µs
36.3 µs
test_box_convert_xyxy_xywh[uint64]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[uint64]
+2%
41.1 µs
40.4 µs
test_box_convert_xyxy_xywh[uint8]
bindings/tests/test_speed.py::test_box_convert_xyxy_xywh[uint8]
+4%
36.3 µs
35 µs
test_boxes_areas[float32]
bindings/tests/test_speed.py::test_boxes_areas[float32]
+2%
34.4 µs
33.8 µs
test_boxes_areas[float64]
bindings/tests/test_speed.py::test_boxes_areas[float64]
0%
38.4 µs
38.5 µs
test_boxes_areas[int16]
bindings/tests/test_speed.py::test_boxes_areas[int16]
+3%
33.3 µs
32.3 µs
test_boxes_areas[int32]
bindings/tests/test_speed.py::test_boxes_areas[int32]
+1%
34.4 µs
34 µs
test_boxes_areas[int64]
bindings/tests/test_speed.py::test_boxes_areas[int64]
+1%
35.9 µs
35.7 µs
test_boxes_areas[uint16]
bindings/tests/test_speed.py::test_boxes_areas[uint16]
+5%
33.9 µs
32.4 µs
test_boxes_areas[uint32]
bindings/tests/test_speed.py::test_boxes_areas[uint32]
+2%
34.5 µs
33.9 µs
test_boxes_areas[uint64]
bindings/tests/test_speed.py::test_boxes_areas[uint64]
+1%
35.9 µs
35.4 µs
test_boxes_areas[uint8]
bindings/tests/test_speed.py::test_boxes_areas[uint8]
+2%
34.6 µs
33.8 µs
test_diou_distance[float32]
bindings/tests/test_speed.py::test_diou_distance[float32]
0%
201.3 µs
200.8 µs
test_diou_distance[float64]
bindings/tests/test_speed.py::test_diou_distance[float64]
0%
200.8 µs
200.7 µs
test_giou_distance[float32]
bindings/tests/test_speed.py::test_giou_distance[float32]
0%
268.6 µs
268.4 µs
test_giou_distance[float64]
bindings/tests/test_speed.py::test_giou_distance[float64]
0%
268.4 µs
268.3 µs
test_giou_distance[int16]
bindings/tests/test_speed.py::test_giou_distance[int16]
0%
368.7 µs
368 µs
test_giou_distance[int32]
bindings/tests/test_speed.py::test_giou_distance[int32]
0%
375.7 µs
375.6 µs
test_giou_distance[int64]
bindings/tests/test_speed.py::test_giou_distance[int64]
0%
381.6 µs
381.4 µs
test_giou_distance[uint16]
bindings/tests/test_speed.py::test_giou_distance[uint16]
0%
368.6 µs
368.1 µs
test_giou_distance[uint32]
bindings/tests/test_speed.py::test_giou_distance[uint32]
0%
375.6 µs
375.5 µs
test_giou_distance[uint64]
bindings/tests/test_speed.py::test_giou_distance[uint64]
0%
401.5 µs
401.1 µs
test_giou_distance[uint8]
bindings/tests/test_speed.py::test_giou_distance[uint8]
0%
403 µs
402.6 µs
test_iou_distance[float32]
bindings/tests/test_speed.py::test_iou_distance[float32]
0%
188.2 µs
187.3 µs
test_iou_distance[float64]
bindings/tests/test_speed.py::test_iou_distance[float64]
0%
195.5 µs
194.7 µs
test_iou_distance[int16]
bindings/tests/test_speed.py::test_iou_distance[int16]
0%
295.7 µs
294.6 µs
test_iou_distance[int32]
bindings/tests/test_speed.py::test_iou_distance[int32]
0%
272.7 µs
271.6 µs
test_iou_distance[int64]
bindings/tests/test_speed.py::test_iou_distance[int64]
-2%
284.1 µs
288.8 µs
test_iou_distance[uint16]
bindings/tests/test_speed.py::test_iou_distance[uint16]
0%
295.9 µs
294.9 µs
test_iou_distance[uint32]
bindings/tests/test_speed.py::test_iou_distance[uint32]
0%
272.5 µs
271.9 µs
test_iou_distance[uint64]
bindings/tests/test_speed.py::test_iou_distance[uint64]
+1%
295.7 µs
292 µs
test_iou_distance[uint8]
bindings/tests/test_speed.py::test_iou_distance[uint8]
0%
291.2 µs
290.5 µs
test_masks_to_boxes
bindings/tests/test_speed.py::test_masks_to_boxes
0%
9.4 ms
9.4 ms
test_nms[float32]
bindings/tests/test_speed.py::test_nms[float32]
+1%
71.8 µs
70.9 µs
test_nms[float64]
bindings/tests/test_speed.py::test_nms[float64]
+2%
76.9 µs
75.7 µs
test_nms[int16]
bindings/tests/test_speed.py::test_nms[int16]
+2%
77.8 µs
76 µs
test_nms[int32]
bindings/tests/test_speed.py::test_nms[int32]
+3%
79 µs
76.7 µs
test_nms[int64]
bindings/tests/test_speed.py::test_nms[int64]
+3%
81.3 µs
78.8 µs
test_nms[uint16]
bindings/tests/test_speed.py::test_nms[uint16]
+4%
78.5 µs
75.9 µs
test_nms[uint32]
bindings/tests/test_speed.py::test_nms[uint32]
+3%
79.1 µs
76.8 µs
test_nms[uint64]
bindings/tests/test_speed.py::test_nms[uint64]
+3%
81.7 µs
79.6 µs
test_nms[uint8]
bindings/tests/test_speed.py::test_nms[uint8]
+3%
76 µs
74.1 µs
test_nms_many_boxes[10000]
bindings/tests/test_speed.py::test_nms_many_boxes[10000]
+2%
197 ms
193.5 ms
test_nms_many_boxes[1000]
bindings/tests/test_speed.py::test_nms_many_boxes[1000]
+2%
1.8 ms
1.8 ms
test_nms_many_boxes[20000]
bindings/tests/test_speed.py::test_nms_many_boxes[20000]
+2%
765.8 ms
751.9 ms
test_nms_many_boxes[5000]
bindings/tests/test_speed.py::test_nms_many_boxes[5000]
+2%
49.6 ms
48.7 ms
test_parallel_giou_distance[float32]
bindings/tests/test_speed.py::test_parallel_giou_distance[float32]
0%
267.8 µs
267.7 µs
test_parallel_giou_distance[float64]
bindings/tests/test_speed.py::test_parallel_giou_distance[float64]
0%
269.4 µs
269.1 µs
test_parallel_giou_distance[int16]
bindings/tests/test_speed.py::test_parallel_giou_distance[int16]
0%
368.4 µs
367.9 µs
test_parallel_giou_distance[int32]
bindings/tests/test_speed.py::test_parallel_giou_distance[int32]
0%
375.7 µs
375.5 µs
test_parallel_giou_distance[int64]
bindings/tests/test_speed.py::test_parallel_giou_distance[int64]
0%
381.5 µs
381.3 µs
test_parallel_giou_distance[uint16]
bindings/tests/test_speed.py::test_parallel_giou_distance[uint16]
0%
368.3 µs
368 µs
test_parallel_giou_distance[uint32]
bindings/tests/test_speed.py::test_parallel_giou_distance[uint32]
0%
375.6 µs
375.3 µs
test_parallel_giou_distance[uint64]
bindings/tests/test_speed.py::test_parallel_giou_distance[uint64]
0%
401.3 µs
401.1 µs
test_parallel_giou_distance[uint8]
bindings/tests/test_speed.py::test_parallel_giou_distance[uint8]
0%
403.4 µs
403 µs
test_parallel_iou_distance[float32]
bindings/tests/test_speed.py::test_parallel_iou_distance[float32]
-4%
237.6 µs
248.7 µs
test_parallel_iou_distance[float64]
bindings/tests/test_speed.py::test_parallel_iou_distance[float64]
+2%
243.7 µs
239.6 µs
test_parallel_iou_distance[int16]
bindings/tests/test_speed.py::test_parallel_iou_distance[int16]
0%
410.8 µs
410.6 µs
test_parallel_iou_distance[int32]
bindings/tests/test_speed.py::test_parallel_iou_distance[int32]
+1%
379 µs
373.4 µs
test_parallel_iou_distance[int64]
bindings/tests/test_speed.py::test_parallel_iou_distance[int64]
-3%
363 µs
372.8 µs
test_parallel_iou_distance[uint16]
bindings/tests/test_speed.py::test_parallel_iou_distance[uint16]
-2%
403.1 µs
410.2 µs
test_parallel_iou_distance[uint32]
bindings/tests/test_speed.py::test_parallel_iou_distance[uint32]
-6%
354.5 µs
376.3 µs
test_parallel_iou_distance[uint64]
bindings/tests/test_speed.py::test_parallel_iou_distance[uint64]
-5%
368.1 µs
385.8 µs
test_parallel_iou_distance[uint8]
bindings/tests/test_speed.py::test_parallel_iou_distance[uint8]
0%
372.9 µs
373.2 µs
test_remove_small_boxes[float32]
bindings/tests/test_speed.py::test_remove_small_boxes[float32]
0%
34.6 µs
34.6 µs
test_remove_small_boxes[float64]
bindings/tests/test_speed.py::test_remove_small_boxes[float64]
0%
39.2 µs
39.3 µs
test_remove_small_boxes[int16]
bindings/tests/test_speed.py::test_remove_small_boxes[int16]
+1%
33.4 µs
33.1 µs
test_remove_small_boxes[int32]
bindings/tests/test_speed.py::test_remove_small_boxes[int32]
+1%
35 µs
34.6 µs
test_remove_small_boxes[int64]
bindings/tests/test_speed.py::test_remove_small_boxes[int64]
+1%
36.4 µs
36.2 µs
test_remove_small_boxes[uint16]
bindings/tests/test_speed.py::test_remove_small_boxes[uint16]
+1%
33.5 µs
33.3 µs
test_remove_small_boxes[uint32]
bindings/tests/test_speed.py::test_remove_small_boxes[uint32]
+1%
35.8 µs
35.5 µs
test_remove_small_boxes[uint64]
bindings/tests/test_speed.py::test_remove_small_boxes[uint64]
+2%
36.7 µs
36 µs
test_remove_small_boxes[uint8]
bindings/tests/test_speed.py::test_remove_small_boxes[uint8]
+1%
35 µs
34.6 µs
test_rotated_giou_distance[float64]
bindings/tests/test_speed.py::test_rotated_giou_distance[float64]
0%
12.3 ms
12.3 ms
test_rotated_iou_distance[float64]
bindings/tests/test_speed.py::test_rotated_iou_distance[float64]
0%
12.8 ms
12.8 ms
test_rotated_tiou_distance[float64]
bindings/tests/test_speed.py::test_rotated_tiou_distance[float64]
0%
191.8 µs
192.2 µs
test_tiou_distance[float32]
bindings/tests/test_speed.py::test_tiou_distance[float32]
0%
197.7 µs
196.7 µs
test_tiou_distance[float64]
bindings/tests/test_speed.py::test_tiou_distance[float64]
0%
197.8 µs
196.9 µs
test_tiou_distance[int16]
bindings/tests/test_speed.py::test_tiou_distance[int16]
+1%
190 µs
189 µs
test_tiou_distance[int32]
bindings/tests/test_speed.py::test_tiou_distance[int32]
0%
224.4 µs
223.7 µs
test_tiou_distance[int64]
bindings/tests/test_speed.py::test_tiou_distance[int64]
-1%
275.5 µs
277.8 µs
test_tiou_distance[uint16]
bindings/tests/test_speed.py::test_tiou_distance[uint16]
+1%
196.8 µs
195.9 µs
test_tiou_distance[uint32]
bindings/tests/test_speed.py::test_tiou_distance[uint32]
0%
243.9 µs
243.2 µs
test_tiou_distance[uint64]
bindings/tests/test_speed.py::test_tiou_distance[uint64]
0%
321.5 µs
320.6 µs
test_tiou_distance[uint8]
bindings/tests/test_speed.py::test_tiou_distance[uint8]
0%
206.5 µs
205.9 µs
giou distance benchmark
powerboxesrs/benches/bench_iou.rs::benches::giou_distance_benchmark::giou distance benchmark
-2%
270.6 µs
275.6 µs
iou distance benchmark
powerboxesrs/benches/bench_iou.rs::benches::iou_distance_benchmark::iou distance benchmark
0%
213.7 µs
213.3 µs
parallel giou distance benchmark
powerboxesrs/benches/bench_iou.rs::benches::parallel_giou_distance_benchmark::parallel giou distance benchmark
+25%
489.4 µs
392.1 µs
parallel iou distance benchmark
powerboxesrs/benches/bench_iou.rs::benches::parallel_iou_distance_benchmark::parallel iou distance benchmark
-4%
282.2 µs
295.1 µs

Commits

Click on a commit to change the comparison range
base
main
db09f08
-58%
chore(bench): update CodSpeed/action to v2 Upgrading to the v2 of https://github.com/CodSpeedHQ/action will bring a better base run selection algorithm, better logging, and continued support.
01ca671
2 months ago by adriencaccia
ResourcesHomePricingDocsBlogGitHub
Copyright © 2024 CodSpeed Technology SAS. All rights reserved.