qaihm-bot commited on
Commit
f015c2f
·
verified ·
1 Parent(s): d78951d

See https://github.com/quic/ai-hub-models/releases/v0.38.0 for changelog.

Files changed (1) hide show
  1. README.md +94 -104
README.md CHANGED
@@ -38,110 +38,100 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | YOLOv10-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 14.058 ms | 0 - 69 MB | NPU | -- |
42
- | YOLOv10-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 12.777 ms | 1 - 93 MB | NPU | -- |
43
- | YOLOv10-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 7.383 ms | 0 - 42 MB | NPU | -- |
44
- | YOLOv10-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 7.646 ms | 5 - 42 MB | NPU | -- |
45
- | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.519 ms | 0 - 18 MB | NPU | -- |
46
- | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.806 ms | 5 - 89 MB | NPU | -- |
47
- | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.66 ms | 0 - 95 MB | NPU | -- |
48
- | YOLOv10-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.844 ms | 0 - 69 MB | NPU | -- |
49
- | YOLOv10-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.307 ms | 2 - 111 MB | NPU | -- |
50
- | YOLOv10-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 14.058 ms | 0 - 69 MB | NPU | -- |
51
- | YOLOv10-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 12.777 ms | 1 - 93 MB | NPU | -- |
52
- | YOLOv10-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.52 ms | 0 - 24 MB | NPU | -- |
53
- | YOLOv10-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.797 ms | 0 - 93 MB | NPU | -- |
54
- | YOLOv10-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 8.66 ms | 0 - 34 MB | NPU | -- |
55
- | YOLOv10-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 8.15 ms | 4 - 39 MB | NPU | -- |
56
- | YOLOv10-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.526 ms | 0 - 20 MB | NPU | -- |
57
- | YOLOv10-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.81 ms | 0 - 84 MB | NPU | -- |
58
- | YOLOv10-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.844 ms | 0 - 69 MB | NPU | -- |
59
- | YOLOv10-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.307 ms | 2 - 111 MB | NPU | -- |
60
- | YOLOv10-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 4.509 ms | 0 - 26 MB | NPU | -- |
61
- | YOLOv10-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.79 ms | 4 - 88 MB | NPU | -- |
62
- | YOLOv10-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.519 ms | 0 - 36 MB | NPU | -- |
63
- | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.326 ms | 0 - 83 MB | NPU | -- |
64
- | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.709 ms | 0 - 217 MB | NPU | -- |
65
- | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.833 ms | 0 - 143 MB | NPU | -- |
66
- | YOLOv10-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 3.12 ms | 0 - 75 MB | NPU | -- |
67
- | YOLOv10-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 2.536 ms | 5 - 101 MB | NPU | -- |
68
- | YOLOv10-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.735 ms | 5 - 107 MB | NPU | -- |
69
- | YOLOv10-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.255 ms | 158 - 158 MB | NPU | -- |
70
- | YOLOv10-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.716 ms | 5 - 5 MB | NPU | -- |
71
- | YOLOv10-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 7.124 ms | 2 - 32 MB | NPU | -- |
72
- | YOLOv10-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 4.537 ms | 2 - 42 MB | NPU | -- |
73
- | YOLOv10-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.831 ms | 2 - 14 MB | NPU | -- |
74
- | YOLOv10-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 56.531 ms | 9 - 200 MB | NPU | -- |
75
- | YOLOv10-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 4.417 ms | 1 - 33 MB | NPU | -- |
76
- | YOLOv10-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 12.305 ms | 2 - 38 MB | NPU | -- |
77
- | YOLOv10-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 183.447 ms | 72 - 87 MB | CPU | -- |
78
- | YOLOv10-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 139.604 ms | 69 - 75 MB | CPU | -- |
79
- | YOLOv10-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 7.124 ms | 2 - 32 MB | NPU | -- |
80
- | YOLOv10-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.824 ms | 2 - 13 MB | NPU | -- |
81
- | YOLOv10-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 5.089 ms | 2 - 40 MB | NPU | -- |
82
- | YOLOv10-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.827 ms | 2 - 13 MB | NPU | -- |
83
- | YOLOv10-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 4.417 ms | 1 - 33 MB | NPU | -- |
84
- | YOLOv10-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.826 ms | 2 - 13 MB | NPU | -- |
85
- | YOLOv10-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 56.21 ms | 9 - 198 MB | NPU | -- |
86
- | YOLOv10-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.567 ms | 2 - 43 MB | NPU | -- |
87
- | YOLOv10-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 48.557 ms | 0 - 2121 MB | NPU | -- |
88
- | YOLOv10-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 2.181 ms | 2 - 42 MB | NPU | -- |
89
- | YOLOv10-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 46.501 ms | 7 - 660 MB | NPU | -- |
90
- | YOLOv10-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.263 ms | 5 - 5 MB | NPU | -- |
91
- | YOLOv10-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 58.515 ms | 31 - 31 MB | NPU | -- |
92
- | YOLOv10-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.699 ms | 0 - 26 MB | NPU | -- |
93
- | YOLOv10-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.595 ms | 1 - 27 MB | NPU | -- |
94
- | YOLOv10-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.047 ms | 0 - 36 MB | NPU | -- |
95
- | YOLOv10-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.992 ms | 1 - 37 MB | NPU | -- |
96
- | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.834 ms | 0 - 14 MB | NPU | -- |
97
- | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.744 ms | 1 - 10 MB | NPU | -- |
98
- | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 6.582 ms | 0 - 26 MB | NPU | -- |
99
- | YOLOv10-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.283 ms | 0 - 26 MB | NPU | -- |
100
- | YOLOv10-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.167 ms | 1 - 27 MB | NPU | -- |
101
- | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.119 ms | 0 - 33 MB | NPU | -- |
102
- | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 5.289 ms | 1 - 35 MB | NPU | -- |
103
- | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 45.893 ms | 22 - 40 MB | CPU | -- |
104
- | YOLOv10-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 58.577 ms | 1 - 9 MB | NPU | -- |
105
- | YOLOv10-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 40.034 ms | 21 - 26 MB | CPU | -- |
106
- | YOLOv10-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.699 ms | 0 - 26 MB | NPU | -- |
107
- | YOLOv10-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.595 ms | 1 - 27 MB | NPU | -- |
108
- | YOLOv10-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.835 ms | 0 - 14 MB | NPU | -- |
109
- | YOLOv10-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.753 ms | 2 - 15 MB | NPU | -- |
110
- | YOLOv10-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.671 ms | 0 - 34 MB | NPU | -- |
111
- | YOLOv10-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.548 ms | 1 - 34 MB | NPU | -- |
112
- | YOLOv10-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.84 ms | 0 - 9 MB | NPU | -- |
113
- | YOLOv10-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.755 ms | 0 - 13 MB | NPU | -- |
114
- | YOLOv10-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.283 ms | 0 - 26 MB | NPU | -- |
115
- | YOLOv10-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.167 ms | 1 - 27 MB | NPU | -- |
116
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 1.83 ms | 0 - 13 MB | NPU | -- |
117
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.754 ms | 1 - 15 MB | NPU | -- |
118
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 6.526 ms | 0 - 25 MB | NPU | -- |
119
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.222 ms | 0 - 39 MB | NPU | -- |
120
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.202 ms | 1 - 38 MB | NPU | -- |
121
- | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.755 ms | 2 - 77 MB | NPU | -- |
122
- | YOLOv10-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.928 ms | 0 - 29 MB | NPU | -- |
123
- | YOLOv10-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 0.879 ms | 1 - 38 MB | NPU | -- |
124
- | YOLOv10-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.19 ms | 1 - 60 MB | NPU | -- |
125
  | YOLOv10-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.014 ms | 1 - 1 MB | NPU | -- |
126
- | YOLOv10-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.838 ms | 1 - 1 MB | NPU | -- |
127
- | YOLOv10-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.989 ms | 2 - 30 MB | NPU | -- |
128
- | YOLOv10-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.516 ms | 2 - 13 MB | NPU | -- |
129
- | YOLOv10-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 61.405 ms | 9 - 193 MB | NPU | -- |
130
- | YOLOv10-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.066 ms | 0 - 27 MB | NPU | -- |
131
- | YOLOv10-Detection | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 132.301 ms | 52 - 73 MB | CPU | -- |
132
- | YOLOv10-Detection | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 113.305 ms | 56 - 63 MB | CPU | -- |
133
- | YOLOv10-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.989 ms | 2 - 30 MB | NPU | -- |
134
- | YOLOv10-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.534 ms | 2 - 12 MB | NPU | -- |
135
- | YOLOv10-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.518 ms | 2 - 13 MB | NPU | -- |
136
- | YOLOv10-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.066 ms | 0 - 27 MB | NPU | -- |
137
- | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 2.542 ms | 2 - 12 MB | NPU | -- |
138
- | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 59.144 ms | 19 - 178 MB | NPU | -- |
139
- | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.71 ms | 2 - 42 MB | NPU | -- |
140
- | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 47.7 ms | 3 - 692 MB | NPU | -- |
141
- | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.514 ms | 2 - 37 MB | NPU | -- |
142
- | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 47.407 ms | 7 - 660 MB | NPU | -- |
143
- | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.841 ms | 3 - 3 MB | NPU | -- |
144
- | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 60.643 ms | 29 - 29 MB | NPU | -- |
145
 
146
 
147
 
@@ -223,7 +213,7 @@ from qai_hub_models.models.yolov10_det import Model
223
  torch_model = Model.from_pretrained()
224
 
225
  # Device
226
- device = hub.Device("Samsung Galaxy S24")
227
 
228
  # Trace model
229
  input_shape = torch_model.get_input_spec()
 
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | YOLOv10-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 14.077 ms | 0 - 69 MB | NPU | -- |
42
+ | YOLOv10-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 12.775 ms | 0 - 92 MB | NPU | -- |
43
+ | YOLOv10-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 7.456 ms | 0 - 41 MB | NPU | -- |
44
+ | YOLOv10-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 7.678 ms | 5 - 44 MB | NPU | -- |
45
+ | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.518 ms | 0 - 22 MB | NPU | -- |
46
+ | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.819 ms | 0 - 88 MB | NPU | -- |
47
+ | YOLOv10-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.759 ms | 0 - 106 MB | NPU | -- |
48
+ | YOLOv10-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.831 ms | 0 - 70 MB | NPU | -- |
49
+ | YOLOv10-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.309 ms | 1 - 110 MB | NPU | -- |
50
+ | YOLOv10-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 14.077 ms | 0 - 69 MB | NPU | -- |
51
+ | YOLOv10-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 12.775 ms | 0 - 92 MB | NPU | -- |
52
+ | YOLOv10-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.507 ms | 0 - 26 MB | NPU | -- |
53
+ | YOLOv10-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.814 ms | 0 - 78 MB | NPU | -- |
54
+ | YOLOv10-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 8.673 ms | 0 - 34 MB | NPU | -- |
55
+ | YOLOv10-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 8.214 ms | 4 - 39 MB | NPU | -- |
56
+ | YOLOv10-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.511 ms | 0 - 22 MB | NPU | -- |
57
+ | YOLOv10-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.793 ms | 0 - 86 MB | NPU | -- |
58
+ | YOLOv10-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.831 ms | 0 - 70 MB | NPU | -- |
59
+ | YOLOv10-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.309 ms | 1 - 110 MB | NPU | -- |
60
+ | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.328 ms | 0 - 85 MB | NPU | -- |
61
+ | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.715 ms | 5 - 221 MB | NPU | -- |
62
+ | YOLOv10-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.748 ms | 0 - 173 MB | NPU | -- |
63
+ | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 2.58 ms | 0 - 77 MB | NPU | -- |
64
+ | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 2.127 ms | 4 - 100 MB | NPU | -- |
65
+ | YOLOv10-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.741 ms | 2 - 91 MB | NPU | -- |
66
+ | YOLOv10-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.271 ms | 118 - 118 MB | NPU | -- |
67
+ | YOLOv10-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.131 ms | 5 - 5 MB | NPU | -- |
68
+ | YOLOv10-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 7.25 ms | 2 - 40 MB | NPU | -- |
69
+ | YOLOv10-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 4.637 ms | 2 - 48 MB | NPU | -- |
70
+ | YOLOv10-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.865 ms | 2 - 16 MB | NPU | -- |
71
+ | YOLOv10-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 65.087 ms | 8 - 201 MB | NPU | -- |
72
+ | YOLOv10-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 4.486 ms | 2 - 41 MB | NPU | -- |
73
+ | YOLOv10-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 12.758 ms | 2 - 39 MB | NPU | -- |
74
+ | YOLOv10-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 177.257 ms | 74 - 89 MB | CPU | -- |
75
+ | YOLOv10-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 139.671 ms | 70 - 76 MB | CPU | -- |
76
+ | YOLOv10-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 7.25 ms | 2 - 40 MB | NPU | -- |
77
+ | YOLOv10-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.868 ms | 1 - 13 MB | NPU | -- |
78
+ | YOLOv10-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 5.19 ms | 0 - 40 MB | NPU | -- |
79
+ | YOLOv10-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.86 ms | 2 - 13 MB | NPU | -- |
80
+ | YOLOv10-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 4.486 ms | 2 - 41 MB | NPU | -- |
81
+ | YOLOv10-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.587 ms | 2 - 50 MB | NPU | -- |
82
+ | YOLOv10-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 49.337 ms | 0 - 906 MB | NPU | -- |
83
+ | YOLOv10-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.798 ms | 2 - 43 MB | NPU | -- |
84
+ | YOLOv10-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 42.454 ms | 20 - 1031 MB | NPU | -- |
85
+ | YOLOv10-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.28 ms | 10 - 10 MB | NPU | -- |
86
+ | YOLOv10-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 62.465 ms | 29 - 29 MB | NPU | -- |
87
+ | YOLOv10-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.73 ms | 0 - 26 MB | NPU | -- |
88
+ | YOLOv10-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.616 ms | 1 - 27 MB | NPU | -- |
89
+ | YOLOv10-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.007 ms | 0 - 35 MB | NPU | -- |
90
+ | YOLOv10-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.003 ms | 1 - 40 MB | NPU | -- |
91
+ | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.837 ms | 0 - 14 MB | NPU | -- |
92
+ | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.737 ms | 1 - 15 MB | NPU | -- |
93
+ | YOLOv10-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 6.698 ms | 0 - 27 MB | NPU | -- |
94
+ | YOLOv10-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.318 ms | 0 - 26 MB | NPU | -- |
95
+ | YOLOv10-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.188 ms | 0 - 26 MB | NPU | -- |
96
+ | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.298 ms | 0 - 33 MB | NPU | -- |
97
+ | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 5.373 ms | 1 - 36 MB | NPU | -- |
98
+ | YOLOv10-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 46.283 ms | 22 - 38 MB | CPU | -- |
99
+ | YOLOv10-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 57.735 ms | 2 - 8 MB | NPU | -- |
100
+ | YOLOv10-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 39.612 ms | 22 - 27 MB | CPU | -- |
101
+ | YOLOv10-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.73 ms | 0 - 26 MB | NPU | -- |
102
+ | YOLOv10-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.616 ms | 1 - 27 MB | NPU | -- |
103
+ | YOLOv10-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.846 ms | 0 - 13 MB | NPU | -- |
104
+ | YOLOv10-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.747 ms | 1 - 15 MB | NPU | -- |
105
+ | YOLOv10-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.67 ms | 0 - 32 MB | NPU | -- |
106
+ | YOLOv10-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.569 ms | 1 - 33 MB | NPU | -- |
107
+ | YOLOv10-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.836 ms | 0 - 14 MB | NPU | -- |
108
+ | YOLOv10-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.748 ms | 1 - 15 MB | NPU | -- |
109
+ | YOLOv10-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.318 ms | 0 - 26 MB | NPU | -- |
110
+ | YOLOv10-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.188 ms | 0 - 26 MB | NPU | -- |
111
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.226 ms | 0 - 34 MB | NPU | -- |
112
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.204 ms | 1 - 37 MB | NPU | -- |
113
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.817 ms | 2 - 89 MB | NPU | -- |
114
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.931 ms | 0 - 28 MB | NPU | -- |
115
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.863 ms | 1 - 34 MB | NPU | -- |
116
+ | YOLOv10-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.675 ms | 2 - 66 MB | NPU | -- |
 
 
 
 
 
 
 
 
117
  | YOLOv10-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.014 ms | 1 - 1 MB | NPU | -- |
118
+ | YOLOv10-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 7.034 ms | 1 - 1 MB | NPU | -- |
119
+ | YOLOv10-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.01 ms | 2 - 30 MB | NPU | -- |
120
+ | YOLOv10-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.527 ms | 2 - 12 MB | NPU | -- |
121
+ | YOLOv10-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 61.587 ms | 13 - 174 MB | NPU | -- |
122
+ | YOLOv10-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.079 ms | 2 - 30 MB | NPU | -- |
123
+ | YOLOv10-Detection | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 132.533 ms | 54 - 70 MB | CPU | -- |
124
+ | YOLOv10-Detection | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 130.646 ms | 54 - 61 MB | CPU | -- |
125
+ | YOLOv10-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.01 ms | 2 - 30 MB | NPU | -- |
126
+ | YOLOv10-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.533 ms | 2 - 12 MB | NPU | -- |
127
+ | YOLOv10-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.529 ms | 1 - 11 MB | NPU | -- |
128
+ | YOLOv10-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.079 ms | 2 - 30 MB | NPU | -- |
129
+ | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.703 ms | 2 - 41 MB | NPU | -- |
130
+ | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 48.511 ms | 1 - 907 MB | NPU | -- |
131
+ | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.249 ms | 2 - 38 MB | NPU | -- |
132
+ | YOLOv10-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 40.211 ms | 5 - 876 MB | NPU | -- |
133
+ | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.868 ms | 4 - 4 MB | NPU | -- |
134
+ | YOLOv10-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 64.526 ms | 29 - 29 MB | NPU | -- |
 
 
135
 
136
 
137
 
 
213
  torch_model = Model.from_pretrained()
214
 
215
  # Device
216
+ device = hub.Device("Samsung Galaxy S25")
217
 
218
  # Trace model
219
  input_shape = torch_model.get_input_spec()