Other
PyTorch
bu_auto
android

BEVDet: Optimized for Qualcomm Devices

BEVDet is a machine learning model for generating a birds eye view represenation from the sensors(cameras) mounted on a vehicle.

This is based on the implementation of BEVDet found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.50, ONNX Runtime 1.30.0 Download
ONNX mixed_with_float Universal QAIRT 2.50, ONNX Runtime 1.30.0 Download
QNN_DLC float Universal QAIRT 2.50 Download
QNN_DLC mixed_with_float Universal QAIRT 2.50 Download
TFLITE float Universal QAIRT 2.50 Download

For more device-specific assets and performance metrics, visit BEVDet on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for BEVDet on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.driver_assistance

Model Stats:

  • Input resolution: 1 x 6 x 3 x 256 x 704
  • Model checkpoint: bevdet-r50.pth
  • Model size: 171 MB
  • Number of parameters: 44M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
decoder ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.023 ms 4 - 147 MB NPU
decoder ONNX float Snapdragon® 8 Elite For Galaxy Mobile 7.243 ms 3 - 146 MB NPU
decoder ONNX float Snapdragon® X2 Elite 6.304 ms 4 - 4 MB NPU
decoder ONNX float Snapdragon® X Elite 12.049 ms 34 - 34 MB NPU
decoder ONNX float Snapdragon® 8 Gen 3 Mobile 8.757 ms 0 - 166 MB NPU
decoder ONNX float Snapdragon® 8 Gen 1 Mobile 22.334 ms 0 - 166 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-8275 25.864 ms 4 - 12 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.548 ms 4 - 6 MB NPU
decoder ONNX float Qualcomm® QCS8450 22.334 ms 0 - 166 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-9075 23.282 ms 4 - 11 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 12.049 ms 34 - 34 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ Q-8750 7.243 ms 3 - 146 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 2.861 ms 4 - 156 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 3.822 ms 3 - 149 MB NPU
decoder ONNX mixed_with_float Snapdragon® X2 Elite 3.724 ms 8 - 8 MB NPU
decoder ONNX mixed_with_float Snapdragon® X Elite 6.27 ms 16 - 16 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 4.661 ms 7 - 201 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 8.172 ms 5 - 9 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.975 ms 0 - 17 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 6.991 ms 5 - 8 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 6.27 ms 16 - 16 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 3.822 ms 3 - 149 MB NPU
decoder QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.106 ms 4 - 150 MB NPU
decoder QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 7.24 ms 0 - 142 MB NPU
decoder QNN_DLC float Snapdragon® X2 Elite 6.693 ms 4 - 4 MB NPU
decoder QNN_DLC float Snapdragon® X Elite 12.18 ms 4 - 4 MB NPU
decoder QNN_DLC float Snapdragon® 8 Gen 3 Mobile 8.742 ms 0 - 167 MB NPU
decoder QNN_DLC float Snapdragon® 8 Gen 1 Mobile 22.301 ms 0 - 164 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 25.675 ms 4 - 12 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.451 ms 4 - 6 MB NPU
decoder QNN_DLC float Qualcomm® QCS8450 22.301 ms 0 - 164 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 23.357 ms 6 - 13 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 12.18 ms 4 - 4 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 7.24 ms 0 - 142 MB NPU
decoder QNN_DLC float Qualcomm® SA8295P 24.666 ms 1 - 138 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 2.831 ms 4 - 151 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 3.867 ms 2 - 150 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® X2 Elite 4.096 ms 4 - 4 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® X Elite 6.532 ms 4 - 4 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Gen 3 Mobile 4.611 ms 0 - 190 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 7.918 ms 4 - 12 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.008 ms 4 - 6 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 6.726 ms 4 - 11 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 6.532 ms 4 - 4 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 3.867 ms 2 - 150 MB NPU
decoder TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.114 ms 1 - 148 MB NPU
decoder TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 7.242 ms 0 - 146 MB NPU
decoder TFLITE float Snapdragon® 8 Gen 3 Mobile 8.769 ms 1 - 201 MB NPU
decoder TFLITE float Snapdragon® 8 Gen 1 Mobile 22.253 ms 1 - 202 MB NPU
decoder TFLITE float Qualcomm® Dragonwing™ IQ-8275 25.556 ms 1 - 47 MB NPU
decoder TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.486 ms 1 - 3 MB NPU
decoder TFLITE float Qualcomm® SA8775P 468.372 ms 1 - 32 MB GPU
decoder TFLITE float Qualcomm® SA8650P 468.372 ms 1 - 32 MB GPU
decoder TFLITE float Qualcomm® SA8255P 468.372 ms 1 - 32 MB GPU
decoder TFLITE float Qualcomm® QCS8450 22.253 ms 1 - 202 MB NPU
decoder TFLITE float Qualcomm® Dragonwing™ IQ-9075 22.762 ms 1 - 46 MB NPU
decoder TFLITE float Qualcomm® Dragonwing™ Q-8750 7.242 ms 0 - 146 MB NPU
decoder TFLITE float Qualcomm® SA7255P 310.757 ms 1 - 31 MB GPU
decoder TFLITE float Qualcomm® SA8295P 24.744 ms 1 - 141 MB NPU
encoder ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 21.127 ms 5 - 310 MB NPU
encoder ONNX float Snapdragon® 8 Elite For Galaxy Mobile 25.57 ms 5 - 294 MB NPU
encoder ONNX float Snapdragon® X2 Elite 23.329 ms 12 - 12 MB NPU
encoder ONNX float Snapdragon® X Elite 41.419 ms 38 - 38 MB NPU
encoder ONNX float Snapdragon® 8 Gen 3 Mobile 30.642 ms 0 - 391 MB NPU
encoder ONNX float Snapdragon® 8 Gen 1 Mobile 72.114 ms 1 - 317 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-8275 67.619 ms 12 - 29 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 41.684 ms 13 - 15 MB NPU
encoder ONNX float Qualcomm® QCS8450 72.114 ms 1 - 317 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-9075 63.802 ms 12 - 28 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 41.419 ms 38 - 38 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ Q-8750 25.57 ms 5 - 294 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 22.191 ms 14 - 891 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 24.581 ms 14 - 833 MB NPU
encoder ONNX mixed_with_float Snapdragon® X2 Elite 21.679 ms 17 - 17 MB NPU
encoder ONNX mixed_with_float Snapdragon® X Elite 36.085 ms 22 - 22 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 29.986 ms 26 - 965 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 37.411 ms 12 - 27 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 37.522 ms 15 - 18 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 38.052 ms 12 - 27 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 36.085 ms 22 - 22 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 24.581 ms 14 - 833 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 19.916 ms 0 - 306 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 25.255 ms 0 - 286 MB NPU
encoder QNN_DLC float Snapdragon® X2 Elite 22.485 ms 12 - 12 MB NPU
encoder QNN_DLC float Snapdragon® X Elite 42.637 ms 12 - 12 MB NPU
encoder QNN_DLC float Snapdragon® 8 Gen 3 Mobile 33.553 ms 12 - 402 MB NPU
encoder QNN_DLC float Snapdragon® 8 Gen 1 Mobile 70.87 ms 12 - 320 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 67.587 ms 12 - 30 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 42.67 ms 12 - 15 MB NPU
encoder QNN_DLC float Qualcomm® QCS8450 70.87 ms 12 - 320 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 64.911 ms 14 - 31 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 42.637 ms 12 - 12 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 25.255 ms 0 - 286 MB NPU
encoder QNN_DLC float Qualcomm® SA8295P 72.06 ms 0 - 210 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 7.093 ms 12 - 267 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 8.821 ms 0 - 222 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® X2 Elite 8.61 ms 12 - 12 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® X Elite 16.454 ms 12 - 12 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Gen 3 Mobile 11.254 ms 12 - 306 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 15.818 ms 12 - 30 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 15.723 ms 12 - 200 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 16.854 ms 12 - 29 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 16.454 ms 12 - 12 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 8.821 ms 0 - 222 MB NPU
encoder TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 20.361 ms 24 - 341 MB NPU
encoder TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 24.907 ms 24 - 326 MB NPU
encoder TFLITE float Snapdragon® 8 Gen 3 Mobile 34.709 ms 24 - 451 MB NPU
encoder TFLITE float Snapdragon® 8 Gen 1 Mobile 67.596 ms 25 - 377 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ IQ-8275 68.743 ms 25 - 115 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 42.044 ms 25 - 28 MB NPU
encoder TFLITE float Qualcomm® SA8775P 1453.022 ms 25 - 36 MB CPU
encoder TFLITE float Qualcomm® SA8650P 1453.022 ms 25 - 36 MB CPU
encoder TFLITE float Qualcomm® SA8255P 1453.022 ms 25 - 36 MB CPU
encoder TFLITE float Qualcomm® QCS8450 67.596 ms 25 - 377 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ IQ-9075 65.226 ms 24 - 113 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ Q-8750 24.907 ms 24 - 326 MB NPU
encoder TFLITE float Qualcomm® SA7255P 209.025 ms 25 - 321 MB NPU
encoder TFLITE float Qualcomm® SA8295P 66.608 ms 25 - 253 MB NPU
pooler ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 18.193 ms 280 - 288 MB CPU
pooler ONNX float Snapdragon® 8 Elite For Galaxy Mobile 20.987 ms 278 - 290 MB CPU
pooler ONNX float Snapdragon® X2 Elite 17.165 ms 284 - 284 MB CPU
pooler ONNX float Snapdragon® X Elite 94.883 ms 283 - 283 MB CPU
pooler ONNX float Snapdragon® 8 Gen 3 Mobile 24.354 ms 278 - 288 MB CPU
pooler ONNX float Snapdragon® 8 Gen 1 Mobile 38.711 ms 278 - 294 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ IQ-8275 60.993 ms 274 - 278 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 28.206 ms 271 - 273 MB CPU
pooler ONNX float Qualcomm® QCS8450 38.711 ms 278 - 294 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ IQ-9075 48.482 ms 277 - 281 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ IQ-X7181 94.883 ms 283 - 283 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ Q-8750 20.987 ms 278 - 290 MB CPU
pooler ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 17.039 ms 280 - 289 MB CPU
pooler ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 23.566 ms 277 - 285 MB CPU
pooler ONNX mixed_with_float Snapdragon® X2 Elite 16.931 ms 284 - 284 MB CPU
pooler ONNX mixed_with_float Snapdragon® X Elite 61.508 ms 283 - 283 MB CPU
pooler ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 22.295 ms 281 - 290 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 65.72 ms 274 - 278 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 27.91 ms 298 - 299 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 48.33 ms 277 - 281 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 61.508 ms 283 - 283 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 23.566 ms 277 - 285 MB CPU
pooler QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 214.446 ms 4 - 13 MB CPU
pooler QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 188.072 ms 4 - 17 MB CPU
pooler QNN_DLC float Snapdragon® X2 Elite 322.512 ms 4 - 4 MB CPU
pooler QNN_DLC float Snapdragon® X Elite 341.085 ms 4 - 4 MB CPU
pooler QNN_DLC float Snapdragon® 8 Gen 3 Mobile 172.166 ms 5 - 15 MB CPU
pooler QNN_DLC float Snapdragon® 8 Gen 1 Mobile 220.607 ms 4 - 22 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 371.538 ms 269 - 736 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 194.089 ms 2 - 496 MB CPU
pooler QNN_DLC float Qualcomm® QCS8450 220.607 ms 4 - 22 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 345.362 ms 272 - 740 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 341.085 ms 4 - 4 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ Q-8750 188.072 ms 4 - 17 MB CPU
pooler QNN_DLC float Qualcomm® SA8295P 308.576 ms 4 - 15 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 216.724 ms 4 - 19 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 184.984 ms 4 - 14 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® X2 Elite 318.682 ms 3 - 3 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® X Elite 367.682 ms 4 - 4 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® 8 Gen 3 Mobile 167.71 ms 5 - 14 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 366.121 ms 269 - 736 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 194.577 ms 4 - 8 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 326.164 ms 271 - 739 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 367.682 ms 4 - 4 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 184.984 ms 4 - 14 MB CPU
pooler TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 47.47 ms 127 - 142 MB CPU
pooler TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 52.602 ms 127 - 139 MB CPU
pooler TFLITE float Snapdragon® 8 Gen 3 Mobile 52.661 ms 126 - 138 MB CPU
pooler TFLITE float Snapdragon® 8 Gen 1 Mobile 78.637 ms 128 - 144 MB CPU
pooler TFLITE float Qualcomm® Dragonwing™ IQ-8275 126.985 ms 127 - 321 MB CPU
pooler TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 69.796 ms 129 - 430 MB CPU
pooler TFLITE float Qualcomm® SA8775P 93.698 ms 128 - 138 MB CPU
pooler TFLITE float Qualcomm® SA8650P 93.698 ms 128 - 138 MB CPU
pooler TFLITE float Qualcomm® SA8255P 93.698 ms 128 - 138 MB CPU
pooler TFLITE float Qualcomm® QCS8450 78.637 ms 128 - 144 MB CPU
pooler TFLITE float Qualcomm® Dragonwing™ IQ-9075 104.284 ms 127 - 320 MB CPU
pooler TFLITE float Qualcomm® Dragonwing™ Q-8750 52.602 ms 127 - 139 MB CPU
pooler TFLITE float Qualcomm® SA7255P 109.046 ms 127 - 137 MB CPU
pooler TFLITE float Qualcomm® SA8295P 95.691 ms 128 - 133 MB CPU

License

  • The license for the original implementation of BEVDet can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/BEVDet