Real Frigate hardware benchmarks from real builds.

1. 1
   AMD RX 9060 XT 16GBROCm (AMD)
   5 ms1 build · docs
2. 2
   Nvidia RTX 5060 TiONNX (Nvidia / GPU)
   7 ms1 build · docs
3. 3
   Apple M3 ProApple Silicon
   8 ms1 build · docs
4. 4
   Intel Iris Xe (iGPU)OpenVINO (Intel)
   8 ms1 build · docs
5. 5
   Nvidia RTX 3070ONNX (Nvidia / GPU)
   8 ms1 build · docs
6. 6
   AMD XDNA2 NPU (Strix Halo)AMD XDNA2 NPU
   9 ms1 build · docs
7. 7
   Apple M1Apple Silicon
   9 ms1 build · docs
8. 8
   Apple M4Apple Silicon
   10 ms1 build · docs

Median of builds marked usable for stats; 20 devices have data for this model. Bars show relative throughput. “docs” rows are the Frigate project’s own reference numbers, which are approximate.

1. 1
   Nvidia RTX 5070 TiONNX (Nvidia / GPU)
   10.5 ms1 build · community
2. 2
   Intel UHD 730 (12th-14th gen iGPU)OpenVINO (Intel)
   17.5 ms1 build · community
3. 3
   Intel Arc A310OpenVINO (Intel)
   20 ms1 build · community
4. 4
   Intel HD 530 (6th-gen iGPU)OpenVINO (Intel)
   30 ms1 build · community

Median of community builds marked usable for stats; 4 devices have community data for this model. Bars show relative throughput. “docs” rows are the Frigate project’s own reference numbers, which are approximate.

1. 1
   AMD RX 9060 XT 16GBROCm (AMD)
   6 ms1 build · docs
2. 2
   Intel Arc A310OpenVINO (Intel)
   8 ms1 build · docs
3. 3
   Intel Arc A750OpenVINO (Intel)
   8 ms1 build · docs
4. 4
   Nvidia RTX 3070ONNX (Nvidia / GPU)
   8 ms1 build · docs
5. 5
   Intel Arc A380OpenVINO (Intel)
   10 ms1 build · docs
6. 6
   Intel Iris Xe (iGPU)OpenVINO (Intel)
   10 ms1 build · docs
7. 7
   Nvidia RTX 3050ONNX (Nvidia / GPU)
   10 ms1 build · docs
8. 8
   Intel NPU (Core Ultra)OpenVINO (Intel)
   14 ms1 build · docs

Median of builds marked usable for stats; 19 devices have data for this model. Bars show relative throughput. “docs” rows are the Frigate project’s own reference numbers, which are approximate.

Median of community builds marked usable for stats; 2 devices have community data for this model. Bars show relative throughput. “docs” rows are the Frigate project’s own reference numbers, which are approximate.

1. 1
   AMD RX 9060 XT 16GBROCm (AMD)
   4 ms1 build · docs
2. 2
   Nvidia RTX 5060 TiONNX (Nvidia / GPU)
   5 ms1 build · docs
3. 3
   Apple M3 ProApple Silicon
   6 ms1 build · docs
4. 4
   Intel Iris Xe (iGPU)OpenVINO (Intel)
   6 ms1 build · docs
5. 5
   Nvidia RTX 3070ONNX (Nvidia / GPU)
   6 ms1 build · docs
6. 6
   Intel Arc A310OpenVINO (Intel)
   7 ms1 build · docs
7. 7
   AMD XDNA2 NPU (Strix Halo)AMD XDNA2 NPU
   7.4 ms1 build · docs
8. 8
   Nvidia RTX 3050ONNX (Nvidia / GPU)
   8 ms1 build · docs

Median of builds marked usable for stats; 15 devices have data for this model. Bars show relative throughput. “docs” rows are the Frigate project’s own reference numbers, which are approximate.

Median of community builds marked usable for stats; 2 devices have community data for this model. Bars show relative throughput. “docs” rows are the Frigate project’s own reference numbers, which are approximate.

1. 1
   Intel Arc A310OpenVINO (Intel)
   15 ms1 build · docs
2. 2
   Intel Iris Xe (iGPU)OpenVINO (Intel)
   16 ms1 build · docs
3. 3
   AMD XDNA2 NPU (Strix Halo)AMD XDNA2 NPU
   20 ms1 build · docs
4. 4
   Apple M3 ProApple Silicon
   20 ms1 build · docs
5. 5
   Nvidia RTX 5060 TiONNX (Nvidia / GPU)
   22 ms1 build · docs
6. 6
   Nvidia RTX 3070ONNX (Nvidia / GPU)
   25 ms1 build · docs
7. 7
   Nvidia RTX 3050ONNX (Nvidia / GPU)
   28 ms1 build · docs
8. 8
   Intel NPU (Core Ultra)OpenVINO (Intel)
   30 ms1 build · docs

Median of builds marked usable for stats; 12 devices have data for this model. Bars show relative throughput. “docs” rows are the Frigate project’s own reference numbers, which are approximate.

Median of community builds marked usable for stats; 2 devices have community data for this model. Bars show relative throughput. “docs” rows are the Frigate project’s own reference numbers, which are approximate.