Description
MLPerf Mobile Inference Benchmark is an open-source benchmark suite for measuring how fast mobile devices (e.g. phones, laptops) can run AI tasks. The benchmark is supported by the MLPerf Mobile App which currently supports Android and iOS. Please see the MLPerf Mobile Inference benchmark paper for a detailed description of the benchmarks along with the motivation and guiding principles behind the benchmark suite.
Release Notes
New features
- Added a new benchmark task: Image Classification v2
- Implemented a new design for various screens.
- Added the ability to manage your uploaded results directly in the app.
- Added a web interface to view uploaded results (https://mlperf-mobile.mlcommons.org)
Bug fixes and other changes
- Integrated with Firebase Crashlytics to identify and fix app crashes.
- Updated and improved CI&CD system.
Full Changelog: v3.1...v4.0
Supported SOCs
Mediatek
- Dimensity 9000 series (9000/9000+/9200/9200+/9300/9300+)
- Dimensity 8000 series (8000/8020/8050/8100/8200)
Qualcomm
- Snapdragon 8 Gen 3
- Snapdragon 8s Gen 3
- Snapdragon 7 Gen 3
- Snapdragon 8 Gen 2
- Snapdragon 7+ Gen 2
- Snapdragon 8+ Gen 1
- Snapdragon 8 Gen 1
- Snapdragon 7 Gen 1
- Snapdragon 888
- Snapdragon 778
Samsung
- Exynos 2400
- Exynos 2300
- Exynos 2200
- Exynos 2100
- Exynos 990
Google Pixel
- Pixel 8 and Pixel 8 Pro (Tensor G3 SoC)
- Pixel 7 and Pixel 7 Pro (Tensor G2 ScC)
- Pixel 6 and Pixel 6 Pro (Tensor G1 ScC)
MLPerf Mobile 4.0 will also run on a host of other devices via our default path, which uses TensorFlow Lite on Android devices.
Installation instructions
- Allow installation of unknown apps in Settings > Apps > Special Access.
- Download the MLPerf Mobile APK.
- Find the APK in 'Downloads' or file browser.
- Tap the APK file. Approve installation when prompted.
- Confirm 'Install'.
- Once installed, tap 'Open' to launch MLPerf Mobile.
SHA256 of mlperfbench-v4.0-qsmgt.apk: 816ceb4358b5dc5c90f3e67f72cbadd94531f265799403124a1b1dfe0b56a9a9