AndroidWorld benchmark
mobile-use solved all 116 AndroidWorld tasks.
Our open-source agent, on Google DeepMind’s benchmark. mini is the QA agent we built next.
mobile-use on AndroidWorld
116/116
- mobile-useopen source
- google/artemisuses mobile-use
miniour QA agent, built next
How to read this result.
What was measured
Tasks in plain words on an Android emulator, checked against device state.
How to check it
The code is open source, the paper is public, every task is below.
When
116 of 116 in January 2026. The paper followed on 8 February.
What it doesn’t tell you
QA accuracy on production apps. mini has no score here.
All 116 tasks, by app.
By AndroidWorld id. mobile-use solved each one.
Simple Calendar Pro17/17 solved
SimpleCalendarAddOneEventSimpleCalendarAddOneEventInTwoWeeksSimpleCalendarAddOneEventRelativeDaySimpleCalendarAddOneEventTomorrowSimpleCalendarAddRepeatingEventSimpleCalendarAnyEventsOnDateSimpleCalendarDeleteEventsSimpleCalendarDeleteEventsOnRelativeDaySimpleCalendarDeleteOneEventSimpleCalendarEventOnDateAtTimeSimpleCalendarEventsInNextWeekSimpleCalendarEventsInTimeRangeSimpleCalendarEventsOnDateSimpleCalendarFirstEventAfterStartTimeSimpleCalendarLocationOfEventSimpleCalendarNextEventSimpleCalendarNextMeetingWithPerson
Settings16/16 solved
OpenAppTaskEvalSystemBluetoothTurnOffSystemBluetoothTurnOffVerifySystemBluetoothTurnOnSystemBluetoothTurnOnVerifySystemBrightnessMaxSystemBrightnessMaxVerifySystemBrightnessMinSystemBrightnessMinVerifySystemCopyToClipboardSystemWifiTurnOffSystemWifiTurnOffVerifySystemWifiTurnOnSystemWifiTurnOnVerifyTurnOffWifiAndTurnOnBluetoothTurnOnWifiAndOpenApp
Markor14/14 solved
MarkorAddNoteHeaderMarkorChangeNoteContentMarkorCreateFolderMarkorCreateNoteMarkorCreateNoteAndSmsMarkorCreateNoteFromClipboardMarkorDeleteAllNotesMarkorDeleteNewestNoteMarkorDeleteNoteMarkorEditNoteMarkorMergeNotesMarkorMoveNoteMarkorTranscribeReceiptMarkorTranscribeVideo
Broccoli13/13 solved
RecipeAddMultipleRecipesRecipeAddMultipleRecipesFromImageRecipeAddMultipleRecipesFromMarkorRecipeAddMultipleRecipesFromMarkor2RecipeAddSingleRecipeRecipeDeleteDuplicateRecipesRecipeDeleteDuplicateRecipes2RecipeDeleteDuplicateRecipes3RecipeDeleteMultipleRecipesRecipeDeleteMultipleRecipesWithConstraintRecipeDeleteMultipleRecipesWithNoiseRecipeDeleteSingleRecipeRecipeDeleteSingleWithRecipeWithNoise
Pro Expense9/9 solved
ExpenseAddMultipleExpenseAddMultipleFromGalleryExpenseAddMultipleFromMarkorExpenseAddSingleExpenseDeleteDuplicatesExpenseDeleteDuplicates2ExpenseDeleteMultipleExpenseDeleteMultiple2ExpenseDeleteSingle
OpenTracks6/6 solved
SportsTrackerActivitiesCountForWeekSportsTrackerActivitiesOnDateSportsTrackerActivityDurationSportsTrackerLongestDistanceActivitySportsTrackerTotalDistanceForCategoryOverIntervalSportsTrackerTotalDurationForCategoryThisWeek
Simple SMS Messenger6/6 solved
SimpleSmsReplySimpleSmsReplyMostRecentSimpleSmsResendSimpleSmsSendSimpleSmsSendClipboardContentSimpleSmsSendReceivedAddress
Tasks6/6 solved
TasksCompletedTasksForDateTasksDueNextWeekTasksDueOnDateTasksHighPriorityTasksTasksHighPriorityTasksDueOnDateTasksIncompleteTasksOnDate
Joplin4/4 solved
NotesIsTodoNotesMeetingAttendeeCountNotesRecipeIngredientCountNotesTodoItemCount
Retro Music4/4 solved
RetroCreatePlaylistRetroPlayingQueueRetroPlaylistDurationRetroSavePlaylist
Chrome3/3 solved
BrowserDrawBrowserMazeBrowserMultiply
Clock3/3 solved
ClockStopWatchPausedVerifyClockStopWatchRunningClockTimerEntry
OsmAnd3/3 solved
OsmAndFavoriteOsmAndMarkerOsmAndTrack
Audio Recorder2/2 solved
AudioRecorderRecordAudioAudioRecorderRecordAudioWithFileName
Camera2/2 solved
CameraTakePhotoCameraTakeVideo
Contacts2/2 solved
ContactsAddContactContactsNewContactDraft
Files2/2 solved
FilesDeleteFileFilesMoveFile
VLC2/2 solved
VlcCreatePlaylistVlcCreateTwoPlaylists
Simple Draw Pro1/1 solved
SimpleDrawProCreateDrawing
Simple Gallery Pro1/1 solved
SaveCopyOfReceiptTaskEval
Good questions.
Did mini score 116 of 116?
No. mobile-use, our open-source agent, did. mini is the QA agent we built next. It writes, runs and maintains tests on iOS, Android and web, and has no AndroidWorld score.
Why does the paper say Minitap?
The paper names the system after the company. Its code is mobile-use, linked from the abstract. mini is a different, newer agent.Read the paper
How was it measured?
Our paper reports the result under the official AndroidWorld evaluation protocol, without modification, and lists the models used. Google’s Artemis uses mobile-use.
How do other agents compare?
In our 8 February 2026 paper (Table 1): AGI-0 97.4%, askui 94.8%, gbox.ai 86.2% and Z.AI 80.2%. H Company reported 87.1% for Surfer 2 in October 2025. Each is a published result, dated above.See Table 1
What does this mean for testing my app?
AndroidWorld shows an agent can finish real tasks on an Android emulator. Testing your app needs more. mini learns your product, writes the tests and their acceptance criteria, runs them on real devices, simulators and browsers, and keeps the suite current as your app changes.How mini tests your app
Bring your hardest flow.
Bring a build. We run mini on it during the call, and you leave with the report.