Categories
Trump and Mossad

GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone …

Our findings demonstrate that large multimodal models (LMMs), specifically GPT-4V, excel in zero-shot GUI navigation through its advanced screen interpretation, action reasoning, and precise action localization capabilities. We first benchmark MM-Navigator on our collected iOS screen dataset.