🏠Stalecollected in 83m

Gemini Enables Multi-Step Tasks on Phones

Gemini Enables Multi-Step Tasks on Phones
PostLinkedIn
🏠Read original on IT之家
#agentic-ai#on-device-detection#android-geminigoogle-gemini-android-featuresgooglegeminigalaxy-s26pixel-10

💡Gemini's phone agents automate rides/shopping—new benchmark for mobile LLM apps

⚡ 30-Second TL;DR

What Changed

Gemini automates multi-step tasks (e.g., booking rides) in background with user monitoring

Why It Matters

Advances agentic AI on mobile, enabling practical automation for everyday tasks and improving user safety via on-device processing. Developers gain new Gemini tools for Android integration.

What To Do Next

Prototype Gemini multi-step task delegation in your Android app using the beta rollout on Pixel 10.

Who should care:Developers & AI Engineers

Key Points

  • Gemini automates multi-step tasks (e.g., booking rides) in background with user monitoring
  • Circle to Search upgrades for multi-object detection and outfit virtual try-on
  • On-device Gemini scam detection for calls and messages, alerts on fraud patterns
  • Initially US/Korea for food/grocery/ride apps on Galaxy S26/Pixel 10
  • Phone scam detection off by default, unused with contacts

🧠 Deep Insight

Background and context from public sources — not the original article. 8 sources cited.

🔑 Enhanced Key Takeaways

  • Multi-step automations execute in a secure virtual environment (sandbox) on the device, limiting Gemini's access to only specified apps and preventing broader data exposure.
  • Scam Detection for phone calls, powered by Gemini, previously launched on Pixel devices in the US, Australia, Canada, India, Ireland, and UK before expanding to Galaxy S26 in the US.
  • Gemini scam text detection uses on-device models and is initially available on Pixel 10 series in the US, Canada, and UK, with upcoming support for Galaxy S26.
  • Feature rollout is in beta with real-time user monitoring, explicit initiation required, and ability to intervene or stop tasks during execution.
📊 Competitor Analysis▸ Show
FeatureGoogle Gemini (Android)Apple Siri (iOS)OpenAI ChatGPT
Multi-step Task AutomationBeta for rideshare/food/grocery on Pixel 10/Galaxy S26 (US/Korea); on-device sandbox [1][2][4]Teased at WWDC 2025, limited beta with third-party app integration [1][3]Scheduled tasks, agent for computer tasks like calendar/slideshow/code; not mobile app-focused [4]
Scam DetectionOn-device for calls (Pixel/S26) and texts (Pixel 10); English/US initial [2][4]Not mentioned in sourcesNot applicable
PricingFree with eligible devicesFree with iOS devicesSubscription-based (ChatGPT Plus)
BenchmarksLower latency via on-device; 3B+ Android devices [1][5]Beta limitations; smaller iOS baseCloud-dependent; broader agent testing [1][3]

🛠️ Technical Deep Dive

  • Automations leverage Android's deep OS integration, likely using accessibility APIs for navigating third-party app UIs, handling authentication, and applying user preferences without constant input.
  • On-device execution in a constrained sandbox ensures privacy, low latency, and limited app access, distinguishing from cloud-heavy competitors.
  • Scam detection employs local Gemini models for real-time analysis of call patterns and text content, processing entirely on-device.

🔮 Future ImplicationsAI analysis grounded in cited sources

Gemini multi-step tasks will expand beyond initial US/Korea and app categories by end of 2026
Sources indicate beta status with plans to extend scam detection to more devices and regions, signaling phased global rollout for automations.
Android's 3B+ device base positions Google to lead consumer AI agents over iOS
Google's on-device focus and massive install base provide distribution advantage while Apple's features remain in limited beta.
On-device AI will drive higher daily user reliance on Gemini vs cloud assistants
Features emphasize faster responses, privacy, and managed autonomy in real mobile apps, aligning with mobile user expectations.

Timeline

2025-06
Apple previews Siri multi-step automation at WWDC, influencing Google's competitive push
2025
Gemini Scam Detection launches on Pixel devices in US, Australia, Canada, India, Ireland, UK
2026-02
Gemini replaces Google Assistant on Android with advanced on-device capabilities
📰

Weekly AI Recap

Read this week's curated digest of top AI events →

👉Related Updates

AI-curated news aggregator. All content rights belong to original publishers.
Original source: IT之家

This is a summary, not the original. Read the source, or get the weekly briefing.

Weekly AI briefing

One email a week. Unsubscribe anytime.