Workflow: Agentic Competitor Research with Chrome ‘Project Jarvis’

Google is turning Chrome from a passive viewer into an active Agent. Codenamed “Project Jarvis,” this new feature uses Computer Use capabilities to navigate the web for you.

How “Auto Browse” Works

Unlike standard chatbots, Jarvis “sees” your screen. It takes screenshots, interprets the buttons, and moves a virtual cursor.

1. Input: “Find the cheapest hotel in Tokyo for May 12-15 under $200.”
2. Reasoning: Jarvis opens Booking.com, Expedia, and Airbnb.
3. Action: It filters, clicks, and presents a comparison table in the side panel.
4. Execution: It proceeds to checkout (requiring your final confirmation).

⚠️ The Security Trade-off

Giving an AI control of your browser is risky. Google ensures transparency by showing a Side Panel Log of every action. However, experts warn about “Prompt Injection” attacks where malicious websites could trick the agent.

Check Proficiency in Chrome