What is Project Mariner
Project Mariner is a browser assistant launched by Google DeepMind. Project Mariner is based on Gemini 2.0 technology and uses a Chrome extension to implement browser automation, understand and execute web tasks. Project Mariner can understand and reason about the information on the browser screen, including pixels and web elements, and use this information to complete tasks based on the Chrome extension. Project Mariner can control the Chrome browser, move the cursor on the screen, click buttons, and fill out forms, using and browsing websites like a human. Project Mariner achieved a high score of 83.5% on the WebVoyager benchmark test. Currently, Project Mariner can only perform typing, scrolling, and clicking operations in the active tab of the browser, and before performing certain sensitive operations (such as purchasing items), it will ask the user for final confirmation.
Main features of Project Mariner
- Multimodal understanding: Understands all content on the browser screen, including data such as pixels, text, code, images, and forms.
- Browser interaction: Navigates and operates complex websites in real time, automatically performs tasks in the browser, and keeps the user in control.
- Task automation: Automatically interacts with the browser, organizes and fills data into other areas of the web page, and organizes the data according to the user's requirements.
- Complex instruction handling: Understands and executes complex user instructions, breaking them down into executable steps.
- Relationship understanding: Understands the relationships between different web page elements and their functions.
- Visual feedback: Provides visual feedback and updates while performing tasks, letting users know the progress.
- Security: Before performing sensitive operations (such as shopping and payment), it will ask the user for final confirmation to ensure security.
How to use Project Mariner
Project Mariner is currently in an early testing stage and is only open to a small number of testers. Visit Project Mariner'sofficial websiteto join the waiting list.
Application scenarios of Project Mariner
- Data organization and copying: Copy data from web pages into spreadsheets for organization, for example, extracting information from web pages that store large amounts of data and organizing it into spreadsheet software such as Excel.
- Online shopping: According to the shopping list provided by the user, automatically search for products on e-commerce websites and add them to the shopping cart.
- Travel planning: Help users find flight and hotel information, and automate web browsing and information comparison during the travel planning process.
- Everyday shopping: Shop for users on retail websites, such as searching for and purchasing household items.
- Recipe search: Automatically search for and select recipes on recipe websites according to user needs.