Rabbit Android Agent: voice-controlled intelligence for Android applications (not open)

General Introduction

Rabbit Android Agent is an innovative AI intelligence developed by Rabbit, designed to help users accomplish single- or multi-step tasks on Android devices through voice and text commands. Based on Rabbit's LAM (Large Action Model), the technology understands user intent and manipulates apps and system settings on Android devices. From changing notification settings to collaborating across apps to generate documents, this intelligence shows the potential for the future of human-computer interaction. Currently in research preview, Rabbit has demonstrated its initial capabilities through blogs and videos, and plans to incorporate it into an upcoming cross-platform multi-intelligence system that will provide users with a smarter, more autonomous experience.

Function List

• System setup adjustments: Modify notification settings or other system parameters of your Android device with simple commands.
• Cross-application task coordination: The ability to switch between multiple applications and perform complex tasks such as extracting information from the Notes application and generating documents.
• Messaging: Support for sending AI-generated content, such as poetry or text, in apps like WhatsApp.
• Content search and playback: Search for and play a specific video on platforms such as YouTube.
• Inventory management: Extract information from apps and add it to inventory tools like Google Keep.
• Games to download and learn: Download games from Google Play and learn to play them via voice commands.

Using Help

Rabbit Android Agent is currently in the research preview stage and has not yet been officially released for public download, so there is no clear installation process. However, based on Rabbit's official blog and video demonstrations, we can speculate on its future use and provide users with detailed operating instructions. The following content is based on existing information and is intended to help users understand and prepare for the use of this smart body.

Installation and Preparation

While it is currently not possible to download Rabbit Android Agent directly, it may be installed in the future via the following steps, based on the conventions of similar AI smart body apps:

1. Visit the Google Play StoreWhen it goes live, users will be able to search for "Rabbit Android Agent" in the Google Play store on their Android devices.
2. Download and install: Click the "Install" button and wait for the app to finish downloading. The installation process is the same as a normal Android app, no additional configuration is required.
3. authority authorization: When opening an app for the first time, the system prompts to grant necessary permissions, such as access to the app, storage and microphone permissions, to ensure that the smart body can operate the device properly.
4. Login or Register: You may need to log in with a Rabbit account, similar to Rabbit R1's Rabbithole system, to synchronize user data and task records.

After the installation is completed, users can interact with the smart body through voice or text. Below is the detailed operation procedure for specific functions:

Function Operation Guide

1. System set-up adjustments

• Operating Scenarios: Want to turn off push notifications for an app.
• Procedure for use::
  1. Open the Rabbit Android Agent application.
  2. Tap the voice input button (or enter text directly) and say, "Turn off notifications for [app name]."
  3. The Intelligent Society will automatically jump to the system settings page and find the settings of the corresponding application.
  4. The operation process will be displayed on the screen and the user can view the confirmation in real time.
  5. Upon completion, the smart body will return results, such as a voice note: "Notifications for [app name] are turned off."
• caveat: Ensure that the name of the application is accurate to avoid intelligences misinterpreting instructions.

2. Cross-application task coordination

• Operating Scenarios: Get business ideas from Google Keep and generate Google Docs documents.
• Procedure for use::
  1. Launch the app and activate voice mode.
  2. Enter the instruction, "Extract my business idea from Google Keep, generate a revenue plan and save it to Google Docs."
  3. The smart body will first open Google Keep and recognize notes that contain "business ideas".
  4. Then jump to Google Docs, create a new document and enter the relevant content.
  5. When the operation is complete, the smart body will prompt, "The revenue plan has been saved to Google Docs."
• Featured Details: Supports multi-step collaboration, reducing the need to manually switch between applications.

3. Messaging

• Operating Scenarios: Send an AI-generated poem via WhatsApp.
• Procedure for use::
  1. Open the app and enter voice mode.
  2. Say: "Generate a poem about the moon and send it to [contact name] via WhatsApp."
  3. The smart body will use the built-in AI to generate poems (possibly line by line).
  4. Then open WhatsApp, find the specified contact and send it.
  5. After a successful send, there will be voice feedback, "Poetry has been sent to [contact name]."
• tip: If there is a duplicate contact name, it is recommended that more information be added, such as "Send to my friend Xiaoming".

4. Content search and playback

• Operating Scenarios: Search for and play cat videos on YouTube.
• Procedure for use::
  1. Launch the app and use voice input.
  2. Say, "Search for cat videos on YouTube and play them."
  3. Your smartphone will open the YouTube app and type in the keyword "cat videos".
  4. Select a video from the search results and start playing.
  5. Once playback begins, the smart body will prompt, "The cat video has begun to play."
• Optimization Recommendations: You can specify the type of video, e.g. "Search for funny cat videos".

5. Inventory management

• Operating Scenarios: Pull ingredients from the Recipes app and add them to Google Keep.
• Procedure for use::
  1. Open the app and enter voice mode.
  2. Type in, "Get cocktail recipe ingredients from [recipe app name] to add to your Google Keep list."
  3. The Smart Society will open the Recipes app and find the relevant recipe.
  4. After extracting the list of ingredients, jump to Google Keep to create a new list and add it.
  5. When finished it prompts, "Ingredients have been added to Google Keep."
• caveat: Make sure the Recipes app is installed and logged in.

6. Game downloads and learning

• Operating Scenarios: Download and learn to play the 2048 game.
• Procedure for use::
  1. Launch the app and activate the voice function.
  2. Says "Download the 2048 game from Google Play and teach me how to play it."
  3. Your smartphone will open Google Play, search for and download "2048".
  4. Once the download is complete, open the game and simulate the action with a voice explanation of the rules.
  5. Tip: "2048 has been downloaded, I have demonstrated how to play it, please try it."
• Featured Highlights: Explained while operating, suitable for novice users.

Tips and Precautions for Use

• clear voice: Try to use it in a quiet environment to ensure that commands are recognized accurately.
• Step-by-step instructions: Complex tasks can be broken down into multi-step commands, such as saying "open YouTube" and then "search for videos".
• Inspection results: After the smart body operation, the screen displays the process and suggests checking that the results are as expected.
• continual improvement: Rabbit says it will optimize speed and accuracy in the future, so users can keep an eye out for official updates.

The core advantage of Rabbit Android Agent is its cross-application capability, which reduces the need for users to manually switch between applications. If it is integrated into a cross-platform system in the future, it may further enhance its usefulness.