Rabbit Teams Up With ElevenLabs for Life-like Voice Control on Rabbit R1 AI Device

Updated on March 30 2024
image

As a key step to improve human-device interaction, Rabbit Inc, makers of Rabbit R1, partnered up with ElevenLabs, one of the top player in voice cloning & text to speech space. This seems like well thought of step by Rabbit Inc, a company that intrigued onlookers at Consumer Electronics Show (CES 2024) earlier this year with its glitzy showcase of the Rabbit R1 AI device and captured the world’s attention overnight.

The collaboration between Rabbit Inc and ElevenLabs is intended to empower the Rabbit R1 AI devices with the enhanced voice command capabilities. The first stage will feature voice command in English with only one voice availability to demonstrate the ElevenLabs’ capabilities enhancing human interaction with its low latency models.

ElevenLabs’ CEO, Matthew Staniszewski, pointed out the collaboration’s goal:

Together with Rabbit, we’re striving to bring the future of human-device interaction closer. We’re building a platform that will make the Rabbit R1 devices a truly dynamic co-pilot.

The Rabbit R1

Rabbit R1 Price

Rabbit R1 sparked up imagination in CES 2024 when it emphasized the use of Large Action Models (LAMs) for AI to be much more effective, personalized and action driven.

Explore More: What Is Rabbit R1 

Rabbit R1 release date

The Rabbit R1 device, priced at $199, is set to leave the factory by March 31 and will reach users within a few weeks. It promises a wide range of functionalities right out of the box, including the ability to interact with chatbots, get answers from Perplexity AI, use bi-directional translation, order rides and foods, and play music.

Rabbit R1 preorder

Rabbit Inc CEO, Jesse Lyu, has also mentioned that the company is close to having 100,000 device orders, indicating a strong demand for the Rabbit R1 devices. At $199, the Rabbit R1 will present a great option for cost-conscious and pragmatic consumers who want an AI friend which is easy to use, tailor-made and also powerful.

Also Read: 10k Rabbit R1 Pre Ordered within a day – Is it worth it? [Opinion]

How does Rabbit R1 device work with voice commands?

The voice command technology in the Rabbit R1 devices is powered by a unique combination of software and hardware designed to facilitate a wide range of tasks without the need for a smartphone. This technology is built around Rabbit OS, an operating system that leverages a “Large Action Model” (LAM) to interact with various apps and services directly. Here’s how it works:

Large Action Model (LAM): The LAM is a key component of the Rabbit R1’s functionality. It acts as a universal controller for apps, allowing the device to trigger services across different platforms and devices. The LAM was trained by humans interacting with apps like Spotify and Uber, learning how to recognize icons, confirm orders, and navigate menus. This learning process enables the Rabbit R1 to perform tasks on any app, essentially acting as a personal assistant that can control music, order rides, buy groceries, and more, all through a single interface.

Voice Commands: The R1 uses a push-to-talk button to activate voice commands. Unlike traditional voice assistants that constantly listen for wake words, the Rabbit R1’s microphone only activates when the button is pressed, ensuring privacy and efficiency. Users can ask the device to perform tasks, such as ordering an Uber or adding items to a shopping cart, and the Rabbit R1 will execute these commands using the LAM.

Privacy and Security: Rabbit has designed the Rabbit R1 with privacy and security in mind. The device does not store user credentials for third-party services, and all authentication happens on the third-party service’s login systems. Users have the option to unlink Rabbit OS’s access at any time and delete any stored data. Additionally, the Rabbit R1’s camera, known as the “Rabbit Eye,” can be used as a privacy shutter, blocking the lens when not in use.

Experimental “Teach Mode”: An upcoming feature, the “teach mode,” allows users to train the Rabbit R1 on specific tasks by demonstrating them on their desktop or phone. This feature enables users to automate niche tasks they would prefer to handle themselves, such as removing watermarks in Adobe Photoshop or playing video games.

Hardware and Design: The Rabbit R1 is a compact device with a 2.88-inch touchscreen, a rotating camera, a button for voice commands, and a scroll wheel for navigation. It features a 2.3GHz MediaTek processor, 4GB of memory, and 128GB of storage, designed in collaboration with Teenage Engineering. The device is designed to be lightweight and portable, with a focus on user-friendly design.

Key Points of Rabbit R1 and Elevenlabs’ Collaboration

English Voice Commands: At first, this option will be offered only in English with one voice available. Rabbit R1 intends to include a support of additional languages in the next version.

Human-Like Interactions: The responsiveness of the Rabbit R1 model is made more human-like by the use of low-latency models from ElevenLabs. You will find the dialogue with your virtual assistant to be straightforward and thrilling.

Voice Cloning Services: ElevenLabs, known as a specialist in voice cloning, goes further by refining its technology, resulting in the most natural human voice interactions possible. The Rabbit R1’s responses will be more than just bots complaining—they’ll have sense and be entertaining.

Also Read: Rabbit R1 Will Use Perplexity AI as Their Answer Engine

Performance and Battery life of Rabbit R1

The integration of voice command technology provided by ElevenLabs into Rabbit R1 device will be expected to increase the users experience level by creating a more natural and human-like communication between the device and the user.

Performance impact

Low Latency Models: Along with the recent flexible, low-latency models of ElevenLabs, the command processing should be quick and responsive. This, in turn, might improve the efficiency and the intuitiveness of the user interface, due to the fact that the delay between voice requests and responses will be much shorter.

AI-Powered Features: The Rabbit R1 device features LAM (Large Action Model) with a higher level of understanding that processes complicated instructions. ElevenLabs’ voice technology is expected to be another step in improving the virtual assistant’s capabilities, letting it evaluate more complex voice-controlled interactions.

Battery life impact

AI Processing: The Rabbit R1 device uses a MediaTek MT6765 octa-core (Helio P35) processor to power her and the 4GB of RAM signifies for the advanced processing capacity. On the other hand, AI based features like voice command require more resources. This might result in raised power consumption, which in turn, can lead to shortened battery life.

Optimization and Cloud Updates: The developers of Rabbit R1 plan to start from very simple apps that people are already used to, and then conduct a very serious testing process. The major effort made by users in the Rabbit R1 will be consequently considerably small, with many changes performed in the cloud.

Conclusion

It is worth noting that cooperation between Rabbit Inc and ElevenLabs is a real breakthrough in the audio command technology history. ElevenLabs’ advanced voice command features in Rabbit R1 devices will make the interactions easier and will improve the command recognition capabilities of Rabbit R1 devices with time. Subsequently, such cooperation takes users’ experience to a higher level, and changes the way humans and device interact.

About Appscribed

Appscribed is a comprehensive resource for SaaS tools, providing in-depth reviews, insightful comparisons, and feature analysis. It serves as a knowledge hub, offering access to the latest industry blogs and news, thereby empowering businesses to make informed decisions in their digital transformation journey.

Related Articles