Figure’s Humanoid Robot Takes Voice Orders to Help with Household Tasks

Figure robots arranging groceries.

Figure robots arranging groceries.

Figure's humanoid robot is making significant progress in household assistance by incorporating voice instructions via its powerful machine-learning model, Helix. This "generalist" Vision-Language-Action (VLA) approach allows the robot to process and carry out tasks by merging vision and language comprehension. The breakthrough comes after Figure's recent decision to end its collaboration with OpenAI and instead focus on in-house AI development.

VLAs are a significant advancement in robotics, allowing robots to understand commands using both visual input and verbal language. Google DeepMind's RT-2 is a well-known example that trains robots using video and massive language models. Figure's Helix operates similarly, allowing its humanoid robot to detect and control hundreds of household projects, including ones it has never seen before.

Figure robots arranging groceries.
expand image

The ability to take voice orders and act accordingly is significant in home robotics. Helix allows the robot to scan its environment and carry out directions flawlessly. For example, a user could say, "Hand the bag of cookies to the robot on your right," and the system would process the instruction, recognize the object, and complete the task. This feature extends to multiple robots working together to streamline domestic activities.

Households present distinct challenges for robots because of their unstructured nature. Unlike factories and warehouses; homes have different layouts, lighting conditions, and a variety of goods. Figure plans to handle these complications with Helix, assuring that its robot can adapt to a variety of household circumstances.

Figure robot handing cookie to another Figure robot.
expand image

Regardless of the potential, training a robot to handle real-world household tasks remains a tough barrier. Traditional approaches necessitate substantial manual programming or thousands of demonstrations. However, Helix's approach tries to produce intelligent behaviors on demand, hence increasing process efficiency and scalability.

While Figure's initial focus was on industrial applications, its current transition to home robotics reflects a larger ambition. With Helix, the business is building the framework for a future in which humanoid robots effortlessly assist with everyday chores. Though still in its early stages, this technology has the potential to revolutionize domestic automation, making intelligent robotic assistance a part of everyday life.