Step-by-step starting

Start and stop teleoperation

In brief

The button names used below are for the Meta Quest headsets. Please refer to the Controllers input page to get the corresponding inputs for your device.

Start teleoperating Reachy

  1. Make sure the robot is turned on, connected to the network and that all the robot’s services are running before launching the teleoperation application.

  2. Select the robot you want to teleoperate (or create a new one), and click on “Connect”.

  3. Once in the mirror room, you can configure various settings. Take time to tune the motion sickness effects you want to use in the settings menu. When you are ready to start, press “Ready”, then hold (A).

  4. Look straight ahead, with your body in the same orientation as your head while pressing A to start the teleoperation. The initial head position is used to determine the coordinate system giving your VR controllers position.

  1. (NEW) You first have the control of the head and the mobile base, but not of the arms. Take a few seconds to check the robot surroundings and go to an appropriate place before starting the full teleoperation. When the environment is safe, press A to get the full control. You can also go back to the mirror room pressing the related button with your laser beam.

  2. Come back any time to mirror room by holding A. Teleoperation of the robot is automatically paused if the headset is removed.

Stop teleoperation

  1. Come back to the mirror room to pause the teleoperation by holding A at any time during teleoperation.

  2. Leave the app by clicking “Quit” icons in the mirror room and connection menu.

The motors are automatically turned into compliant mode when quitting the mirror room. Please make sure the arms are close enough to the lowest position they can reach when coming back to the menu to avoid them falling or hitting something.

Step-by-step starting

  1. Make sure that your VR equipement is up and running. Please refer to your device documentation.

  2. Make sure the robot is turned on, connected to the network and that all the robot services are running. By default, if you haven’t modified anything, all services should be automatically launched on start of the full/starter kit robots.

  3. Launch the application TeleoperateReachy.exe file if you are using a VR device connected to a Windows computer. For Oculus Quest users, start the app from within the headset if you have installed the .apk.

  4. Equip yourself with your headset, make sure you can see both controllers and that the scene around you is moving correctly in accordance with your head movements.

  5. Choose the robot you want to connect to: you can select a robot with its IP address, or add a new one to the list of available robots.

Change robot to connect Select robot to connect

  1. Press Connect to initiate the communication with the robot.

Connect to a robot

  1. You should be now in the transition room, and see yourself controlling a virtual reachy. The actual robot is not in control at that time but the live camera stream is displayed at the top right of the mirror. The info, help and settings menus are available here (they are documented in the next section). Please get familiar with the robot controls and features (emotion, grasping lock).

Mirror scene

  1. When you are ready, face the mirror completely and click on “Ready”. The position of the actual robot appears in a semi-transparent green color. This may be useful when you’ve left the robot in a certain position that you would like to keep when entering the teleoperation. Hold (A) to start the teleoperation.

Start teleoperation

  1. (NEW) You first have the control of the head and the mobile base, but not of the arms. Take a few seconds to check the robot surroundings and go to an appropriate place before starting the full teleoperation. When the environment is safe, press A to get the full control. You can also go back to the mirror room pressing the related button with your laser beam.

  2. A 3 seconds timer appears while you enter the teleoperation. The motors speeds are reduced during this time to avoid sudden movements of the robot. Full speed is reached at the end of this countdown.

Validate position before starting
  1. Come back any time to menu by pressing A. Teleoperation of the robot is automatically paused if the headset is removed.

Use Reachy’s emotions

Use of the antennas emotion is not available on Reachy 2.

Application features

Connection page

Click on the robot to select to open the panel of all saved robots:

Change robot to connect

Then click on “Add new robot +” at the bottom right of the page:

Add robot button

Enter a robot name and the IP address of the robot (if the headset is connected on a computer, use the computer keyboard), and save your robot card:
The IP address is mandatory. If no name is given to the new robot, it will be called @Reachy by default

Add robot panel

Click on the robot to select to open the panel of all saved robots:

Change robot to connect

Then click on the pencil icon of the robot you want to modify:

Modify robot button

Modify the info on the robot card and save the card:

Modify robot panel

Click on the robot to select to open the panel of all saved robots:

Change robot to connect

Then click on the bin icon of the robot you want to delete:

Delete robot button

Validate the deletion:

Delete robot panel

Mirror scene

Open the info menu in the mirror room:

Info menu

The connection and services status, and motor temperature are reported here.

Open the help menu in the mirror room:

Info menu

The mapping of the controller buttons to the robot actions are displayed here.

Open the settings menu in the mirror room:

Settings menu

Here you can set your size to improve the mapping between your movements and reachy’s motion. Individual parts of the robot can be deactivated in the case you don’t need the mobile base, a specific arm, etc.
Motion sickness options are available in this panel: choose to display a reticle or not, and select a navigation effect that fit to your robot use. You can also modify the grasping mode there: with full control you decide at each time the opening of the gripper, while the grasping lock option enables you to close the gripper with on trigger press and open it with another one. Grasping lock option can be turned on/off as well in the emotion menu.

While facing the mirror, your body should be aligned with Reachy’s body. This is mandatory to have a consistent control. If this is not the case after having pressed “Ready”, face the mirror and click on “Reset position”.

Reset position

The “Reset position” button is placed at the bottom of the mirror, under the A loader.

Teleoperation exit

While press (A) to exit the teleoperation, you may hold (X) to activate the position lock. A lock is displayed when doing so.

Exit and lock

The robot will stayed locked while you’ll be back in the mirror room. This can be useful to keep a certain position while you need to take a break, change position or remove the headset. The position of the robot will be displayed by the semi-transparent green robot when you will restart the teleoperation.