Remote operation system

Patent metadata

Field	Value
Publication number	US-12038770-B2
Application number	US-202217665708-A
Country	US
Kind code	B2
Filing date	Feb 7, 2022
Priority date	Mar 19, 2021
Publication date	Jul 16, 2024
Grant date	Jul 16, 2024

Abstract

A remote operation system for a moving body, includes: a control device provided on the moving body; and an operation terminal configured to receive input from a user and to communicate with the control device. The moving body includes an external environment sensor that acquires surrounding information of the moving body and a display device. The control device creates a surrounding image including the moving body based on the surrounding information, makes the display device display the surrounding image, and in a case where communication between the control device and the operation terminal is performed, makes the display device display the surrounding image in which at least a part of a communication status display showing a status of communication with the control device is superimposed on an image of the moving body included in the surrounding image.

First claim

The invention claimed is:

1. A remote operation system for a moving body, comprising:
a control device provided on the moving body; and
an operation terminal configured to receive input from a user and to communicate with the control device, wherein the moving body comprises a display device and an external environment sensor that acquires surrounding information of the moving body, and
the control device creates a surrounding image based on the surrounding information, the surrounding image being an image showing the moving body and its surroundings as seen from above, makes the display device display the surrounding image, and in a case where communication between the control device and the operation terminal is performed, makes the display device display the surrounding image in which an entirety of a communication status display showing a status of communication with the control device and the operation terminal is superimposed on an image of the moving body included in the surrounding image.

2. The remote operation system according to claim 1 , wherein the communication status display includes a display corresponding to “during connection attempt” and a display corresponding to “connection completed”.

3. The remote operation system according to claim 1 , wherein when connection with the operation terminal is completed, the control device makes the display device display a display that prompts the user to exit the moving body together with the surrounding image.

4. The remote operation system according to claim 1 , wherein the operation terminal has a display unit and, when connection with the control device is completed, makes the display unit display a display that prompts the user to exit the moving body.

5. The remote operation system according to claim 4 , wherein when the control device determines that the connection between the control device and the operation terminal is completed and the operation terminal has departed from the control device, the control device makes the display unit of the operation terminal display an image for operation of the moving body.

6. The remote operation system according to claim 4 , wherein when the control device determines that the connection between the control device and the operation terminal is completed and the operation terminal has departed from the control device, the control device turns off the display on the display device.

7. The remote operation system according to claim 5 , wherein the control device determines that the operation terminal has departed from the control device when the control device detects that the connection between the control device and the operation terminal is completed, thereafter a door of the moving body is opened, thereafter the door is closed, and thereafter the door is locked.

8. The remote operation system according to claim 5 , wherein the control device acquires a distance between the control device and the operation terminal based on a strength of radio wave signal received from the operation terminal and determines that the operation terminal has departed from the control device when the acquired distance is greater than or equal to a prescribed value.

Assignees

• Honda Motor Co Ltd

Inventors

• Fujiwara Tatsuro
• Nakamura Akiko

Classifications

• G05D1/223

  Command input arrangements on the remote controller, e.g. joysticks or touch screens · CPC title

• G05D1/2247

  providing the operator with simple or augmented images from one or more cameras · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• G01S11/06

  using intensity measurements · CPC title

• B60W30/06

  Automatic manoeuvring for parking · CPC title