Remote control system, remote control method, and program

Patent metadata

Field	Value
Publication number	US-10810867-B2
Application number	US-201616338555-A
Country	US
Kind code	B2
Filing date	Oct 11, 2016
Priority date	Oct 11, 2016
Publication date	Oct 20, 2020
Grant date	Oct 20, 2020

Abstract

A remote control system 1 includes a selecting unit 13 that selects at least one control target device from among a plurality of control target devices 2, according to a result obtained by capturing a field of view of a user by a user terminal 20, and a control unit 14 that controls the control target device 2 selected by the selecting unit 13. Accordingly, the burden on the user when selecting the control target device 2 can be reduced.

First claim

What is claimed is:

1. A remote control system comprising:
a display unit that displays an image representing a camera that is not included in an image captured by a user terminal but exists in an image-capturing direction of the user terminal, at a position in a direction in which the camera exists within a space captured by the user terminal;
a selecting unit that selects the camera that is not included in the image captured by the user terminal but exists in the image-capturing direction of the user terminal when the camera whose image is displayed is designated by a user, wherein the display unit includes a transmissive display panel and displays an image for guiding a control on the selected camera at a position corresponding to the selected camera that is seen through the transmissive display panel by the user; and
a control unit that controls the selected camera, wherein the control unit controls a direction of the selected camera in accordance with a movement of a head of the user.

2. The remote control system according to claim 1 , wherein the selecting unit further selects the camera included in the image captured by the user terminal.

3. The remote control system according to claim 2 , wherein the selecting unit selects the camera based on an identification image of the camera included in an image captured by the user terminal.

4. The remote control system according to claim 2 , wherein when a plurality of cameras are included in an image captured by the user terminal, the selecting unit selects at least one camera according to a position of each of the cameras in the image.

5. The display device according to claim 1 , further comprising a storage unit that stores a control history of the camera by the control unit.

6. The remote control system according to claim 1 , wherein the control unit restricts a control on the selected camera based on a predetermined condition.

7. The remote control system according to claim 2 , wherein when the selecting unit selects the one camera according to results captured by a plurality of user terminals and a control by the control unit conflicts among the plurality of user terminals, the control unit performs a reservation process that first executes a control according to an instruction by any one of the user terminals is executed and then executes a control according to an instruction by other user terminal.

8. The remote control system according to claim 1 , wherein the control unit terminates a control on the camera based on a predetermined condition.

9. The user terminal according to claim 1 , wherein the user terminal is a wearable terminal worn on the head of the user, and the control unit is provided in an operation terminal different from the wearable terminal.

10. A remote control method comprising:
a display step of displaying an image representing a camera that is not included in an image captured by a user terminal but exists in an image-capturing direction of the user terminal, at a position in a direction in which the camera exists within a space captured by the user terminal;
a selecting step of selecting the camera that is not included in the image captured by the user terminal but exists in the image-capturing direction of the user terminal when the camera whose image is displayed is designated by a user;
displaying an image for guiding a control on the selected camera at a position corresponding to the selected camera that is seen through a transmissive display panel by the user; and
a control step of controlling the selected camera, wherein the control step includes controlling a direction of the selected camera in accordance with a movement of a head of the user.

11. A program for causing one or more computers to execute:
a display step of displaying an image representing a camera that is not included in an image captured by a user terminal but exists in an image-capturing direction of the user terminal, at a position in a direction in which the camera exists within a space captured by the user terminal;
a selecting step of selecting the camera that is not included in the image captured by the user terminal but exists in the image-capturing direction of the user terminal when the camera whose image is displayed is designated by a user;
displaying an image for guiding a control on the selected camera at a position corresponding to the selected camera that is seen through a transmissive display panel by the user; and
a control step of controlling the selected camera, wherein the control step includes controlling a direction of the selected camera in accordance with a movement of a head of the user.

Assignees

• Optim Corp

Inventors

• Sugaya Shunji

Classifications

• G06V20/20

  in augmented reality scenes · CPC title

• H04Q9/00

  Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom · CPC title

• G08C17/02 Primary

  using a radio link · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G08C2201/34

  Context aware guidance · CPC title