Image display device and image display method

Patent metadata

Field	Value
Publication number	US-12005570-B2
Application number	US-202217950800-A
Country	US
Kind code	B2
Filing date	Sep 22, 2022
Priority date	Dec 22, 2021
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

A synchronization controller performs control so that operator motion data is transmitted to a robot when a synchronization switch is set to ON which allows synchronization of a rotational motion of an operator with a rotational motion of the robot. An image correction unit, when there is a difference between a first rotation angle of the operator and a second rotation angle of the robot, corrects a cutout range of an image so as to be equal to a range corresponding to the first rotation angle. The synchronization controller performs control so that the operator motion data is not transmitted to the robot when the synchronization switch is set to OFF which does not allow synchronization of a rotational motion of the operator with a rotational motion. The image correction unit corrects the cutout range so as to be equal to a range corresponding to the first rotation angle.

First claim

What is claimed is:

1. An image display device comprising:
an operator motion data acquisition unit configured to acquire operator motion data indicating a first rotation angle produced when an operator who operates a robot performs a rotational motion;
a robot motion data acquisition unit configured to acquire robot motion data which indicates a second rotation angle produced when the robot performs a rotational motion in accordance with the operator motion data and is transmitted from the robot;
an image data acquisition unit configured to acquire image data which is generated by being captured by a 360-degree camera provided in the robot and is transmitted from the robot;
an image correction unit configured to supply, to a display panel, image data in a cutout range obtained by cutting out a range of an image to be displayed on the display panel to be viewed by the operator, from the image data acquired by the image data acquisition unit, and to correct the cutout range;
a synchronization switch configured to set whether or not to synchronize a rotational motion of the operator with a rotational motion of the robot; and
a synchronization controller configured to perform control so that the operator motion data is transmitted to the robot when the synchronization switch is set to ON which allows synchronization of a rotational motion of the operator with a rotational motion of the robot, and to control the image correction unit to correct the cutout range so as to be equal to a range corresponding to the first rotation angle when there is a difference between the first rotation angle and the second rotation angle, and configured to perform control so that the operator motion data is not transmitted to the robot when the synchronization switch is set to OFF which does not allow synchronization of a rotational motion of the operator with a rotational motion of the robot, and to control the image correction unit to correct the cutout range so as to be equal to a range corresponding to the first rotation angle.

2. The image display device according to claim 1 , wherein
the synchronization controller, when the synchronization switch is set to ON which allows synchronization of a rotational motion of the operator with a rotational motion of the robot, corrects the cutout range so as to be shifted in a direction in which the operator performs a rotational motion, by a difference between the first rotation angle and second rotation angle in a case where the first rotation angle is greater than the second rotation angle, and corrects the cutout range so as to be shifted in a direction opposite to the direction in which the operator performs a rotational motion, by a difference between the first rotation angle and second rotation angle in a case where the first rotation angle is smaller than the second rotation angle.

3. The image display device according to claim 1 , wherein
the synchronization controller is in a state equivalent to a state in which the synchronization switch is set to ON, when the operator has been watching an image displayed on the display panel for a predetermined period of time or longer.

4. The image display device according to claim 1 , wherein
the image correction unit cuts out a range of an image having a viewing angle which is wider than a field angle of the display panel, from the image data acquired by the image data acquisition unit as the cutout range, and compresses a size of the cutout range so as to fit within the field angle of the display panel.

5. An image display method comprising:
acquiring operator motion data indicating a first rotation angle produced when an operator who operates a robot performs a rotational motion;
acquiring robot motion data which indicates a second rotation angle produced when the robot performs a rotational motion in accordance with the operator motion data and is transmitted from the robot;
acquiring image data which is generated by being captured by a 360-degree camera provided in the robot and is transmitted from the robot;
supplying, to a display panel, image data in a cutout range obtained by cutting out a range of an image to be displayed on a display panel to be viewed by the operator, from the acquired image data;
performing control so that the operator motion data is transmitted to the robot when a setting is implemented so that a rotational motion of the operator is synchronized with a rotational motion of the robot, and correcting the cutout range so as to be equal to a range corresponding to the first rotation angle when there is a difference between the first rotation angle and the second rotation angle; and
performing control so that the operator motion data is not transmitted to the robot when s setting is set to OFF which does not allow synchronization of a rotational motion of the operator with a rotational motion of the robot, and correcting the cutout range so as to be equal to a range corresponding to the first rotation angle.

Assignees

• Jvckenwood Corp

Inventors

• Fujii Shunichi
• ARAHATA Yuichi
• Arase Takayuki
• Yoshimura Satoshi

Classifications

• H04N13/161

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/239

  using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) · CPC title

• H04N13/332

  Displays for viewing with the aid of special glasses or head-mounted displays [HMD] · CPC title

• B25J19/023

  including video camera means · CPC title