Image display system, image control method, and image control program

Patent metadata

Field	Value
Publication number	US-2025358398-A1
Application number	US-202218873429-A
Country	US
Kind code	A1
Filing date	Jun 22, 2022
Priority date	Jun 22, 2022
Publication date	Nov 20, 2025
Grant date	—

Abstract

An image display system includes a floating image display unit that displays a floating image as a real image in a predetermined displayable region in a three-dimensional space, a sensor unit that detects a user in the vicinity of the displayable region and outputs detection information, and a control unit that identifies a gesture, including at least one of body part movement and posture of the user, based on the detection information, and when the gesture is a predetermined position designation gesture designating a display position of the floating image in the displayable region, controls the floating image display unit so that the floating image is displayed at a designated display position as the display position designated by the position designation gesture.

First claim

1 . An image display system comprising:
a floating image display that displays a floating image as a real image in a predetermined displayable region in a three-dimensional space; a sensor that detects a user in a vicinity of the displayable region and outputs detection information; and control circuitry that calculates a vision range by identifying an eye position of the user based on the detection information, identifies a gesture of closing the eye of the user, and controls the floating image display so that the floating image is displayed at a designated display position as a display position determined depending on the vision range.

2 .- 3 . (canceled)

4 . An image display system comprising:
a floating image display that displays a floating image as a real image in a predetermined displayable region in a three-dimensional space; a sensor that detects a user in a vicinity of the displayable region and outputs detection information; control circuitry that identifies a gesture, including at least one of body part movement and posture of the user, based on the detection information, and when the gesture is a predetermined position designation gesture designating a display position of the floating image in the displayable region, controls the floating image display so that the floating image is displayed at a designated display position as the display position designated by the position designation gesture; and a camera that photographs a subject and outputs image data of the subject, wherein when the gesture is judged to be a subject designation gesture designating the subject to be displayed at the designated display position, the control circuitry controls the floating image display so that an image of the subject designated by the subject designation gesture is displayed at the designated display position as the floating image.

5 . The image display system according to claim 1 , wherein the control circuitry changes the display position in the displayable region according to the position designation gesture.

6 .- 7 . (canceled)

8 . The image display system according to claim 1 , wherein the control circuitry detects a state of a skeletal structure of the user based on the detection information and determines the display position designated by the position designation gesture based on the state of the skeletal structure.

9 .- 10 . (canceled)

11 . The image display system according to claim 1 , wherein
the sensor includes a camera that photographs a subject and outputs image data, and the control circuitry identifies a gesture, including at least one of body part movement and posture of the user, based on the detection information or the image data in a case of photographing the user with the camera, and when the gesture is judged to be a subject designation gesture designating the subject to be displayed at the display position, controls the floating image display so that an image of the subject designated by the subject designation gesture is displayed at the display position as the floating image.

12 . The image display system according to claim 11 , wherein when the gesture is a predetermined position designation gesture designating the display position of the floating image in the displayable region, the control circuitry controls the floating image display so that the floating image is displayed at a designated display position as the display position designated by the position designation gesture.

13 . The image display system according to claim 1 , wherein
the sensor includes a camera that photographs the user and a subject and outputs image data, and when the gesture is judged to be a subject designation gesture designating the subject to be displayed at the designated display position, the control circuitry controls the floating image display so that an image of the subject designated by the subject designation gesture is displayed at the designated display position as the floating image.

14 . (canceled)

15 . The image display system according to claim 1 , wherein when the gesture is judged to be a subject designation gesture designating a subject to be displayed at the designated display position, the control circuitry controls the floating image display so that an image of the subject designated by the subject designation gesture is displayed at the designated display position as the floating image by using image information regarding the subject acquired from a database storing image data obtained by previously photographing subjects to be displayed as the floating image.

16 . The image display system according to claim 4 , wherein the subject designation gesture is an action in which the user points at the subject with a finger.

17 . (canceled)

18 . The image display system according to claim 1 , wherein
the floating image display includes a first display that displays a first image, a second display that displays a second image, and a real image optical system that displays the first image or the second image as the floating image as the real image, a distance from the first display to the real image optical system is longer than a distance from the second display to the real image optical system, and the control circuitry identifies a gesture, including at least one of the body part movement and the posture of the user, based on the detection information, and when the gesture is a predetermined depth designation gesture designating a depth direction position of the displayable region, controls the floating image display so that the floating image is displayed in the displayable region whose depth direction position is designated by the depth designation gesture.

19 . The image display system according to claim 1 , wherein when the gesture is a predetermined size designation gesture for enlarging/reducing size of the floating image in the displayable region, the control circuitry controls the floating image display so that the floating image is displayed in the size designated by the size designation gesture.

20 . The image display system according to claim 19 , wherein the size designation gesture is an action in which the user widens or narrows a distance between two fingers.

21 . The image display system according to claim 19 , wherein the size designation gesture is an action in which the user moves a finger closer to or farther from the displayable region.

22 . An image display system comprising:
a floating image display that displays a floating image as a real image in a predetermined displayable region in a three-dimensional space; a sensor that detects a user in a vicinity of the displayable region and outputs detection information and photographs a subject and outputs image data; and control circuitry that identifies a gesture, including at least one of body part movement and posture of the user, based on the detection information, and when the gesture is judged to be a subject designation gesture designating the subject, controls the floating image display so that an image of the subject designated by the subject designation gesture is displayed as the floating image.

23 . (canceled)

24 . An image control method to be executed by an image display system including a floating image display that displays a floating image as a real image in a predetermined displayable region in a three-dimensional space and a sensor that detects a user in a vicinity of the displayable region and outputs detection information, the method comprising:
ident

Assignees

• Mitsubishi Electric Corp

Inventors

• KIKUTA Hayato

Classifications

• H04N13/346

  using prisms or semi-transparent mirrors · CPC title

• H04N13/366 Primary

  using viewer tracking · CPC title

• G02B30/56 Primary

  by projecting aerial or floating images · CPC title