Image display apparatus for enhanced interaction with a user

Patent metadata

Field	Value
Publication number	US-11914797-B2
Application number	US-202017755116-A
Country	US
Kind code	B2
Filing date	Jul 21, 2020
Priority date	Oct 29, 2019
Publication date	Feb 27, 2024
Grant date	Feb 27, 2024

Abstract

Provided is an image display apparatus that includes a display displaying a three-dimensional image such that a three-dimensional object looks as if in a space defined by a member constituting an external surface and that the three-dimensional object is visible from multiple directions around the display, a motion detector detecting a motion of the display caused by an external force, a motion calculation unit calculating a motion of the three-dimensional object caused by the motion of the display based on the motion detected by the motion detector, a display control unit changing the three-dimensional image displayed on the display based on the calculation by the motion calculation unit, and a force sense control unit causing a force sense presentation unit to present a sense of force based on the calculation by the motion calculation unit.

First claim

The invention claimed is:

1. An image display apparatus, comprising:
a display configured to display a three-dimensional image in such a manner that a three-dimensional object looks as if in a space defined by a member constituting an external surface and that the three-dimensional object is visible from multiple directions around the display;
a motion detector configured to detect a first motion of the display caused by an external force;
a motion calculation unit configured to calculate, a second motion of the three-dimensional object caused by the first motion of the display, based on the detected first motion on an assumption that the three-dimensional object is actually present in the space;
a display control unit configured to change the three-dimensional image displayed on the display based on the calculated second motion;
a force sense presentation unit configured to present a sense of force to a user of the image display apparatus; and
a force sense control unit configured to output, to the force sense presentation unit, a signal to present the sense of force based on the calculated second motion.

2. The image display apparatus according to claim 1 , wherein
the display control unit is further configured to change the three-dimensional image based on the calculated second motion to display the second motion of the three-dimensional object caused by the first motion of the display, and
the force sense control unit is further configured to output, to the force sense presentation unit, the signal to present the sense of force based on the calculated second motion on the assumption that the three-dimensional object is actually present in the space to make the user feel a vibration supposed to be generated by contact of the three-dimensional object with the member constituting the external surface.

3. The image display apparatus according to claim 1 , wherein
substance data indicating at least one of a mass, a center of gravity, a density, a volume, a Young's modulus, a Poisson's ratio, a vibration damping rate, a viscosity, or an outer shape is set to the three-dimensional object, and
the motion calculation unit is further configured to calculate the second motion of the three-dimensional object based on the substance data, the detected first motion, and a specific physical law.

4. The image display apparatus according to claim 1 , further comprising an input operation detector configured to detect an input operation by the user, wherein
the display control unit includes a display operation unit, and
the display operation unit is configured to change the three-dimensional image displayed on the display based on the detected input operation.

5. The image display apparatus according to claim 4 , wherein the input operation detector comprises at least one of a touch panel on the external surface of the display, a microphone picking up surrounding sounds of the display, a camera capturing surrounding images of the display, or a distance image sensor capturing surrounding distance images of the display.

6. The image display apparatus according to claim 5 , wherein the display operation unit is further configured to:
detect a position of the touch panel in contact with a finger; and
change the three-dimensional image displayed on the display based on the detected position.

7. The image display apparatus according to claim 4 , wherein
a single piece of the input operation detector has a plurality of operation methods, and
the display operation unit is further configured to change the three-dimensional image displayed on the display based on the detected input operation by one of the plurality of operation methods when the display is held in the hand of the user.

8. The image display apparatus according to claim 7 , wherein
the display operation unit is further configured to prohibit the three-dimensional image from changing based on the detected input operation when the display is held in the hand.

9. The image display apparatus according to claim 4 , wherein
a single piece of the input operation detector has a plurality of operation methods,
when a plurality of input operations by the plurality of operation methods are detected, the display operation unit is further configured to change the three-dimensional image displayed on the display based on an input operation of the plurality of input operations by a first operation method, of the plurality of operation methods, with a highest priority, and
priorities assigned to the plurality of operation methods differ between when the display is shaken and when the display is not shaken.

10. The image display apparatus according to claim 1 , wherein the second motion includes at least one of a collision of the three-dimensional object with a top end of the space or a bouncing motion of the three-dimensional object.

Assignees

• Sony Group Corp

Inventors

• Omata Takanobu
• Koike Kaoru
• Miyagawa Yuichi
• Izawa Hisataka
• Shimizu Itaru

Classifications

• G06F3/0346 Primary

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• H04N5/74

  Projection arrangements for image reproduction, e.g. using eidophor · CPC title

• G03B35/00

  Stereoscopic photography · CPC title