Information processing device and information processing method

Patent metadata

Field	Value
Publication number	US-11262838-B2
Application number	US-201816962384-A
Country	US
Kind code	B2
Filing date	Dec 13, 2018
Priority date	Jan 30, 2018
Publication date	Mar 1, 2022
Grant date	Mar 1, 2022

Abstract

Provided is an information processing device that provides feedback to a user. The information processing device includes: a recognition unit that recognizes a physical relation between a real object and a first virtual object positioned on an identical surface and a control unit that controls the behavior of the real object based on the physical relation.

First claim

The invention claimed is:

1. An information processing device, comprising:
a recognition unit configured to recognize a first physical relation between a real object and a first virtual object based on a second physical relation between the first virtual object and a second virtual object, wherein
the real object, the first virtual object, and the second virtual object are on an identical surface, and
the second virtual object corresponds to the real object; and

a control unit configured to:
control a behavior of the real object based on the first physical relation; and
control a behavior of the second virtual object to one of stop or slow down in a case where the behavior of the real object on the identical surface is delayed with respect to the behavior of the second virtual object on the identical surface by one of a first time or a second time, wherein the second time is longer than the first time.

2. The information processing device according to claim 1 , further comprising a video output unit configured to one of display or project the first virtual object on the identical surface.

3. The information processing device according to claim 2 , wherein the control unit is further configured to control one of a position of the real object or a physical quantity of the real object to control the behavior of the real object.

4. The information processing device according to claim 3 , wherein the physical quantity includes at least one of a speed, an acceleration, a mass, a density, a length, a friction coefficient, an elastic force, or a temperature.

5. The information processing device according to claim 2 , wherein the control unit is further configured to control the behavior of the real object based on the behavior of the second virtual object.

6. The information processing device according to claim 5 , wherein the control unit is further configured to control the behavior of the real object in accordance with the behavior of the second virtual object.

7. The information processing device according to claim 6 , wherein the control unit is further configured to:
predict the behavior of the real object based on the second virtual object; and
control the behavior of the real object based on a result of the prediction.

8. The information processing device according to claim 2 , wherein the control unit is further configured to control the second virtual object to stop on the identical surface at a stopping position of the real object.

9. The information processing device according to claim 2 , wherein the control unit is further configured to control the behavior of the real object based on one of an environment or a material represented by the first virtual object.

10. The information processing device according to claim 2 , wherein the control unit is further configured to control an external device, that acts on the real object, to control the behavior of the real object.

11. The information processing device according to claim 10 , further comprising a transmission unit, wherein
the control unit is further configured to:
generate control information; and
control the behavior of the real object based on the control information, and

the transmission unit is configured to transmit the control information to one of the real object or the external device.

12. The information processing device according to claim 10 , further comprising an emission unit, wherein
the control unit is further configured to:
generate control information; and
control the behavior of the real object based on the control information,

the emission unit is configured to emit light based on the control information, and
the light is emitted for the control of the behavior of the real object.

13. The information processing device according to claim 2 , wherein the recognition unit is further configured to recognize, as the first physical relation, at least one of a collision, a contact, or a position relation between the first virtual object and the real object.

14. An information processing method comprising:
recognizing a first physical relation between a real object and a first virtual object based on a second physical relation between the first virtual object and a second virtual object, wherein
the real object, the first virtual object, and the second virtual object are on an identical surface, and
the second virtual object corresponds to the real object;

controlling a behavior of the real object based on the first physical relation; and
controlling a behavior of the second virtual object to one of stop or slow down in a case where the behavior of the real object on the identical surface is delayed with respect to the behavior of the second virtual object on the identical surface by one of a first time or a second time, wherein the second time is longer that the first time.

15. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
recognizing a first physical relation between a real object and a first virtual object based on a second physical relation between the first virtual object and a second virtual object, wherein
the real object, the first virtual object, and the second virtual object are positioned on an identical surface, and
the second virtual object corresponds to the real object;

controlling a behavior of the real object based on the first physical relation; and
controlling a behavior of the second virtual object to one of stop or slow down in a case where the behavior of the real object on the identical surface is delayed with respect to the behavior of the second virtual object on the identical surface by one of a first time or a second time, wherein the second time is longer that the first time.

Assignees

• Sony Corp

Inventors

• Fujinawa Eisuke
• Ikeda Tetsuo
• Kitamura Kensuke

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G05D1/12

  Target-seeking control · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title