Information processing apparatus and information processing method

Patent metadata

Field	Value
Publication number	US-12062233-B2
Application number	US-201917278512-A
Country	US
Kind code	B2
Filing date	Sep 6, 2019
Priority date	Oct 1, 2018
Publication date	Aug 13, 2024
Grant date	Aug 13, 2024

Abstract

There is provided an information processing apparatus including a projection control unit ( 150 ) that causes visual information to be projected onto a projection surface. The visual information corresponds to content that is provided to the projection surface and disposed on a first object. The content is identified on the basis of a recognition result of the first object and a recognition result of a second object. The second object is provided along with the first object.

First claim

The invention claimed is:

1. An information processing apparatus, comprising:
a processor configured to:
recognize a size of a first object from an image, wherein
the first object is on a projection surface, and
the first object includes content;

recognize a second object from the image, wherein the second object is on the projection surface;
determine the recognized size of the first object is not in a first range;
identify, based on a result of the recognition of the second object and the determination that the recognized size of the first object is not in the first range, the content that is on the projection surface; and
control projection of visual information onto the projection surface based on the determination that the recognized size of the first object is not in the first range, wherein the visual information corresponds to the identified content that is on the projection surface.

2. The information processing apparatus according to claim 1 , wherein the second object is associated with each piece of a plurality of pieces of the content.

3. The information processing apparatus according to claim 1 , wherein the processor is further configured to:
continuously recognize the first object and the second object; and
dynamically control the projection of the visual information onto the projection surface based on the continuous recognition of the first object and the second object.

4. The information processing apparatus according to claim 1 , wherein the processor is further configured to:
recognize a position of the first object and a position of the second object; and
control the projection of the visual information corresponding onto the projection surface based on the position of the first object and the position of the second object.

5. The information processing apparatus according to claim 4 , wherein
the processor is further configured to control the projection of the visual information onto the projection surface based on the position of the first object in a case where the position of the second object is not in a second range, and
the position of the second object is based on the position of the first object.

6. The information processing apparatus according to claim 1 , wherein the processor is further configured to:
recognize a state change in the content; and
control the projection of the visual information onto the projection surface based on the state change.

7. The information processing apparatus according to claim 6 , wherein
the state change includes a mass change in the content, and
the processor is further configured to control the projection of the visual information corresponding to the mass change onto the projection surface.

8. The information processing apparatus according to claim 1 , wherein the visual information is associated with each piece of a plurality of pieces of the content.

9. The information processing apparatus according to claim 1 , wherein the processor is further configured to control the projection the visual information onto the first object.

10. The information processing apparatus according to claim 1 , wherein the processor is further configured to:
recognize a third object; and
control the projection of the visual information onto the projection surface based on a recognition result of the third object.

11. The information processing apparatus according to claim 10 , wherein
the processor is further configured to control the projection of the visual information onto the projection surface based on interaction of the third object with at least one of the first object or the second object, and
the interaction indicates that the third object one of comes closer to or comes into contact with the at least one of the first object or the second object.

12. The information processing apparatus according to claim 1 , wherein the processor is further configured to control the projection of the visual information onto the projection surface based on a time elapsed since the projection of the visual information corresponding to the identified content is started.

13. The information processing apparatus according to claim 1 , wherein the processor is further configured to:
identify a plurality of pieces of the content; and
control the projection of the visual information corresponding to the plurality of pieces of the content onto the projection surface.

14. The information processing apparatus according to claim 1 , wherein
the content includes a food product, and
the second object is on the food product.

15. The information processing apparatus according to claim 14 , wherein the processor is further configured to control the projection of the visual information onto the projection surface to be started at a timing of provision of the food product.

16. An information processing method, comprising:
recognizing, by a processor, a size of a first object from an image, wherein
the first object is on a projection surface, and
the first object includes content;

recognizing, by the processor, a second object from the image, wherein the second object is on the projection surface;
determining, by the processor, the recognized size of the first object is not in a specific range;
identifying, by the processor, the content that is on the projection surface, wherein the identification is based on a result of the recognition of the second object and the determination that the recognized size of the first object is not in the specific range; and
controlling, by the processor, projection of visual information onto the projection surface based on the determination that the recognized size of the first object is not in the specific range, wherein the visual information corresponds to the identified content that is on the projection surface.

17. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
recognizing a size of a first object from an image, wherein
the first object is on a projection surface, and
the first object includes content;

recognizing a second object from the image, wherein the second object is on the projection surface;
determining the recognized size of the first object is not in a specific range;
identifying, based on a result of the recognition of the second object and the determination that the recognized size of the first object is not in the specific range, the content that is on the projection surface; and
controlling projection of visual information onto the projection surface based on the determination that the recognized size of the first object is not in the specific range, wherein the visual information corresponds to the identified content that is on the projection surface.

18. An information processing apparatus, comprising:
a processor configured to:
recognize a position of a first object from an image, wherein
the first object is on a projection surface, and
the first object includes content;

recognize a position of a second object from the image, wherein
the second object is on the projection surface, and
the position of the second object is based on the position of the first object;

determine the position of the second object is not in a specific range; and
control projection of visual information onto the projection surface, based on the position of the first object and the determination that the position of the second object is not in the specific range, wherein the

Assignees

• Sony Corp

Inventors

• TOKITAKE Miki
• Toriumi Hiroaki
• Miyazawa Katsuji
• Watanabe Shoji
• Ikeda Tetsuo
• Ichiyama Yoshihito

Classifications

• G06F3/0425

  using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386) · CPC title

• G03B21/26

  Projecting separately subsidiary matter simultaneously with main image · CPC title

• G06V20/64

  Three-dimensional [3D] objects · CPC title

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G09G5/38

  with means for controlling the display position · CPC title