Automated guidance when taking a photograph, using virtual objects overlaid on an image

Patent metadata

Field	Value
Publication number	US-9256986-B2
Application number	US-201213718088-A
Country	US
Kind code	B2
Filing date	Dec 18, 2012
Priority date	Feb 10, 2012
Publication date	Feb 9, 2016
Grant date	Feb 9, 2016

Abstract

There is provided an image processing device including a data acquisition unit configured to acquire a recommended angle-of-view parameter that represents a recommended angle of view for a subject in an environment that appears in an image, and a display control unit configured to overlay on the image a virtual object that guides a user so that an angle of view for capturing an image of the subject becomes closer to the recommended angle of view, using the recommended angle-of-view parameter. The recommended angle-of-view parameter is a parameter that represents a three-dimensional position and attitude of a device that captures an image of the subject at the recommended angle of view.

First claim

What is claimed is:

1. An image processing device comprising:
circuitry configured to:
acquire a recommended angle-of-view parameter that represents a recommended angle of view for a subject in an environment that appears in an image;
overlay on the image a virtual object that guides a user so that an angle of view for capturing an image of the subject becomes closer to the recommended angle of view, using the recommended angle-of-view parameter,
wherein the recommended angle-of-view parameter is a parameter that represents a three-dimensional position and attitude of a device that captures an image of the subject at the recommended angle of view;

overlay on the image a target object representing the recommended angle of view, and intermediate objects representing intermediate angles of views between the recommended angle of view and a current angle of view;
form an animation for guiding the user by sequentially overlaying the target object and the intermediate objects on a plurality of frames, such that the target object and the intermediate objects on the plurality of frames are simultaneously displayed; and
change display attributes of the intermediate objects in a stepwise manner, such that one of the intermediate objects closest to the target object has a peripheral line that is thicker than a peripheral line of another one of the intermediate objects farther away from the target object.

2. The image processing device according to claim 1 , wherein the circuitry is configured to:
recognize a current angle-of-view parameter representing the current angle of view, using the image, and
determine an arrangement of the intermediate objects in the environment using the recommended angle-of-view parameter and the current angle-of-view parameter.

3. The image processing device according to claim 2 , wherein the intermediate objects are arranged in the environment at positions and attitudes interpolated at non-even intervals between the recommended angle of view and the current angle of view.

4. The image processing device according to claim 1 , wherein the circuitry is configured to form a track of an angle of view for guiding the user by overlaying the target object and the intermediate objects.

5. The image processing device according to claim 1 , wherein the circuitry is configured to cause the image processing device to execute a predetermined operation when the current angle of view is determined to be substantially equal to the recommended angle of view.

6. The image processing device according to claim 5 , wherein the predetermined operation is recording of a captured image.

7. The image processing device according to claim 5 , wherein the predetermined operation is acquisition or reproduction of content associated with the subject.

8. The image processing device according to claim 5 , wherein the predetermined operation is guidance to a next subject or a next recommended angle of view.

9. The image processing device according to claim 1 , wherein the recommended angle-of-view parameter is a parameter that represents an angle of view of when a recommended image of the subject is captured.

10. The image processing device according to claim 1 , wherein the recommended angle-of-view parameter is a parameter that represents an angle of view determined based on a predefined rule for the subject and a position and an attitude of the subject.

11. The image processing device according to claim 1 , wherein the circuitry is configured to operate in conjunction with a device that resides on a cloud computing environment.

12. An image processing method comprising:
acquiring a recommended angle-of-view parameter representing a three-dimensional position and attitude of a device that captures an image of a subject in an environment that appears in an image at a recommended angle of view;
overlaying on the image a virtual object for guiding a user so that an angle of view for capturing an image of the subject becomes closer to the recommended angle of view, using the recommended angle-of-view parameter;
overlaying on the image a target object representing the recommended angle of view, and intermediate objects representing intermediate angles of views between the recommended angle of view and a current angle of view;
forming an animation for guiding the user by sequentially overlaying the target object and the intermediate objects on a plurality of frames, such that the target object and the intermediate objects on the plurality of frames are simultaneously displayed; and
changing display attributes of the intermediate objects in a stepwise manner, such that one of the intermediate objects closest to the target object has a peripheral line that is thicker than a peripheral line of another one of the intermediate objects farther away from the target object.

13. A non-transitory computer readable medium having a computer program recorded thereon, the computer program configured to perform a method when executed on a computer, the method comprising:
acquiring a recommended angle-of-view parameter that represents a recommended angle of view for a subject in an environment that appears in an image;
overlaying on the image a virtual object that guides a user so that an angle of view for capturing an image of the subject becomes closer to the recommended angle of view, using the recommended angle-of-view parameter,
wherein the recommended angle-of-view parameter is a parameter that represents a three-dimensional position and attitude of a device that captures an image of the subject at the recommended angle of view;

overlaying on the image a target object representing the recommended angle of view, and intermediate objects representing intermediate angles of views between the recommended angle of view and a current angle of view;
forming an animation for guiding the user by sequentially overlaying the target object and the intermediate objects on a plurality of frames, such that the target object and the intermediate objects on the plurality of frames are simultaneously displayed; and
changing display attributes of the intermediate objects in a stepwise manner, such that one of the intermediate objects closest to the target object has a peripheral line that is thicker than a peripheral line of another one of the intermediate objects farther away from the target object.

Assignees

• Sony Corp

Inventors

• Kasahara Shunichi
• Ikeda Takuo

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title