Information processing apparatus and information processing method

Patent metadata

Field	Value
Publication number	US-11689702-B2
Application number	US-201917250692-A
Country	US
Kind code	B2
Filing date	Aug 2, 2019
Priority date	Aug 30, 2018
Publication date	Jun 27, 2023
Grant date	Jun 27, 2023

Abstract

An information processing apparatus includes an input unit and a control unit. The input unit to which sensing information and coordinate information are input, the sensing information being obtained by sensing a space in which video is projected, the coordinate information being obtained by pointing through a pointing operation of the space by a user. The control unit stores setting information for setting a projection region in a predetermined range in a storage unit on the basis of a result of analyzing a state in the space on the basis of the sensing information and the coordinate information. Then, the control unit controls, in a case where a projection region is designated by the user on the basis of the stored setting information, a projection apparatus to project the video onto the projection region.

First claim

The invention claimed is:

1. An information processing apparatus, comprising:
circuitry configured to:
receive sensing information and coordinate information as input, wherein
the sensing information is obtained by sensing a space in which video is projected, and
the coordinate information is obtained by pointing through a pointing operation of the space by a user;

store setting information for setting a projection region in a specific range in a storage unit based on a result of analyzing a state in the space, wherein the result is analyzed based on the sensing information and the coordinate information;
control, based on designation of the projection region by the user, a projection apparatus to project the video onto the projection region, wherein the projection region is designated by the user based on the stored setting information;
determine that the projection region is designated, based on reception of the pointing operation by the user in an extended region including the set projection region and which is extended to be larger than the projection region; and
handle, based on presence of an overlap region between the extended regions of a plurality of projection regions, the pointing operation with respect to the overlap region as an invalid operation.

2. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to set the projection region, based on the result of analysis, to be centered on first coordinates indicated by the coordinate information.

3. The information processing apparatus according to claim 2 , wherein the circuitry is further configured to set the projection region along a specific edge of a plurality of edges of an object recognized in vicinity of second coordinates indicated by the coordinate information.

4. The information processing apparatus according to claim 3 , wherein
the circuitry is further configured to set, based on detection of the plurality of edges within a distance that is a specific radius from the second coordinates indicated by the coordinate information, the projection region along the specific edge of the plurality of edges, and
the specific edge minimizes a movement distance when the second coordinates are moved along the plurality of edges.

5. The information processing apparatus according to claim 3 , wherein the circuitry is further configured to change an area of the projection region set in accordance with an area of a plane including the second coordinates indicated by the coordinate information.

6. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to output, based on detection of the pointing operation as one of outside the extended region or inside the overlap region, feedback information for providing a feedback indicating that the pointing operation is invalid to the user.

7. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:
store the setting information together with identification information for identifying the projection region; and
determine that a projection region corresponding to the identification information is designated when at least one of an operation or voice to select the identification information is input from the user.

8. An information processing method, comprising:
receiving input of sensing information and coordinate information, wherein
the sensing information is obtained by sensing a space in which video is projected, and
the coordinate information is obtained by pointing through a pointing operation of the space by a user;

storing setting information for setting a projection region in a specific range based on a result of analyzing a state in the space, wherein the result is analyzed based on the sensing information and the coordinate information;
controlling, based on designation of the projection region by the user, a projection apparatus to project the video onto the projection region, wherein the projection region is designated by the user based on the stored setting information;
determining that the projection region is designated, based on reception of the pointing operation by the user in an extended region including the set projection region and which is extended to be larger than the projection region; and
handling, based on presence of an overlap region between the extended regions of a plurality of projection regions, the pointing operation with respect to the overlap region as an invalid operation.

9. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
receiving input of sensing information and coordinate information, wherein
the sensing information is obtained by sensing a space in which video is projected, and
the coordinate information is obtained by pointing through a pointing operation of the space by a user;

storing setting information for setting a projection region in a specific range based on a result of analyzing a state in the space, wherein the result is analyzed based on the sensing information and the coordinate information;
controlling, based on designation of the projection region by the user, a projection apparatus to project the video onto the projection region, wherein the projection region is designated by the user based on the stored setting information;
determining that the projection region is designated, based on reception of the pointing operation by the user in an extended region including the set projection region and which is extended to be larger than the projection region; and
handling, based on presence of an overlap region between the extended regions of a plurality of projection regions, the pointing operation with respect to the overlap region as an invalid operation.

10. The information processing apparatus according to claim 3 , wherein the circuitry is further configured to output, based on a determination that a surface in vicinity of the second coordinates indicated by the coordinate information is unsuitable for projection based on the analysis, information to execute the pointing operation on the first coordinates, wherein the first coordinates are different from the second coordinates.

Assignees

• Sony Corp

Inventors

• Ida Kentaro
• Aoki Yu

Classifications

• H04N9/3194

  including sensor feedback · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• H04N9/3185 Primary

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• G09G5/00

  Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) · CPC title

• G09G5/36

  characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory · CPC title