Display control apparatus, display control method, and display control program

Patent metadata

Field	Value
Publication number	US-9342142-B2
Application number	US-80696610-A
Country	US
Kind code	B2
Filing date	Aug 25, 2010
Priority date	Sep 4, 2009
Publication date	May 17, 2016
Grant date	May 17, 2016

Abstract

A display control apparatus includes a recognizing unit configured to recognize a position of an operator and a position of a hand or the like of the operator, a calculating unit configured to regard a position of the operator in a screen coordinate system set on a screen as an origin of an operator coordinate system and multiply a position of the hand or the like with respect to the origin of the operator coordinate system by a predetermined function, thereby calculating a position of display information corresponding to the hand or the like in the screen coordinate system, and a control unit configured to cause the display information to be displayed at the position in the screen coordinate system calculated by the calculating unit.

First claim

What is claimed is:

1. A display control apparatus comprising:
a recognizing unit configured to recognize a position of an operator and a position of an operation object of the operator;
a calculating unit configured to regard a position of the operator in a screen coordinate system set on a screen as an origin of an operator coordinate system and to calculate a position of display information corresponding to the operation object in the screen coordinate system; and
a control unit configured to cause the display information to be displayed at the position in the screen coordinate system calculated by the calculating unit; and
a determining unit configured to (i) determine a first operation range of the operation object in a first direction and a second operation range of the operation object in a second direction which is different from the first direction and (ii) set a first scaling ratio in the first direction based on the determined first operation range and a size of the screen in said first direction and set a second scaling ratio in the second direction based on the determined second operation range and a size of the screen in said second direction such that when the operation object is moved by the operator to an end of the operation range in the first direction the operation object is located at an end of the screen in the first direction and such that when the operation object is moved by the operator to an end of the operation range in the second direction the operation object is located at an end of the screen in the second direction.

2. The display control apparatus according to claim 1 ,
wherein, the recognizing unit recognizes the position of the operator and the position of the operation object from a camera image, and the calculating unit regards a position of the operator in an image coordinate system of the camera image as the origin of the operator coordinate system, the image coordinate system being set as a coordinate system that is identical to the screen coordinate system.

3. The display control apparatus according to claim 1 ,
wherein, the position of the operation object is a position of a hand of the operator.

4. The display control apparatus according to claim 1 ,
wherein, the recognizing unit recognizes a gesture operation performed by the operation object from the camera image.

5. The display control apparatus according to claim 1 ,
wherein, the recognizing unit determines the correspondence between the operator and the operation object based on a positional relationship between the operator and the operation object.

6. The display control apparatus according to claim 1 , in which the first direction is one of a horizontal direction or a vertical direction relative to the screen and the second direction is the other one of the horizontal direction or the vertical direction.

7. The display control apparatus according to claim 6 , in which the determining unit is further configured to (i) determine a third operation range of the operation object in a third direction which is a depth direction so as to be perpendicular to both the horizontal direction and the vertical direction and (ii) set a third scaling ratio in the third direction based on the determined third operation range and a size of the screen in said third direction such that when the operation object is moved by the operator to an end of the operation range in the third direction the operation object is located at an end of the screen in the third direction.

8. A display control method performed by an information processing apparatus, the display control method comprising the steps of:
recognizing a position of an operator and a position of an operation object of the operator;
regarding a position of the operator in a screen coordinate system set on a screen as an origin of an operator coordinate system and multiplying a position of the operation object with respect to the origin of the operator coordinate system by a predetermined function, to calculate a position of display information corresponding to the operation object in the screen coordinate system;
causing the display information to be displayed at the calculated position in the screen coordinate system; and
determining a first operation range of the operation object in a first direction and a second operation range of the operation object in a second direction which is different from the first direction, and setting a first scaling ratio in the first direction based on the determined first operation range and a size of the screen in said first direction and set a second scaling ratio in the second direction based on the determined second operation range and a size of the screen in said second direction, such that when the operation object is moved by the operator to an end of the operation range in the first direction the operation object is located at an end of the screen in the first direction and such that when the operation object is moved by the operator to an end of the operation range in the second direction the operation object is located at an end of the screen in the second direction.

9. The display control method according to claim 8 ,
wherein, the recognizing step determines the correspondence between the operator and the operation object based on a positional relationship between the operator and the operation object.

10. A non-transitory computer readable recording medium having stored thereon a display control program that causes an information processing apparatus to execute:
recognizing a position of an operator and a position of an operation object of the operator;
regarding a position of the operator in a screen coordinate system set on a screen as an origin of an operator coordinate system and calculating a position of display information corresponding to the operation object in the screen coordinate system;
causing the display information to be displayed at the calculated position in the screen coordinate system; and
determining a first operation range of the operation object in a first direction and a second operation range of the operation object in a second direction which is different from the first direction, and setting a first scaling ratio in the first direction based on the determined first operation range and a size of the screen in said first direction and set a second scaling ratio in the second direction based on the determined second operation range and a size of the screen in said second direction, such that when the operation object is moved by the operator to an end of the operation range in the first direction the operation object is located at an end of the screen in the first direction and such that when the operation object is moved by the operator to an end of the operation range in the second direction the operation object is located at an end of the screen in the second direction.

11. The non-transitory computer readable recording medium according to claim 10 ,
wherein, the recognizing determines the correspondence between the operator and the operation object based on a positional relationship between the operator and the operation object.

Assignees

• Shigeta Osamu
• Noda Takuro
• Sony Corp

Inventors

• Shigeta Osamu
• Noda Takuro

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0304 Primary

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/005

  Input arrangements through a video camera · CPC title

• G06F3/038 Primary

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title