Detection device, electronic apparatus, detection method and program

Patent metadata

Field	Value
Publication number	US-10860139-B2
Application number	US-201916434217-A
Country	US
Kind code	B2
Filing date	Jun 7, 2019
Priority date	Dec 26, 2014
Publication date	Dec 8, 2020
Grant date	Dec 8, 2020

Abstract

A detection device that detects an operation by a user on a display in midair, includes: a control unit that changes a positional relationship between a detection reference detecting the operation and the display, wherein: the control unit is capable of changing the positional relationship by user.

First claim

The invention claimed is:

1. A detection device that detects an operation by a user for a midair display, which is located in the space above a display device that generates the midair display, the detection device comprising:
a processor that is configured to change a positional relationship between (i) the midair display and (ii) a detection reference at which the operation for the midair display is determined to be performed by setting a predetermined range, which includes a reach position of a pressing operation for the midair display by the user, as the detection reference, wherein:
the processor is further configured to set as the detection reference a three dimensional area that is present between (i) a position apart from a position of the midair display by a first distance along a first direction opposite to a second direction in which the pressing operation is performed and (ii) a position apart from the position of the midair display by a second distance along the second direction;
the processor is further configured to change the positional relationship between the detection reference and the midair display by moving the midair display in the first direction so that the user perceives the midair display (i) as being positioned outside the detection reference and (ii) to be moved in the first direction by a distance corresponding to a distance between the detection reference and the reach position of the pressing operation; and
the changed positional relationship between the detection reference and the midair display remains after the pressing operation by the user ends.

2. The detection device according to claim 1 , wherein
the first distance and the second distance are substantially equal.

3. The detection device according to claim 1 , wherein
an area that is present between (i) a position apart from the position of the midair display along the first direction by a distance larger than the first distance and (ii) a surface of a detector that detects the operation is a detection area in which the operation can be detected.

4. The detection device according to claim 1 , wherein
the processor changes the positional relationship based on the operation by the user at the detection reference and outside the detection reference.

5. The detection device according to claim 1 , wherein
the processor determines the reach position of the pressing operation based on a velocity of the pressing operation.

6. The detection device according to claim 1 , wherein
the processor is capable of changing the positional relationship based on the user, and changes the positional relationship based on a designated position designated by the user;
the operation by the user is performed with a finger of the user; and
the processor designates a detected position of the finger as the designated position when a sound from the user is detected.

7. The detection device according to claim 6 , wherein
the processor causes to be displayed information relating to designation for the midair display.

8. The detection device according to claim 6 , wherein
the processor designates a detected position of the finger as the designated position when an operation determining the designated position is detected.

9. The detection device according to claim 1 , wherein
the processor changes the positional relationship based on the user.

10. The detection device according to claim 9 , wherein
information on the user includes at least one of: information relating to user age; information relating to user body type; information relating to gender; and information relating to user visual acuity.

11. The detection device according to claim 10 , wherein
the processor identifies the user based on information input to the processor by the user.

12. The detection device according to claim 1 , wherein
the processor changes the positional relationship based on a change in an environment surrounding the detection device attributable to the user.

13. The detection device according to claim 1 , further comprising
a detector that detects the operation by the user performed on the midair display based on the detection reference.

14. The detection device according to claim 13 , further comprising
an image-capturing unit that captures an image of the operation by the user, wherein
the detector detects the operation by the user based on the image captured by the image-capturing unit.

15. A detection device comprising
a detector that detects an operation of an object to be detected for a midair display, which is located in the space above a display device that generates the midair display, and a predetermined sound from the object to be detected, wherein:
the detector is configured to change a positional relationship between (i) the midair display and (ii) a detection reference at which the operation for the midair display is determined to be performed so that a position at which the object to be detected reaches when the predetermined sound is detected is included within the detection reference;
the detector is configured to set as the detection reference a three dimensional area that is present between (i) a position apart from a position of the midair display by a first distance along a first direction opposite to a second direction in which the operation is performed and (ii) a position apart from the position of the midair display by a second distance along the second direction;
the detector is configured to change the positional relationship between the detection reference and the midair display by moving the midair display in the first direction so that a user perceives the midair display (i) as being positioned outside the detection reference and (ii) to be moved in the first direction by a distance between the detection reference and the position at which the object to be detected reaches when the predetermined sound is detected; and
the changed positional relationship between the detection reference and the midair display remains after the operation by the object to be detected ends.

16. The detection device according to claim 15 , wherein
the first distance and the second distance are substantially equal.

17. The detection device according to claim 15 , wherein
an area that is present between (i) a position apart from the position of the midair display along the first direction by a distance larger than the first distance and (ii) a surface of the detector that detects the operation is a detection area in which the operation can be detected.

18. An electronic apparatus equipped with the detection device according to claim 1 .

19. A detection method that detects an operation by at least a part of an object to be detected performed for a midair display, which is located in the space above a display device that generates the midair display, the method comprising:
setting a detection reference at which the operation for the midair display is determined to be performed as a three dimensional area that is present between (i) a position apart from a position of the midair display by a first distance along a first direction opposite to a second direction in which the operation is performed and (ii) a position apart from the position of the midair display by a second distance along the second direction and that includes a reach position at which at least the part of the object to be detected reaches during the operation; and
changing a positional relationship between the detection reference and the midair display by moving the midair display in the

Assignees

• Nikon Corp

Inventors

• Kuribayashi Hidenori
• Tanabe Tatsuyoshi
• Shimoyama Marie
• Toki Hidefumi
• Komiya Daisaku

Classifications

• G07F19/20

  Automatic teller machines [ATMs] · CPC title

• G07F7/1033

  Details of the PIN pad · CPC title

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G06F3/0423

  using sweeping light beams, e.g. using rotating or vibrating mirror · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title