Gesture detection system and method using a radar sensor

Patent metadata

Field	Value
Publication number	US-11416077-B2
Application number	US-201816040019-A
Country	US
Kind code	B2
Filing date	Jul 19, 2018
Priority date	Jul 19, 2018
Publication date	Aug 16, 2022
Grant date	Aug 16, 2022

Abstract

A controller is configured to be coupled to a millimeter-wave radar mounted on a device, where the millimeter-wave radar includes a field of view in a direction away from the device. The controller is configured to: detect a presence of an object in a first range zone of a plurality of range zones of the field of view, where each range zone of the plurality of range zones respectively corresponds to different distance ranges relative to the device, and where each range zone is associated with a respective command database; determine a gesture signature based on detecting the presence of the object in the first range zone of the field of view; and cause execution of a command chosen from the respective command database associated with the first range zone as a function of the gesture signature.

First claim

What is claimed is:

1. A controller configured to be coupled to a plurality of millimeter-wave radars mounted on a device grouped into a plurality of millimeter-wave radar sets, the millimeter-wave radars comprising a field of view in a direction away from the device, the controller configured to:
detect a presence of an object in a first range zone of a plurality of range zones of the field of view, wherein each range zone of the plurality of range zones respectively corresponds to different distance ranges relative to the device, and wherein each range zone is associated with a respective command database;
determine a gesture signature based on detecting the presence of the object in the first range zone of the field of view using the plurality of millimeter-wave radars synchronized to a time reference housed in the device;
cause execution of a command chosen from the respective command database associated with the first range zone as a function of the gesture signature; and
dynamically change a number of the plurality of millimeter-wave radar sets of the device by selectively enabling or disabling millimeter-wave radars from at least one of the plurality of millimeter-wave radar sets based on user input to the device, to enable a first command execution from a first radar set simultaneously with a second command execution from a second radar set, wherein the first command execution and the second command execution are associated with the gesture signature.

2. The controller of claim 1 , wherein the detected presence of the object at a first time corresponds to a range zone of the plurality of range zones that is closest to the device in which the presence of the object is detected at the first time.

3. The controller of claim 1 , wherein the plurality of range zones comprises four or more range zones.

4. The controller of claim 1 , wherein the object comprises a human finger.

5. The controller of claim 1 , wherein each range zone of the plurality of range zones is associated with a respective database of gesture signatures, wherein the controller is further configured to determine the gesture signature based on a range trajectory of the object in the first range zone and on the respective database of gesture signatures.

6. The controller of claim 1 , wherein the plurality of range zones comprises a second range zone, and wherein the controller is further configured to determine the gesture signature based on detecting the presence of the object in the first range zone at a first time, and in the second range zone at a second time after the first time.

7. The controller of claim 6 , wherein the first range zone and the second range zone partially overlap.

8. The controller of claim 6 , further configured to dynamically change a location of the first range zone or the second range zone based on a state of the device.

9. A device comprising:
a screen;
a plurality of millimeter-wave radars mounted on the device grouped into a plurality of millimeter-wave radar sets, the millimeter-wave radars having a field of view; and
a controller configured to:
detect a presence of an object in a first range zone of a plurality of range zones of the field of view, wherein each range zone of the plurality of range zones respectively corresponds to different distance ranges relative to the device, and wherein each range zone is associated with a respective command database;
determine a gesture signature based on detecting the presence of the object in the first range zone of the field of view using the plurality of millimeter-wave radars synchronized to a time reference housed in the device;
cause execution of a command chosen from the respective command database associated with the first range zone as a function of the gesture signature; and
dynamically change a number of the plurality of millimeter-wave radar sets of the device by selectively enabling or disabling millimeter-wave radars from at least one of the plurality of millimeter-wave radar sets based on user input to the device, to enable a first command execution from a first radar set simultaneously with a second command execution from a second radar set, wherein the first command execution and the second command execution are associated with the gesture signature.

10. The device of claim 9 , wherein at least one of the millimeter-wave radars is a monostatic millimeter-wave radar.

11. The device of claim 9 , wherein each range zone of the plurality of range zones is associated with a respective database of gesture signatures, wherein the controller is further configured to determine the gesture signature based on a range trajectory of the object in the first range zone from a first range to a second range, the first range being closer to the screen than the second range, and wherein the command comprises increasing a volume of the device or another device based on the determined gesture signature.

12. The device of claim 9 , wherein the controller is configured to ignore the presence of the object in the field of view when the object is at first distance or closer to the screen.

13. The device of claim 12 , wherein the first distance is between 2 cm and 5 cm.

14. The device of claim 9 , wherein the screen is a touchscreen, wherein the touchscreen is disposed in a front of the device, and wherein the field of view has a direction away from the touchscreen and partially covering the front of the device.

15. The device of claim 9 , wherein the screen is disposed in a front of the device, and wherein the field of view has a direction away from the device and partially covering a back of the device.

16. A method comprising:
detecting a presence of an object in a first range zone of a plurality of range zones of a field of view of a plurality of millimeter-wave radars mounted on a device grouped into a plurality of millimeter-wave radar sets, the plurality of range zones respectively corresponding to different distance ranges relative to the device, wherein each range zone of the plurality of range zones is associated with a respective command database;
determining a gesture signature based on detecting the presence of the object in the first range zone using the plurality of millimeter-wave radars synchronized to a time reference housed in the device;
choosing a command from the respective command database associated with the first range zone based on the determined gesture signature;
executing the command; and
dynamically change a number of the plurality of millimeter-wave radar sets of the device by selectively enabling or disabling millimeter-wave radars from at least one of the plurality of millimeter-wave radar sets based on user input to the device, to enable a first command execution from a first radar set simultaneously with a second command execution from a second radar set, wherein the first command execution and the second command execution are associated with the gesture signature.

17. The method of claim 16 , further comprising receiving information from the millimeter-wave radars via wireless communication.

18. The method of claim 16 , further comprising communicating with the millimeter-wave radars using a serial peripheral interface (SPI).

19. The method of claim 16 , wherein detecting the presence of the object in the first range zone comprises detecting the presence of the object with at least 8-bit accuracy.

20. The method of claim 16 , wherein the device is a smartphone, wherein the determined gesture signature is associated with a trajectory of the ob

Assignees

• Infineon Technologies Ag

Inventors

• Baheti Ashutosh
• Santra Avik
• Barsilai Fernandez Mandy

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G01S7/415 Primary

  Identification of targets based on measurements of movement associated with the target · CPC title

• G06F2203/04108

  Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction · CPC title

• G06F21/33

  using certificates · CPC title

• G01S13/9064

  Inverse SAR [ISAR] · CPC title