Gesture recognition method, an apparatus and a computer program for the same

Patent metadata

Field	Value
Publication number	US-9922241-B2
Application number	US-201114361372-A
Country	US
Kind code	B2
Filing date	Dec 1, 2011
Priority date	Dec 1, 2011
Publication date	Mar 20, 2018
Grant date	Mar 20, 2018

Abstract

The invention concerns a gesture recognition method for gesture-based interaction at an apparatus. The method comprises receiving one or more images of an object; creating feature images for the received one or more images; determining binary values for pixels in corresponding locations of said feature images and concatenating the binary values to form a binary string for said pixel; repeating the previous step for each corresponding pixel of said feature image to form a feature map and forming a histogram representation of the feature map. The invention also concerns an apparatus and a computer program.

First claim

What is claimed is:

1. A method comprising:
receiving one or more images of an object,
creating feature images for the received one or more images,
determining binary values for pixels in corresponding locations of said feature images and concatenating the binary values to form a binary string for said pixel,
repeating the previous determination of binary values for each corresponding pixel of said feature image to form a feature map, and
forming a histogram representation of the feature map.

2. The method of claim 1 , wherein the received one or more images are captured by an infrared sensor.

3. The method of claim 1 , wherein the received one or more images are captured by a camera sensor.

4. The method of claim 1 , wherein the received one or more images is an image of a hand.

5. The method of claim 1 , further comprising:
using multiple features extractors for determining a shape of the object and for creating the feature images.

6. The method of claim 1 , further comprising:
acquiring binary values from at least two feature images to each image location to compose a binary string for the image location in question.

7. The method of claim 1 , further comprising one of:
converting the binary string of each corresponding pixel to an integer value and
dividing the feature map into blocks and performing a histogram statistics for each block.

8. The method of claim 7 , further comprising:
concatenating histograms of all blocks into a long feature vector to represent an image of the object.

9. The method of claim 1 , wherein the received image is a video frame.

10. An apparatus comprising a processor, and memory including computer program code, the memory and the computer program code configured to, with the processor, cause the apparatus to perform at least the following:
receive one or more images of an object,
create feature images for the received one or more images,
determine binary values for each of a plurality of pixels in corresponding locations of said feature images and concatenating the binary values to form a binary string for each respective pixel,
incorporate each of the binary values for each corresponding pixel of said feature image to form a feature map
form a histogram representation of the feature map representative of spatial distribution features of the one or more images; and
compare each histogram representation to stored histogram representations to determine whether each histogram representation is associated with an object type or a background.

11. The apparatus of claim 10 , comprising an infrared sensor configured to capture said one or more images.

12. The apparatus of claim 10 , wherein the received one or more images is an image of a hand.

13. The apparatus of claim 10 , wherein the computer program code is further configured to, with the processor, cause the apparatus to perform
use multiple features extractors for determining a shape of the object and for creating the feature images.

14. The apparatus of claim 10 , wherein the computer program code is further configured to, with the processor, cause the apparatus to perform
acquire binary values from at least two feature images to each image location to compose a binary string for the image location in question.

15. The apparatus of claim 10 , wherein the computer program code is further configured to, with the processor, cause the apparatus to perform:
convert the binary string of each corresponding pixel to an integer value.

16. The apparatus of claim 10 , wherein the computer program code is further configured to, with the processor, cause the apparatus to perform
divide the feature map into blocks and performing a histogram statistics for each block.

17. The apparatus of claim 16 , wherein the computer program code is further configured to, with the processor, cause the apparatus to perform
concatenate histograms of all blocks into a long feature vector to represent an image of the object.

18. The apparatus of claim 10 , wherein the received image is a video frame.

19. A computer program product comprising a non-transitory computer readable medium and a computer program embodied thereon, the computer program comprising instructions causing, when executed on at least one processor, at least one apparatus to:
receive one or more images of an object,
create feature images for the received one or more images,
determine binary values for each of a plurality of pixels in corresponding locations of said feature images and concatenating the binary values to form a binary string for each respective pixel,
incorporate each of the binary values for each corresponding pixel of said feature image to form a feature map,
form a histogram representation of the feature map representative of spatial distribution features of the one or more images; and
compare each histogram representation to stored histogram representations to determine whether each histogram representation is associated with an object type or a background.

20. The method of claim 1 , wherein the histogram representation of the feature map reflects reduced noise and reduced frequency relative to the one or more images.

Assignees

• Li Jiangwei
• Wang Kongqiao
• Xu Lei
• Nokia Technologies Oy

Inventors

• Li Jiangwei
• Wang Kongqiao
• Xu Lei

Classifications

• G06V10/40

  Extraction of image or video features · CPC title

• G06V10/50

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• G06V10/467

  Encoded features or binary features, e.g. local binary patterns [LBP] · CPC title

• G06K9/00355 Primary

  Physics · mapped topic

• G06K9/46

  Physics · mapped topic