Method and system for image processing to classify an object in an image

Patent metadata

Field	Value
Publication number	US-9269154-B2
Application number	US-68690210-A
Country	US
Kind code	B2
Filing date	Jan 13, 2010
Priority date	Jan 13, 2009
Publication date	Feb 23, 2016
Grant date	Feb 23, 2016

Abstract

In an image processing method, an object is located within an image. An area around the object is determined and divided into at least first and second portions based upon image information within the area. The object can then be classified based upon both image information in the first portion of the area and image information in the second portion of the area.

First claim

What is claimed is:

1. An image processing method comprising:
receiving an image;
locating an object within a frame of the image, the foreground object being depicted by a plurality of pixels;
determining an area around the foreground object within the frame of the image, the area including a plurality of rows;
calculating a plurality of row color histograms for less than ten percent of a total number of rows in the plurality of rows;
dividing, using a processor, the area into at least first and second portions based upon the plurality of row color histograms, wherein the first portion comprises a first group of the pixels including a portion of the foreground object and the second portion comprises a second group of the pixels including a different portion of the foreground object, the first group of the pixels having a first color characteristic based on at least one of the plurality of row color histograms and the second group of the pixels having a second color characteristic different from the first color characteristic and based on a different at least one of the plurality of row color histograms; and
after the dividing, classifying the foreground object within the frame of the image based upon both the first color characteristic of the first portion of the area and also the second color characteristic of the second portion of the area, the characteristic being performed by comparing the first color characteristic with first stored color characteristic information and comparing the second color characteristic with second stored color characteristic information.

2. The method of claim 1 , wherein receiving the image comprises receiving a video image.

3. The method of claim 2 , wherein receiving the image comprises receiving an internet protocol television (IPTV) image.

4. The method of claim 1 , wherein dividing the area into at least first and second portions comprises locating a line at a color boundary within the area.

5. The method of claim 4 , wherein the area comprises a rectangle and the line comprises a line such that the area is divided into only first and second portions.

6. The method of claim 1 , wherein the first portion is represented by a first color histogram of the plurality of row color histograms and the second portion is represented by a second color histogram of the plurality of row color histograms and wherein the area is divided into the first and second portions based upon the first and second color histograms.

7. The method of claim 6 , wherein dividing the area into at least first and second portions comprises locating a line at a color boundary utilizing a Bhattacharyya distance.

8. The method of claim 7 , wherein locating the line comprises utilizing a weighted Bhattacharyya distance.

9. The method of claim 6 , wherein dividing the area into at least first and second portions comprises comparing each row color histograms of the plurality of row color histograms with first and/or second color histograms to determine a location of a boundary between the first portion and the second portion.

10. The method of claim 9 , wherein the area comprises a rectangle.

11. The method of claim 1 , wherein the object comprises a sports player having a jersey and shorts and wherein classifying the object comprises classifying the object based upon a color of the jersey and a color of the shorts.

12. The method of claim 1 , wherein classifying the foreground object comprises determining an affiliation of the foreground object with an organization.

13. A method for classifying individuals in a video, the method being performed on a processor and comprising:
receiving a video image;
locating a single player/referee within the video image, the player/referee comprising a plurality of pixels in a fame of the video image;
determining an area around the player/referee, wherein the area distinguishes the player/referee from other player/referees in the image and the area comprises a plurality of rows;
calculating a plurality of row color histograms for less than ten percent of a total number of rows in the plurality of rows;
dividing, base on the plurality of row color histograms, the area into an upper portion that includes a first group of the pixels that depict an upper portion of the player/referee and a lower portion that includes a second group of the pixels that depict a lower portion of the player/referee;
determining color information of row histograms for the upper portion and color information of row color histograms for the lower portion;
comparing the color information of row color histograms for the upper portion with known top color information and comparing the color information of row color histograms for the lower portion with known bottom color information; and
indentifying a characteristic of the player/referee based upon a result of the comparing step, the characteristic related to affiliation.

14. The method of claim 13 , wherein the video image is a sports video, wherein in the known top color information comprises jersey color information and wherein the known bottom color information is shorts color information.

15. The method of claim 14 , wherein identifying the characteristic of the individual comprises determining a team of the player.

16. The method of claim 13 , wherein identifying the characteristic of the individual comprises determining an identity of the individual.

17. The method of claim 13 , wherein receiving the video image comprises receiving a broadcast video image and wherein identifying the characteristic is performed substantially in real-time with the broadcast video image.

18. A non-transitory computer-readable storage medium with an executable program stored thereon, wherein the program instructs a microprocessor to perform the following steps:
locating an object within an frame of an image, the foreground object being depicted by a plurality of pixels;
determining an area around the foreground object within the frame of the image, the area including a plurality of rows;
calculating a plurality of row color histograms for less than ten percent of a total number or rows in the plurality of rows;
dividing the area into at least first and second portions based upon the plurality of row color histograms, wherein the first portion comprises a first group of the pixels including a portion of the foreground object and the second portion comprises a second group of the pixels including a different portion of the foreground object, the first group of the pixels having a first color characteristic based on at least one of the plurality of row color histograms and the second group of the pixels having a second color characteristic different from the first color characteristic and based on a different at least one of the plurality of row color histograms; and
classifying the foreground object within the frame of the image based upon the first color characteristic of the first portion of the area and also the second color characteristic of the second portion of the area, the classifying being performed by comparing the first color characteristic with first stored color characteristic information and comparing the second color characteristic with second stored color characteristic information.

19. An interactive television system comprising:
an authoring tool configured to
receive a video image, locate a plurality of pixels depicting an object within the broadcast video image;
determine an area around the object that segments the object from the objects in the image, the area includ

Assignees

• Huang Yu
• Li Hongbing
• Tian Jun
• Yu Hong Heather
• Futurewei Technologies Inc

Inventors

• Huang Yu
• Li Hongbing
• Tian Jun
• Yu Hong Heather

Classifications

• G06F18/24

  Classification techniques · CPC title

• G06V10/56

  relating to colour · CPC title

• G06V10/50

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• G06V10/255

  Detecting or recognising potential candidate objects based on visual cues, e.g. shapes · CPC title

• G06K9/4642

  Physics · mapped topic