Image processing system and method

Patent metadata

Field	Value
Publication number	US-10504228-B2
Application number	US-201615572587-A
Country	US
Kind code	B2
Filing date	Apr 29, 2016
Priority date	May 15, 2015
Publication date	Dec 10, 2019
Grant date	Dec 10, 2019

Abstract

In an image processing system a processor is configured to perform an image processing method. The method performs receiving a spectral image of a person's skin and identifying the person based on the received spectral image of the person's skin and skin reflectance information.

First claim

The invention claimed is:

1. Image processing system, comprising:
a processor configured to
receive a spectral image of a person's skin,
generate a first skin map based on the spectral image, the first skin map identifying for each preset area of the spectral image split into preset areas whether the preset area is related to skin or not,
receive an RGB image,
generate a second skin map based on the RGB image, the second skin map identifying for each preset area of the RGB image split into preset areas whether the preset area is related to skin or not,
generate a real skin map by combining the first skin map and the second skin map, and
identify the person based on the first skin map, skin reflectance information, and the real skin map.

2. Image processing system of claim 1 , wherein
generating the real skin map includes for each preset area of the image, analyzing the preset area with respect to a skin characteristic dependent on an image type.

3. Image processing system of claim 1 , wherein the processor is further configured to
generate the first skin map based on the spectral image based on a machine learning model.

4. Image processing system of claim 3 , wherein the machine learning model is trained in advance on the basis of a set of training samples, wherein each training sample comprises a spectral image obtained from a spectral camera and a corresponding classifier which indicates if the spectral image is associated to skin or not.

5. Image processing system of claim 1 , wherein the processor is further configured to
post-filter the real skin map.

6. Image processing system of claim 1 , wherein the processor is further configured to
receive a further spectral image; and
filter the further spectral image based on the real skin map, wherein identifying the person is further based on the filtered spectral image.

7. Image processing system of claim 1 , wherein the skin reflectance information comprises skin reflectance information of each of registered users stored in a database.

8. Image processing system of claim 1 , wherein the processor is further configured to
compare the received spectral image of the person's skin with skin reflectance information of each registered user; and
identify the person as one of the registered users, if the received spectral image matches with the skin reflectance information of one of the registered users.

9. Image processing system of claim 8 , wherein the processor is further configured to
determine that the person is not a registered user, if the received spectral image of the person's skin does not match with the skin reflectance information of one of the registered users.

10. Image processing system claim 8 , wherein the processor is further configured to
register the person as registered user, if the received spectral image of the person's skin does not match with the skin reflectance information of one of the registered users.

11. Image processing system of claim 1 , wherein the spectral image comprises spectral reflectance information which is based on radiation of a predetermined wavelength or wavelength range within the visible spectrum.

12. Image processing system of claim 1 , the processor is further configured to pre-process the spectral image.

13. Image processing system of claim 1 , wherein the processor is further configured to
determine a most probable user from the registered users if the person is identified as more than one user; and
identify the person as the most probable user.

14. Image processing system of claim 1 , further comprising a spectral camera configured to provide the spectral image of the person's skin.

15. Image processing system of claim 1 , further comprising a RGB camera configured to provide an RGB image.

16. Image processing method, comprising:
receiving a spectral image of a person's skin;
generating a first skin map based on the spectral image, the first skin map identifying for each preset area of the spectral image split into preset areas whether the preset area is related to skin or not;
receiving an RGB image;
generating a second skin map based on the RGB image, the second skin map identifying for each preset area of the RGB image split into preset areas whether the preset area is related to skin or not;
generating a real skin map by combining the first skin map and the second skin map; and
identifying the person based on the first skin map, skin reflectance information, and the real skin map.

17. A non-transitory computer-readable storage medium storing computer-readable instructions thereon which, when executed by a computer, cause the computer to perform a method, the method comprising:
receive a spectral image of a person's skin;
generating a first skin map based on the spectral image, the first skin map identifying for each preset area of the spectral image split into preset areas whether the preset area is related to skin or not;
receiving an RGB image;
generating a second skin map based on the RGB image, the second skin map identifying for each preset area of the RGB image split into preset areas whether the preset area is related to skin or not;
generating a real skin map by combining the first skin map and the second skin map; and
identifying the person based on the first skin map, skin reflectance information, and the real skin map.

Assignees

• Sony Corp

Inventors

• Gatto Alexander
• Sartor Piergiorgio
• Wilde Matthias
• Mueller Ralf

Classifications

• G06V40/40 Primary

  Spoof detection, e.g. liveness detection · CPC title

• G06T7/0014 Primary

  using an image reference approach · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title

• G06T2207/30088

  Skin; Dermal · CPC title

• G06T7/11

  Region-based segmentation · CPC title