Device and method with image matching

Patent metadata

Field	Value
Publication number	US-2019251237-A1
Application number	US-201816148129-A
Country	US
Kind code	A1
Filing date	Oct 1, 2018
Priority date	Feb 12, 2018
Publication date	Aug 15, 2019
Grant date	—

Abstract

An image matching method includes extracting, from a first image of an object, a landmark patch including a landmark point of the object; extracting, from a second image of the object, a target patch corresponding to the landmark patch; and determining a target point in the second image corresponding to the landmark point based on a matching between the landmark patch and the target patch.

First claim

What is claimed is:

1 . An image matching method, comprising:
extracting, from a first image of an object, a landmark patch including a landmark point of the object; extracting, from a second image of the object, a target patch corresponding to the landmark patch; and determining a target point in the second image corresponding to the landmark point based on a matching between the landmark patch and the target patch.

2 . The image matching method of claim 1 , further comprising:
acquiring, using a color image sensor, a color image as the first image; and acquiring, using an infrared (IR) image sensor, an IR image as the second image.

3 . The image matching method of claim 1 , further comprising:
determining, based on the target point, whether the object is an anatomical structure of a user.

4 . The image matching method of claim 1 , further comprising:
allowing access, through a user interface of a device, to one or more features of the device in response to the object being determined to be a live anatomical structure and/or a recognized user.

5 . The image matching method of claim 1 , wherein the extracting of the target patch comprises determining the target patch in the second image based on a location of the landmark patch in the first image.

6 . The image matching method of claim 1 , wherein the extracting of the target patch comprises extracting the target patch in response to the landmark point being detected in a determined region of the first image.

7 . The image matching method of claim 6 , wherein the extracting of the target patch comprises determining the determined region based on a difference between a field of view (FOV) of a first image sensor used to capture the first image and an FOV of a second image sensor used to capture the second image.

8 . The image matching method of claim 1 , wherein the determining of the target point comprises:
retrieving, from the target patch, a partial region that matches the landmark patch; and determining a center point of the retrieved partial region as the target point.

9 . The image matching method of claim 8 , wherein the retrieving of the partial region comprises:
calculating a similarity level between the landmark patch and each of a plurality of partial regions of the target patch; and determining a partial region with a highest calculated similarity level among the plurality of partial regions as the partial region that matches the landmark patch.

10 . The image matching method of claim 9 , wherein the calculating of the similarity level comprises calculating a correlation level between values of pixels included in each of the plurality of partial regions of the target patch and pixels included in the landmark patch as the similarity level.

11 . The image matching method of claim 1 , wherein:
the first image is a color image and the second image is an infrared (IR) image; and the extracting of the landmark patch comprises:
selecting a channel image from the first image; and
extracting the landmark patch from the selected channel image.

12 . The image matching method of claim 1 , wherein:
the first image includes a plurality of channel images; and the extracting of the landmark patch comprises extracting the landmark patch from a channel image with a minimum wavelength difference between the channel image and the second image among the plurality of channel images.

13 . The image matching method of claim 1 , wherein:
the extracting of the landmark patch comprises extracting the landmark patch from the first image for each of a plurality of landmarks of the object, the extracting of the target patch comprises extracting the target patch from the second image for each of the plurality of landmarks, and the determining of the target point comprises determining the target point corresponding to the landmark point for each of the plurality of landmarks.

14 . The image matching method of claim 1 , wherein the extracting of the landmark patch comprises:
determining an object region corresponding to the object in the first image; identifying the landmark point of the object in the object region; and extracting the landmark patch including the identified landmark point.

15 . The image matching method of claim 1 , further comprising:
matching the first image and the second image based on the landmark point of the first image and the target point of the second image.

16 . The image matching method of claim 1 , further comprising:
preprocessing the landmark patch and the target patch using a Gaussian filter; and matching the preprocessed landmark patch and the preprocessed target patch.

17 . The image matching method of claim 1 , wherein the extracting of the target patch comprises determining the target patch in the second image based on a location of the landmark patch in the first image and a distance between an image matching device and the object.

18 . The image matching method of claim 1 , further comprising:
determining a point corresponding to a remaining landmark in the second image based on the target point associated with one of a plurality of landmarks of the object in response to the plurality of landmarks of the object being detected in the first image.

19 . The image matching method of claim 1 , further comprising:
recognizing an object present in the second image based on the target point.

20 . The image matching method of claim 1 , further comprising:
verifying a liveness of the object present in the second image based on the target point.

21 . A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1 .

22 . An image matching device, comprising:
one or more processors configured to:
obtain a first image of an object and a second image of the object;
extract, from the first image, a landmark patch including a landmark point of the object,
extract, from the second image, a target patch corresponding to the landmark patch, and
determine a target point in the second image corresponding to the landmark point based on a matching between the landmark patch and the target patch.

23 . The image matching device of claim 22 , further comprising:
one or more image sensors configured to acquire the first image and the second image for the obtaining of the first image and the second image.

24 . An image matching method, comprising:
extracting, from a first image of an object, a first patch including a first feature point of the object; extracting, from a second image of the object, a second patch based on the first patch; determining a second feature point in the second patch; and identifying the object or verifying an identity of the object based on the second feature point and the second image.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Park Sungun
• Kim Jihye
• Han Jaejoon
• Ko Minsu
• Han Seungju
• Son Jinwoo
• Son Changyong

Classifications

• G06V40/172 Primary

  Classification, e.g. identification · CPC title

• G06F21/32 Primary

  using biometric data, e.g. fingerprints, iris scans or voiceprints · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06T2207/10024

  Color image · CPC title