Electronic apparatus for recognizing user and controlling method thereof

Patent metadata

Field	Value
Publication number	US-11144791-B2
Application number	US-201916445710-A
Country	US
Kind code	B2
Filing date	Jun 19, 2019
Priority date	Jul 3, 2018
Publication date	Oct 12, 2021
Grant date	Oct 12, 2021

Abstract

An electronic apparatus for recognizing a user and a method therefor are provided. The electronic apparatus includes a communication interface, a dynamic vision sensor (DVS), a memory including a database in which one or more images are stored, and at least one processor. The at least one processor is configured to generate an image, in which a shape of an object is included, based on an event detected through the DVS, control the memory to store a plurality of images generated under a specified condition, in the database, identify shapes of the user included in each of the plurality of images stored in the database, and generate shape information for recognizing the user based on the identified shapes. The plurality of images may include a shape of a user.

First claim

What is claimed is:

1. An electronic apparatus comprising:
a communication interface;
a dynamic vision sensor (DVS) comprising a plurality of sensing elements;
a memory including a database in which one or more images are stored; and
at least one processor configured to:
generate an event signal when a sensing element of the plurality of sensing elements detects a change in a light intensity,
store information about a point in time when the change in the light intensity occurred in an event map based on the generated event signal as a time information, wherein the event map includes a plurality of map elements corresponding to the plurality of sensing elements,
generate an image, in which a shape of an object is included, la displaying a specified value in pixels corresponding to each of the plurality of map elements, based on the time information which is stored in the event map,
store a plurality of images generated under a specified condition, in the database, the plurality of images including a shape of a user,
identify shapes of the user included in each of the plurality of images stored in the database, and
generate shape information for recognizing the user based on the identified shapes.

2. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
extract features of the identified shapes of the user; and
generate the shape information based on the extracted features of the shapes.

3. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
receive identification information for distinguishing the user, from an external electronic apparatus via the communication interface; and
store the plurality of images generated within a specified time from a point in time when the identification information is received, in the database.

4. The electronic apparatus of claim 3 , wherein the at least one processor is further configured to:
when only a shape of the user is included in each of the plurality of images, store the plurality of images in the database.

5. The electronic apparatus of claim 4 , wherein the external electronic apparatus receives the identification information from a key, a user terminal, or a beacon including a radio frequency integrated circuit (RFIC) and performs a specified operation in response to the received identification information.

6. The electronic apparatus of claim 5 , wherein the specified operation is an operation of setting or disabling security.

7. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
generate the plurality of images based on an event detected in a specified space via the DVS;
transmit the plurality of images to a user terminal via the communication interface;
receive feedback information for determining whether the shape of the user is stored in the plurality of images, from the user terminal via the communication interface; and
store the plurality of images in the database based on the feedback information.

8. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
when the shape of the user is stored in the plurality of images more than a specified number of times, transmit the plurality of images to a user terminal.

9. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
recognize the user by identifying the shape of the user included in the generated image, via the DVS based on the generated shape information.

10. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
provide a service corresponding to the recognized user.

11. The electronic apparatus of claim 10 , wherein the at least one processor is further configured to:
control at least one internet of things (IoT) device depending on the recognized user.

12. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
process the plurality of images via an external server to obtain the shape information.

13. A control method of an electronic apparatus, the method comprising:
generating an event signal when a sensing element of a plurality of sensing elements within a dynamic vision sensor (DVS) detects a change in a light intensity;
storing information about a point in time when the change in the light intensity occurred in an event map based on the generated event signal as a time information, wherein the event map includes a plurality of map elements corresponding to the plurality of sensing elements;
generating an image, in which a shape of an object is included, by displaying a specified value in pixels corresponding to each of the plurality of map elements, based on the time information which is stored in the event map;
storing a plurality of images generated under a specified condition, in a database, wherein the plurality of images include a shape of a user;
identifying shapes of the user included in each of the plurality of images stored in the database; and
generating shape information for recognizing the user based on the identified shapes.

14. The method of claim 13 , wherein the generating of the shape information includes:
extracting features of the identified shapes of the user; and
generating the shape information based on the extracted features of the shapes.

15. The method of claim 13 , further comprising:
receiving identification information for distinguishing the user, from an external electronic apparatus via a communication interface,
wherein the storing of the plurality of images in the database includes:
storing the plurality of images generated within a specified time from a point in time when the identification information is received, in the database.

16. The method of claim 15 , wherein the storing of the plurality of images in the database includes:
when only a shape of the user is included in each of the plurality of images, storing the plurality of images in the database.

17. The method of claim 15 , wherein the external electronic apparatus receives the identification information from a key, a user terminal, or a beacon including an RFIC and performs a specified operation in response to the received identification information.

18. The method of claim 13 , wherein the generating of the image includes:
generating the plurality of images based on an event detected in a specified space via the DVS;
transmitting the plurality of images to a user terminal via the communication interface;
receiving feedback information for determining whether the shape of the user is included in the plurality of images, from the user terminal via the communication interface; and
storing the plurality of images in the database based on the feedback information.

19. The method of claim 18 , wherein the transmitting of the plurality of images to the user terminal includes:
when the shape of the user is included in the plurality of images more than a specified number of times, transmitting the plurality of images to the user terminal.

20. The method of claim 13 , further comprising:
recognizing the user by identifying the shape of the user included in the generated image, via the DVS based on the generated shape information.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Yu Yongju
• Kim Yongwook
• Lee Dongkyu
• Kwon Kiyoung
• Kim Jimin
• Kim Chulkwi

Classifications

• G06F16/5854 Primary

  using shape and object relationship · CPC title

• G06V10/7784

  based on feedback from supervisors · CPC title

• G06V40/103

  Static body considered as a whole, e.g. static pedestrian or occupant recognition · CPC title

• G06V10/752

  Contour matching · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title