Information collection system, electronic shelf label, electronic pop advertising, and character information display device

Patent metadata

Field	Value
Publication number	US-12026748-B2
Application number	US-202217858805-A
Country	US
Kind code	B2
Filing date	Jul 6, 2022
Priority date	Sep 27, 2016
Publication date	Jul 2, 2024
Grant date	Jul 2, 2024

Abstract

Provided are an information collection system, an electronic shelf label, an electronic POP advertising, and a character information display device that allow information with higher accuracy to be collected. An information collection device that collects information associated with a customer or a product is included for each product type. Alternatively, an information processing device that supplies information associated with a product and an information display terminal that displays information associated with a product supplied from the information processing device are included.

First claim

What is claimed is:

1. An information collection system, comprising:
an information collection device that includes a plurality of image pickup units configured to capture a plurality of images, wherein
each image pickup unit of the plurality of image pickup units is associated with one product type of a plurality of product types, and
each image of the plurality of images includes a plurality of users; and

an image analysis device configured to:
group a set of face images from the plurality of images that includes one of a first user of the plurality of users or a second user of the plurality of users;
identify at least one face image of the set of face images in which a face of respective one of the first user or the second user faces a front the most among the set of face images; and
extract first information related to the respective one of the first user or the second user based on the identified at least one face image.

2. The information collection system according to claim 1 , wherein the first information related to the respective one of the first user or the second user includes second information associated with which product type the plurality of product types the respective one of the first user or the second user looks at.

3. The information collection system according to claim 2 , wherein the second information includes information associated with a result of identification of one of the first user or the second user who looks at the product type for each product type.

4. The information collection system according to claim 3 , wherein the second information associated with the product type further indicates a number of users who look at the product type within a certain period of time.

5. The information collection system according to claim 3 , wherein the information associated with the result of identification of who looks at the product type includes information associated with a time length in which one of the first user or the second user looks at the product type.

6. The information collection system according to claim 1 , wherein the image analysis device is further configured to:
determine timings at which each user of the plurality of users one of moves into or moves out of a frame of each image pickup unit of the plurality of image pickup units;
identify a same user of the plurality of users based on the determined timings; and
group the set of face images from the plurality of images based on the identified same user.

7. The information collection system according to claim 1 , wherein the image analysis device is further configured to:
determine a series of movements of each user of the plurality of users across the plurality of images;
identify a same user of the plurality of users based on the determined series of movements; and
group the set of face images from the plurality of images based on the identified same user.

8. The information collection system according to claim 7 , wherein the determined series of movements includes a movement start time, a movement stop time, and a moving direction.

9. The information collection system according to claim 1 , wherein
the information collection device further includes a ranging sensor, and the information collection device is further configured to supply a result of distance measurement obtained by using the ranging sensor to the image analysis device.

10. The information collection system according to claim 9 , wherein the image analysis device is further configured to identify the same user of the plurality of users based on the result of the distance measurement.

11. The information collection system according to claim 1 , wherein the information collection device is one of a network camera that has an image pickup function and a communication function, an electronic shelf label that has the image pickup function and the communication function, or an electronic point of purchase (POP) advertising that has the image pickup function and the communication function.

12. The information collection system according to claim 1 , wherein
the image analysis device configured to compare the set of face images to determine the at least one face image in which the face of the respective one of the first user or the second user faces the front the most among the set of face images, and
the comparison of the set of face images comprises comparison of directions of the face of the respective one of the first user or the second user in the set of face images.

13. The information collection system according to claim 12 , wherein the comparison of the directions of the face in the set of face images includes a comparison of size of two sections in the face in the set of face images.

14. The information collection system according to claim 1 , further comprising a communication device configured to transmit information acquired from the information collection device and a result of an image analysis process performed by the image analysis device.

15. An information collection system, comprising:
an information collection device that includes a plurality of image pickup units configured to capture a plurality of images, wherein
each image pickup unit of the plurality of image pickup units is associated with one product type of a plurality of product types, and
each image of the plurality of images includes a plurality of users; and

an image analysis device configured to:
identify a first image of the plurality of images in which a face of a first user of the plurality of users faces a front the most among the plurality of images;
identify a second image of the plurality of images in which a face of a second user of the plurality of users faces the front the most among the plurality of images;
extract first information related to the first user based on the identified first image; and
extract second information related to the second user based on the identified second image.

Assignees

• Sony Group Corp

Inventors

• Ishida Kyoko
• Kuzuya Naoki
• MASUURA Takeshi
• Sumihiro Hiroshi
• Ohki Mitsuharu
• Ono Hiroaki
• Yamada Hideshi

Classifications

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T7/00

  Image analysis · CPC title

• G07F9/026

  for alarm, monitoring and auditing in vending machines or means for indication, e.g. when empty · CPC title

• G07G1/0036

  Checkout procedures · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title