Method, computer program product, and system for providing a sensor-based environment

Patent metadata

Field	Value
Publication number	US-2016110760-A1
Application number	US-201514659128-A
Country	US
Kind code	A1
Filing date	Mar 16, 2015
Priority date	Oct 15, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

Method, computer program product, and system to influence a person within an environment having a plurality of items for selection. The method includes determining, using a first visual sensor disposed within the environment, field of view (FOV) information for the person, and analyzing the FOV information to identify one or more first items within the FOV of the person. The method further includes determining, using a second visual sensor disposed within the environment, behavior information for the person and analyzing the behavior information to classify a behavior of the person into one of a number of predefined behavior types. The method further includes selecting, based on the identified one or more first items and the classified behavior, at least a second item for presentation to the person, and presenting information related to the second item to the person.

First claim

What is claimed is:

1 . A computer-implemented method to influence a person within an environment having a plurality of items, the method comprising:
determining, using a first visual sensor disposed within the environment, field of view (FOV) information for the person; analyzing the FOV information to identify one or more first items of the plurality of items within the FOV of the person; determining, using a second visual sensor disposed within the environment, behavior information for the person; analyzing the behavior information to classify a behavior of the person into one of a number of predefined behavior types; selecting, based on the identified one or more first items and the classified behavior, at least a second item of the plurality of items for presentation to the person; and presenting information related to the second item to the person.

2 . The computer-implemented method of claim 1 , wherein determining field of view information for the person includes using the first visual sensor to determine at least one of an eye orientation, a head orientation, and a body orientation of the person.

3 . The computer-implemented method of claim 1 , wherein determining FOV information for the person is performed during a first time period, and determining behavior information for the person is performed during a second time period that begins after the first time period begins.

4 . The computer-implemented method of claim 1 , further comprising:
calculating an interest score of the person for the one or more first items based on the classified behavior of the person, wherein presenting information related to the second item includes determining content of the information based on the interest score.

5 . The computer-implemented method of claim 4 , further comprising:
updating a profile associated with the person based on the classified behavior, wherein the profile includes information for correlating the interest score of the person to one or more of the number of predefined behavior types.

6 . The computer-implemented method of claim 5 , wherein the predetermined behavior types include at least one of handling one or more of the first items, reading one or more of the first items, selecting one or more of the first items, returning one or more of the first items, and declining to approach an area within the environment containing the one or more first items.

7 . The computer-implemented method of claim 1 , wherein the first visual sensor is worn on the body of the person.

8 . A computer program product to influence a person within an environment having a plurality of items, the computer program product comprising:
a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation that includes:
determining, using a first visual sensor disposed within the environment, field of view (FOV) information for the person;
analyzing the FOV information to identify one or more first items of the plurality of items within the FOV of the person;
determining, using a second visual sensor disposed within the environment, behavior information for the person;
analyzing the behavior information to classify a behavior of the person into one of a number of predefined behavior types;
selecting, based on the identified one or more first items and the classified behavior, at least a second item of the plurality of items for presentation to the person; and
present information related to the second item to the person.

9 . The computer program product of claim 8 , wherein determining field of view information for the person includes using the first visual sensor to determine at least one of an eye orientation, a head orientation, and a body orientation of the person.

10 . The computer program product of claim 8 , wherein determining FOV information for the person is performed during a first time period, and determining behavior information for the person is performed during a second time period that begins after the first time period begins.

11 . The computer program product of claim 8 , wherein the operation further includes:
calculating an interest score of the person for the one or more first items based on the classified behavior of the person, wherein presenting information related to the second item includes determining content of the information based on the interest score.

12 . The computer program product of claim 11 , wherein the operation further includes:
updating a profile associated with the person based on the classified behavior, wherein the profile includes information for correlating the interest score of the person to one or more of the number of predefined behavior types.

13 . The computer program product of claim 12 , wherein the predetermined behavior types include at least one of handling one or more of the first items, reading one or more of the first items, selecting one or more of the first items, returning one or more of the first items, and declining to approach an area within the environment containing the one or more first items.

14 . The computer program product of claim 8 , wherein the first visual sensor is worn on the body of the person.

15 . A system to influence a person within an environment having a plurality of items for selection, the system comprising:
one or more computer processors; one or more visual sensors disposed within the environment and communicatively coupled with the one or more computer processors; and a memory containing program code which, when executed by the one or more computer processors, performs an operation comprising:
determining, using one of the visual sensors, field of view (FOV) information for the person;
analyzing the FOV information to identify one or more first items of the plurality of items within the FOV of the person;
determining, using one of the visual sensors, behavior information for the person;
analyzing the behavior information to classify a behavior of the person into one of a number of predetermined behavior types;
selecting, based on the identified one or more first items and the classified behavior, at least a second item of the plurality of items for presentation to the person; and
presenting information related to the second item to the person.

16 . The system of claim 15 , wherein the one or more visual sensors comprise a first visual sensor included in a body-worn computing device of the person, and wherein the FOV information for the person is determined using the first visual sensor.

17 . The system of claim 16 , wherein the one or more visual sensors further comprises a plurality of visual sensors distributed throughout the environment, and wherein the behavior information for the person is determined using the plurality of visual sensors.

18 . The system of claim 16 , further comprising an output device communicatively coupled with the one or more computer processors, wherein the output device is configured to present the information related to the at least one second item to the person using at least one of audio and visual output.

19 . The system of claim 18 , wherein the output device is one of a handheld computing device of the person and the body-worn computing device of the person.

20 . The system of claim 15 , wherein the predetermined behavior types include at least one of handling one or more of the first items, reading one or more of

Assignees

• Toshiba Global Commerce Solutions Holdings Corp

Inventors

• Herring Dean Frederick
• Singh Ankit

Classifications

• G06Q20/204

  comprising interface for record bearing medium or carrier for electronic funds transfer or payment credit · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title

• G06Q30/0251 Primary

  Targeted advertisements · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title