Systems and methods for managing the processing of information acquired by sensors within an environment

Patent metadata

Field	Value
Publication number	US-10938890-B2
Application number	US-201815935088-A
Country	US
Kind code	B2
Filing date	Mar 26, 2018
Priority date	Mar 26, 2018
Publication date	Mar 2, 2021
Grant date	Mar 2, 2021

Abstract

Systems and methods for managing the processing of information acquired by sensors within an environment are disclosed herein. According to an aspect, a system includes multiple sensors configured to acquire information about an environment. The system may also include computing devices that are each operatively connected to a respective one of the sensors. Further, each computing device may be configured to determine an object and/or action within the environment based on the acquired information. The system may include a processing manager configured to determine whether a first computing device among the plurality of computing devices does not have predetermined resource availability for determining the object and/or action. The processing manager may control the first computing device to communicate the information to a second computing device for determining the one of the object and action in response to determining that the first computing device does not have the predetermined resource availability.

First claim

What is claimed:

1. A system comprising:
a plurality of sensors configured to acquire information about an environment;
a plurality of peer computing devices operatively connected via a network, each computing device being operatively connected to a respective one of the sensors, and each computing device being configured to determine one of an object and action within the environment based on the acquired information and a different predetermined model than another of the computing devices;
a processing manager configured to:
coordinate communication among the peer computing devices;
determine whether a first computing device among the plurality of peer computing devices does not have predetermined resource availability for determining the one of the object and action;
in response to determining that the first computing device does not have the predetermined resource availability, control the first computing device to communicate information acquired by the first computing device to a second computing device among the plurality of peer computing devices for determining the one of the object and action by use of the different predetermined model at the second computing device;
receive, from the first computing device, a determination of identification of the one of the object and action;
receive, from the second computing device, a determination of identification of the one of the object and action; and
identify a plurality of candidate objects or actions as being likely actual object or actions within the environment based on the determinations received from the computing devices and the resources of the first and second computing devices and their associated sensors.

2. The system of claim 1 , wherein the sensors are image capture devices, and wherein the acquired information comprises data associated with one or more images of the environment.

3. The system of claim 1 , wherein the acquired information comprises one of radio frequency identifier data, weight information, smart shelf data, motion data, and coordinate information.

4. The system of claim 1 , wherein the processing manager is configured to aggregate information from the computing devices.

5. The system of claim 1 , wherein the processing manager is independent and remotely located.

6. The system of claim 1 , wherein the predetermined resource availability comprises one of processing availability and memory availability.

7. The system of claim 1 , wherein the second computing device is a model of computing device specialized to identify one of an object and a face, and
wherein the processing manager is configured to:
determine whether the second computing device has predetermined resource availability for determining the one of the object and action; and
in response to determining that the second computing device has the predetermined resource availability, control the first computing device to communicate the information acquired by the first computing device to a second computing device.

8. The system of claim 1 , wherein the processing manager is configured to determine whether the second computing device is not acquiring information; and
in response to determining that the second computing device is not acquiring information, control the first computing device to communicate the information acquired by the first computing device to a second computing device.

9. The system of claim 1 , wherein the computing devices are each configured to determine the one of the object and action based on a predetermined model, and
wherein the first computing device and the second computing device cooperatively use the predetermined model to determine the one of the object and action based on the one or more captured images.

10. The system of claim 1 , wherein the second computing device is configured to:
generate analysis data of the information acquired by the first computing device for determining the one of the object and action; and
communicate the generated analysis data to the first computing device; and
wherein the first computing device determines the one of the object and action based on the generated analysis data.

11. A system comprising:
a plurality of sensors configured to acquire information about an environment;
a plurality of peer computing devices operatively connected via a network, each computing device being operatively connected to a respective one of the sensors, and each computing device being configured to individually determine one of an object and action within the environment based on the acquired information, wherein the acquired information used by each computing device to determine the one of the object and action is different, wherein the computing devices are each configured to determine the one of the object and action based on a predetermined model and wherein the predetermined model used by each computing device is unique;
a processing manager configured to:
coordinate communication among the peer computing devices;
receive, from each computing device, the respective determination of the one of the object and action; and
identify at least one candidate object or action as being a likely actual object or action within the environment based on the determinations received from the computing devices of different models and the resources of the computing devices and their associated sensors.

12. The system of claim 11 , wherein the sensors are image capture devices, and wherein the acquired information comprises data associated with one or more images of the environment.

13. The system of claim 11 , wherein the acquired information comprises one of radio frequency identifier data, weight information, smart shelf data, motion data, and coordinate information.

14. The system of claim 11 , wherein the processing manager resides at one of the first computing device and another computing device.

15. The system of claim 11 , wherein the acquired information used by each computing device to determine the one of the object and action is unique.

16. The system of claim 11 , wherein the processing manager is configured to indicate a plurality of candidate objects or actions as being likely actual object or actions within the environment based on the determinations received from the computing devices.

17. The system of claim 16 , wherein the processing manager is configured to indicate comparison information among the candidate objects or actions.

18. A method comprising:
using a plurality of sensors configured to acquire information about an environment;
coordinating communication among a plurality of peer computing devices, each computing device being operating connected to a respective one of the sensors;
determining whether a first computing device among the plurality of peer computing devices does not have predetermined resource availability for determining one of an object and action within the environment, wherein each computing device being configured to determine one of an object and action within the environment based on the acquired information and a different predetermined model than another of the computing devices;
in response to determining that the first computing device does not have the predetermined resource availability, controlling the first computing device to communicate information acquired by the first computing device to a second computing device among the plurality of peer computing devices for determining the one of the object and action by use of the different predetermined model at the second computing device;
receiving, fro

Assignees

• Toshiba Global Commerce Solutions Holdings Corp

Inventors

• Bernath David
• Do Phuc
• Herring Dean
• Padmanabhan Abhishekh
• Rodriguez Adrian
• Steiner David
• Waite Jonathan

Classifications

• H04L67/12 Primary

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• H04L67/63

  Routing a service request depending on the request content or context · CPC title

• H04L67/1001 Primary

  for accessing one among a plurality of replicated servers · CPC title

• G06Q30/0633

  Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087) · CPC title

• H04L67/327

  Electricity · mapped topic