Person detection, person identification and meeting start for interactive whiteboard appliances

Patent metadata

Field	Value
Publication number	US-11645630-B2
Application number	US-202117320718-A
Country	US
Kind code	B2
Filing date	May 14, 2021
Priority date	Oct 9, 2017
Publication date	May 9, 2023
Grant date	May 9, 2023

Abstract

Artificial intelligence is introduced into an electronic meeting context to perform various tasks before, during, and/or after electronic meetings. The artificial intelligence may analyze a wide variety of data such as data pertaining to other electronic meetings, data pertaining to organizations and users, and other general information pertaining to any topic. Capability is also provided to create, manage, and enforce meeting rules templates that specify requirements and constraints for various aspects of electronic meetings. Embodiments include improved approaches for translation and transcription using multiple translation/transcription services. Embodiments also include using sensors in conjunction with interactive whiteboard appliances to perform person detection, person identification, attendance tracking, and improved meeting start. Embodiments further include improvements to the presentation of content on interactive whiteboard appliances, providing meeting services for meeting attendees, agenda extraction, and learning to aid in creating new electronic meetings.

First claim

What is claimed is:

1. A system comprising:
one or more processors; and
one or more memories, storing instructions which, when processed by the one or more processors, cause:
storing, to at least one of the one or more memories, meeting information including a start time of a meeting and at least one participant of the meeting,
identifying, based upon sensor data from one or more sensors that includes one or more of image data or voice data for a plurality of persons, a particular person from the plurality of persons that corresponds to the sensor data,
wherein identifying includes one or more of retrieving a set of facial images from data storage, or retrieving a set of voice data from the data storage;
wherein the identifying includes, after retrieving the set of facial images or the set of voice data from the data storage, one or more of matching a first facial image, in the set of facial images retrieved from the data storage, for the particular person to a second facial image represented in the sensor data, or matching first voice data, in the set of voice data retrieved from the data storage, for the particular person to second voice data represented in the sensor data,
determining, based upon the meeting information, whether the particular person is a scheduled participant of the meeting at a physical location that is within an area associated with the one or more sensors, and
in response to determining, based upon the meeting information, that the particular person is a scheduled participant of the meeting at the physical location that is within the area associated with the one or more sensors, generating participation data that indicates that the particular person has joined the meeting and recording a participation start time of the particular person in association with the meeting.

2. The system of claim 1 , wherein the physical location is one or more of a conference room, a meeting room, an office, or a presentation area.

3. The system of claim 1 , wherein the one or more sensors are attached to one or more of a wall, a ceiling, or a floor.

4. The system of claim 1 , wherein processing of the instructions by the one or more processors further causes recording data indicating the physical location for the meeting.

5. The system of claim 1 , wherein processing of the instructions by the one or more processors further causes:
recording one or more participation start times in association with one or more meetings as attendance tracking information, and
maintaining the attendance tracking information on a per-particular person basis.

6. The system of claim 1 , wherein the participation start time of the particular person is one or more of an actual arrival time of the particular person or the start time of the meeting included in the meeting information.

7. The system of claim 1 , wherein processing of the instructions by the one or more processors further causes recording a participation end time of the particular person in association with the meeting based upon the sensor data from the one or more sensors.

8. The system of claim 7 , wherein the participation end time is one or more of an actual departure time of the particular person or an end time of the meeting included in the meeting information.

9. The system of claim 1 , wherein matching comprises: computing a distance measurement between the first facial image and the second facial image or between the first voice data and the second voice data, and comparing the distance measurement to a distance threshold.

10. One or more non-transitory computer-readable media storing instructions which, when processed by one or more processors, causes:
storing, to one or more memories, meeting information including a start time of a meeting and at least one participant of the meeting,
identifying, based upon sensor data from one or more sensors that includes one or more of image data or voice data for a plurality of persons, a particular person from the plurality of persons that corresponds to the sensor data,
wherein identifying includes one or more of retrieving a set of facial images from data storage, or retrieving a set of voice data from the data storage;
wherein the identifying includes, after retrieving the set of facial images or the set of voice data from the data storage, one or more of matching a first facial image, in the set of facial images retrieved from the data storage, for the particular person to a second facial image represented in the sensor data, or matching first voice data, in the set of voice data retrieved from the data storage, for the particular person to second voice data represented in the sensor data,
determining, based upon the meeting information, whether the particular person is a scheduled participant of the meeting at a physical location that is within an area associated with the one or more sensors, and
in response to determining, based upon the meeting information, that the particular person is a scheduled participant of the meeting at the physical location that is within the area associated with the one or more sensors, generating participation data that indicates that the particular person has joined the meeting and recording a participation start time of the particular person in association with the meeting.

11. The one or more non-transitory computer-readable media of claim 10 , wherein the physical location is one or more of a conference room, a meeting room, an office, or a presentation area.

12. The one or more non-transitory computer-readable media of claim 10 , wherein the one or more sensors are attached to one or more of a wall, a ceiling, or a floor.

13. The one or more non-transitory computer-readable media of claim 10 , wherein processing of the instructions by the one or more processors further causes recording data indicating the physical location for the meeting.

14. The one or more non-transitory computer-readable media of claim 10 , wherein processing of the instructions by the one or more processors further causes:
recording one or more participation start times in association with one or more meetings as attendance tracking information, and
maintaining the attendance tracking information on a per-particular person basis.

15. The one or more non-transitory computer-readable media of claim 10 , wherein the participation start time of the particular person is one or more of an actual arrival time of the particular person or the start time of the meeting included in the meeting information.

16. The one or more non-transitory computer-readable media of claim 10 , wherein processing of the instructions by the one or more processors further causes recording a participation end time of the particular person in association with the meeting based upon the sensor data from the one or more sensors.

17. The one or more non-transitory computer-readable media of claim 16 , wherein the participation end time is one or more of an actual departure time of the particular person or an end time of the meeting included in the meeting information.

18. A computer-implemented method comprising:
storing, to one or more memories, meeting information including a start time of a meeting and at least one participant of the meeting,
identifying, based upon sensor data from one or more sensors that includes one or more of image data or voice data for a plurality of persons, a particular person from the plurality of persons that corresponds to the sensor data,
wherein identifying includes one or more of retrieving a set of facial images from data storage, or re

Assignees

• Nelson Steven
• Kitada Hiroshi
• Wong Lana
• Ricoh Co Ltd

Inventors

• Nelson Steven
• Kitada Hiroshi
• Wong Lana

Classifications

• G06Q10/1093 Primary

  Calendar-based scheduling for persons or groups · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G10L15/183

  using context dependencies, e.g. language models · CPC title

• G06F40/186

  Templates · CPC title

• G06N20/00

  Machine learning · CPC title