Person detection, person identification and meeting start for interactive whiteboard appliances

Patent metadata

Field	Value
Publication number	US-11030585-B2
Application number	US-201715728360-A
Country	US
Kind code	B2
Filing date	Oct 9, 2017
Priority date	Oct 9, 2017
Publication date	Jun 8, 2021
Grant date	Jun 8, 2021

Abstract

Artificial intelligence is introduced into an electronic meeting context to perform various tasks before, during, and/or after electronic meetings. The artificial intelligence may analyze a wide variety of data such as data pertaining to other electronic meetings, data pertaining to organizations and users, and other general information pertaining to any topic. Capability is also provided to create, manage, and enforce meeting rules templates that specify requirements and constraints for various aspects of electronic meetings. Embodiments include improved approaches for translation and transcription using multiple translation/transcription services. Embodiments also include using sensors in conjunction with interactive whiteboard appliances to perform person detection, person identification, attendance tracking, and improved meeting start. Embodiments further include improvements to the presentation of content on interactive whiteboard appliances, providing meeting services for meeting attendees, agenda extraction, and learning to aid in creating new electronic meetings.

First claim

What is claimed is:

1. An interactive whiteboard (IWB) appliance comprising:
a display;
a communications interface;
one or more processors; and
one or more memories storing instructions which, when processed by the one or more processors, cause:
receiving, via the communications interface, from one or more sensors, sensor data that indicates a detected presence of a person,
identifying, based upon the sensor data that indicates a detected presence of a person and identity information that specifies one or more of image data or voice data for each of a plurality of persons, a particular person from the plurality of persons that corresponds to the sensor data that indicates a detected presence of a person, wherein the identifying includes one or more of matching a facial image for the particular person in the identity information to a facial image represented in the first sensor data, or matching voice data for the particular person in the identity information to voice data represented in the first sensor data,
determining, based upon meeting information that specifies scheduled times, participants and electronic devices for a plurality of electronic meetings and a current time, whether an electronic meeting involving the IWB appliance is scheduled within a specified amount of time of the current time,
determining, based upon the meeting information, whether the particular person is a scheduled participant of the electronic meeting involving the IWB appliance that is scheduled within the specified amount of time of the current time,
in response to determining, based upon the meeting information, that the particular person is a scheduled participant of the electronic meeting involving the IWB appliance that is scheduled within the specified amount of time of the current time, generate and provide to the particular person one or more notifications pertaining to the electronic meeting, and
in response to determining, based upon the meeting information and the current time, that an electronic meeting involving the IWB appliance is not scheduled within the specified amount of time of the current time, prompting the particular person to schedule a new electronic meeting.

2. The IWB appliance of claim 1 , wherein the one or more sensors include one or more image sensors, voice sensors, or scanners.

3. The IWB appliance of claim 1 , wherein the one or more memories store additional instructions which, when processed by the one or more processors, cause in response to determining, based upon the meeting information that the particular person is not a participant of the electronic meeting involving the IWB appliance that is scheduled within the specified amount of time of the current time, prompting the particular person to schedule a new electronic meeting.

4. The IWB appliance of claim 1 , wherein the one or more memories store additional instructions which, when processed by the one or more processors, cause notifying the particular person of the electronic meeting involving the IWB appliance that is scheduled within the specified amount of time of the current time.

5. The IWB appliance of claim 1 , wherein the one or more memories store additional instructions which, when processed by the one or more processors, cause notifying the particular person of available meeting times for the IWB appliance.

6. The IWB appliance of claim 1 , wherein the one or more memories store additional instructions which, when processed by the one or more processors, cause the IWB appliance to acquire one or more facial images of, or one or more words spoken by, a particular person from the plurality of persons.

7. The IWB appliance of claim 6 , wherein the IWB appliance acquires the one or more facial images of, or one or more words spoken by, the particular person from the plurality of persons without an input request from the particular person.

8. The IWB appliance of claim 1 , wherein the one or more notifications pertaining to the electronic meeting include one or more of an announcement of the meeting or a welcome to the meeting.

9. The IWB appliance of claim 1 , wherein:
the one or more notifications pertaining to the electronic meeting include one or more of a visual notification on the display of the IWB appliance or an audio notification, and
prompting the particular person to schedule a new electronic meeting includes providing to the particular person one or more of a visual notification via the display of the IWB appliance or an audio notification.

10. One or more non-transitory computer-readable media storing instructions which, when processed by the one or more processors, cause:
receiving, by an interactive whiteboard (IWB) appliance via a communications interface, from one or more sensors, sensor data that indicates a detected presence of a person,
identifying, based upon the sensor data that indicates a detected presence of a person and identity information that specifies one or more of image data or voice data for each of a plurality of persons, a particular person from the plurality of persons that corresponds to the sensor data that indicates a detected presence of a person, wherein the identifying includes one or more of matching a facial image for the particular person in the identity information to a facial image represented in the first sensor data, or matching voice data for the particular person in the identity information to voice data represented in the first sensor data,
determining, based upon meeting information that specifies scheduled times, participants and electronic devices for a plurality of electronic meetings and a current time, whether an electronic meeting involving the IWB appliance is scheduled within a specified amount of time of the current time,
determining, based upon the meeting information, whether the particular person is a scheduled participant of the electronic meeting involving the IWB appliance that is scheduled within the specified amount of time of the current time,
in response to determining, based upon the meeting information, that the particular person is a scheduled participant of the electronic meeting involving the IWB appliance that is scheduled within the specified amount of time of the current time, generate and provide to the particular person one or more notifications pertaining to the electronic meeting, and
in response to determining, based upon the meeting information and the current time, that an electronic meeting involving the IWB appliance is not scheduled within the specified amount of time of the current time, prompting the particular person to schedule a new electronic meeting.

11. The one or more non-transitory computer-readable media of claim 10 , wherein the one or more sensors include one or more image sensors, voice sensors, or scanners.

12. The one or more non-transitory computer-readable media of claim 10 , further storing additional instructions which, when processed by the one or more processors, cause in response to determining, based upon the meeting information that the particular person is not a participant of the electronic meeting involving the IWB appliance that is scheduled within the specified amount of time of the current time, prompting the particular person to schedule a new electronic meeting.

13. The one or more non-transitory computer-readable media of claim 10 , further storing additional instructions which, when processed by the one or more processors, cause notifying the particular person of the electronic meeting involving the IWB appliance that is scheduled within the specified amount of time of the current time.

14. The one or more non-transitory comput

Assignees

• Nelson Steven
• Kitada Hiroshi
• Wong Lana
• Ricoh Co Ltd

Inventors

• Nelson Steven
• Kitada Hiroshi
• Wong Lana

Classifications

• G06Q10/1093 Primary

  Calendar-based scheduling for persons or groups · CPC title

• G06V40/172

  Classification, e.g. identification · CPC title

• G06F40/186

  Templates · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/183

  using context dependencies, e.g. language models · CPC title