Directing communications using gaze interaction

Patent metadata

Field	Value
Publication number	US-10075491-B2
Application number	US-201615257978-A
Country	US
Kind code	B2
Filing date	Sep 7, 2016
Priority date	Dec 10, 2015
Publication date	Sep 11, 2018
Grant date	Sep 11, 2018

Abstract

In some implementations, audio data or video data associated with a first participant of a communication session is obtained. The communication session may include communication between a first device of the first participant with a second device of a second participant of the communication session. It is determined that biometric information associated with the first participant indicates that the first participant is looking toward the first device. In response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, the audio data or the video data associated with the first participant is transmitted to the second device of the second participant of the communication session.

First claim

What is claimed is:

1. A method performed by one or more electronic devices, the method comprising:
obtaining audio data or video data associated with a first participant of a communication session, wherein the communication session includes communication between a first device of the first participant with a second device of a second participant of the communication session;
muting audio of the first participant such that the audio of the first participant is not transmitted to the second device of the second participant;
after muting the audio of the first participant, determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device; and
in response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, unmuting the audio of the first participant such that the audio of the first participant is transmitted to the second device of the second participant.

2. The method of claim 1 , wherein the biometric information comprises eye tracking data for the first participant.

3. The method of claim 1 , wherein the biometric information comprises head position data for the first participant.

4. The method of claim 1 , wherein the communication session includes communication with a third device of a third participant of the communication session; and
wherein determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining a direction of gaze of the first participant during the communication session;
wherein the method comprises selecting, from among the participants of the communication session, the second participant based on the direction of the gaze of the first participant; and
wherein the method further comprises transmitting the audio data or the video data associated with the first participant to the second device of the second participant of the communication session based at least on selecting the second participant from among the participants of the communication session.

5. The method of claim 4 , further comprising:
providing, for display at the device of the first participant, an indicator that indicates the selected participant.

6. The method of claim 4 , wherein:
the second participant has an assigned direction relative to the first participant; and
determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining that the first participant is looking toward the assigned direction corresponding to the second participant.

7. A system comprising:
one or more electronic devices; and
one or more non-transitory machine-readable media coupled to the one or more electronic devices, the one or more non-transitory machine-readable media having instructions stored thereon, which, when executed by the one or more electronic devices, cause the one or more electronic devices to perform operations comprising:
obtaining audio data or video data associated with a first participant of a communication session, wherein the communication session includes communication between a first device of the first participant with a second device of a second participant of the communication session;
muting audio of the first participant such that the audio of the first participant is not transmitted to the second device of the second participant,
after muting the audio of the first participant, determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device; and
in response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, unmuting the audio of the first participant such that the audio of the first participant is transmitted to the second device of the second participant.

8. The system of claim 7 , wherein the biometric information comprises eye tracking data for the first participant.

9. The system of claim 7 , wherein the biometric information comprises head position data for the first participant.

10. The system of claim 7 , wherein the communication session includes communication with a third device of a third participant of the communication session;
wherein determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining a direction of gaze of the first participant during the communication session;
wherein the operations comprise selecting, from among the participants of the communication session, the second participant based on the direction of the gaze of the first participant; and
wherein the operations further comprise transmitting the audio data or the video data associated with the first participant to the second device of the second participant of the communication session based at least on selecting the second participant from among the participants of the communication session.

11. The system of claim 10 , wherein the operations further comprise:
providing, for display at the device of the first participant, an indicator that indicates the selected participant.

12. The system of claim 10 , wherein:
the second participant has an assigned direction relative to the first participant; and
determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device comprises determining that the first participant is looking toward the assigned direction corresponding to the second participant.

13. One or more non-transitory machine-readable storage devices storing instructions that, when executed by one or more processors of one or more electronic devices, cause the one or more electronic devices to perform operations comprising:
obtaining audio data or video data associated with a first participant of a communication session, wherein the communication session includes communication between a first device of the first participant with a second device of a second participant of the communication session;
muting audio of the first participant such that the audio of the first participant is not transmitted to the second device of the second participant;
after muting the audio of the first participant, determining that biometric information associated with the first participant indicates that the first participant is looking toward the first device; and
in response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, unmuting the audio of the first participant such that the audio of the first participant is transmitted to the second device of the second participant.

14. The one or more non-transitory machine-readable storage devices of claim 13 , wherein the biometric information comprises eye tracking data for the first participant.

15. The one or more non-transitory machine-readable storage devices of claim 13 , wherein the biometric information comprises head position data for the first participant.

16. The one or more non-transitory machine-readable storage devices of claim 13 , wherein the communication session includes communication with a third device of a third participant of the communication session;
wherein determining that biome

Assignees

• Google Llc

Inventors

• Smus Boris

Classifications

• G06F3/012

  Head tracking input arrangements · CPC title

• G06K9/00617

  Physics · mapped topic

• G06K9/00335

  Physics · mapped topic

• H04L65/403 Primary

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title

• H04L65/601

  Electricity · mapped topic