Content identification and playback

Patent metadata

Field	Value
Publication number	US-10403327-B2
Application number	US-201815905733-A
Country	US
Kind code	B2
Filing date	Feb 26, 2018
Priority date	Feb 27, 2017
Publication date	Sep 3, 2019
Grant date	Sep 3, 2019

Abstract

Systems and methods for playing back content based on external content are provided. An example system and method may identify content based on an environment in which a content-playback device is located. The example system and method may also detect a playback-initiation action performed by a user of the content-playback device and identify a content-playback position based on the playback-initiation action. The example system and method may also trigger playback of the content on the content-playback device based on the identified content-playback position.

First claim

What is claimed is:

1. A method, comprising: identifying content based on content playing on an external display device in an environment in which a content-playback device is located; detecting a playback-initiation action performed by a user of the content-playback device by detecting a device-mount event based on a change in ambient light detected by an ambient light sensor of the content-playback device and at least one of motion or orientation measurements from the content-playback device; identifying a content-playback position based on the playback-initiation action; and triggering playback of a replay of a portion of the content playing on the external display device on the content-playback device based on the identified content-playback position, wherein the content playing on the external display device is unaffected by playback of the replay on the content-playback device.

2. The method of claim 1 , wherein the identifying content based on the environment in which the content-playback device is located includes identifying external content playing on an external display device that is separate from the content-playback device.

3. The method of claim 2 , wherein the identifying content based on the environment in which the content-playback device is located includes:
recording an audio sample using a microphone of the content-playback device;
generating an acoustic fingerprint based on the audio sample; and
using the acoustic fingerprint to identify the external content playing on the external display device.

4. The method of claim 1 , wherein the identifying content based on the environment in which the content-playback device is located includes:
determining a location of the content-playback device; and
identifying content that is currently available in the determined location.

5. The method of claim 1 , wherein the identifying a content-playback position based on the playback-initiation action includes:
determining a content-synchronization position for the identified content; and
determining the content-playback position by offsetting the content-synchronization position by a replay time offset.

6. The method of claim 1 , further comprising:
detecting a device-unmount event; and
responsive to detecting the device-unmount event, terminating content playback on the content-playback device.

7. A computing device comprising: at least one processor; and memory storing instructions that, when executed by the at least one processor, cause the computing device to: identify content based on content playing on an external display device in an environment in which a content-playback device is located; detect a playback-initiation action performed by a user of the content-playback device by detecting a device-mount event based on a change in ambient light detected by an ambient light sensor of the content-playback device and at least one of motion or orientation measurements from the content-playback device; initiate a content-playback session based on the playback-initiation action; identify a content-playback position based on the playback-initiation action; and playback a replay of a portion of the content playing on the external display device within the content-playback session on the content-playback device based on the identified content-playback position, wherein the content playing on the external display device is unaffected by playback of the replay on the content-playback device.

8. The computing device of claim 7 , wherein the instructions that cause the computing device to identify content based on the environment in which the content-playback device is located cause the computing device to identify content playing on an external display device that is separate from the content-playback device.

9. The computing device of claim 7 , wherein the instructions that cause the computing device to playback content include instructions that cause the computing device to playback a content stream associated with the identified content.

10. The computing device of claim 7 , wherein the instructions that cause the computing device to detect the playback-initiation action include instructions that cause the computing device to detect a device-mount event.

11. The computing device of claim 10 , wherein the device-mount event is detected based on orientation of the content-playback device.

12. The computing device of claim 10 , wherein the device-mount event is detected based on ambient light sensed by the content-playback device.

13. A method, comprising: identifying, by a head-mounted display device, a content stream associated with external content playing on an external display device; detecting, by the head-mounted display device, that the head-mounted display device has been mounted on a user's head based on a change in ambient light detected by an ambient light sensor of the head-mounted display device and at least one of motion or orientation measurements from the head-mounted display device; responsive to detecting that the head-mounted display device has been mounted on the user's head: identifying, by the head-mounted display device, a synchronization position in the content stream that corresponds to the external content; identifying a replay-playback position within the content stream that precedes the synchronization position; and triggering playback of the content stream based on the identified replay-playback position, wherein the external content playing on the external display device is unaffected by playback of the content stream.

14. The method of claim 13 , further comprising:
receiving a user input; and
in response to the user input, triggering playback of the content stream in slow motion.

15. The method of claim 14 , wherein the user input is received by detecting that a button of the head-mounted display device is depressed for at least a predetermined duration of time.

16. The method of claim 13 , wherein the content stream includes a replay content stream that is different than a video stream of the external content.

17. The method of claim 16 , wherein the replay content stream includes video captured by a different camera than the video stream of the external content.

18. The method of claim 13 , wherein the content stream is identified by:
recording an audio sample of the external content playing on the external display device using a microphone of the head-mounted display device;
generating an acoustic fingerprint based on the audio sample;
using the acoustic fingerprint to identify the external content playing on the external display device; and
identifying the content stream based on the identified external content.

19. The method of claim 13 , further comprising:
identifying a plurality of content streams associated with the external content, each of the content streams being associated with different cameras; and
presenting a content selection user interface for receiving a selection input to identify a content stream from the plurality of content streams;
responsive to receiving the selection input, identifying a content stream based on the selection input; and
playing the identified content stream.

20. The method of claim 19 , wherein the content selection user interface includes a grid of cells, each of the cells being associated with a content stream from the plurality of content streams, and wherein the selection input includes centering a cell of the grid in a field of view of the head-mounted display device to select the content stream associated with the ce

Assignees

• Google Llc

Inventors

• Raphael Seth
• Raffle Hayes S
• Palos Xavier Benavides

Classifications

• H04N21/44218

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title

• G11B31/006 Primary

  with video camera or receiver · CPC title

• H04N21/47217

  for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312) · CPC title

• H04N21/43637

  involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11] (arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114) · CPC title

• H04N21/4394

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title