Multi-device awareness for casting and content delivery

Patent metadata

Field	Value
Publication number	US-2023305788-A1
Application number	US-202217653957-A
Country	US
Kind code	A1
Filing date	Mar 8, 2022
Priority date	Mar 8, 2022
Publication date	Sep 28, 2023
Grant date	—

Abstract

A system and method provides for the transfer of the execution of content, or the casting of content, from a first computing device to a second computing device. The casting may be performed in response to a detected lift event of the second computing device including the detection of movement of the second computing device from a stored state toward a position within a field of view of a user, and an identification event of the second computing device, including the detection or identification of the second computing device within a field of view of an image sensor of the first computing device, corresponding to a field of view of the user. Detection of both the lift event and the identification event may provide a relatively high level of assurance of user intent to cast the content from the first computing device to the second computing device.

First claim

What is claimed is:

1 . A computer-implemented method, comprising:
detecting, by a processor of a second computing device that is operably coupled with a first computing device, that a first triggering condition has been met, the first triggering condition corresponding to a movement of the second computing device toward the first computing device; detecting, by the processor of the second computing device, that a second triggering condition has been met, the second triggering condition corresponding to a detection of the second computing device within a field of view of an image sensor of the first computing device; and transferring execution of content, being executed on the first computing device, from the first computing device to the second computing device, including executing the content on the second computing device and suspending execution of the content on the first computing device, in response to the first triggering condition and the second triggering condition being met, the first computing device being a head mounted computing device, and the second computing device being a handheld computing device.

2 . The computer-implemented method of claim 1 , wherein the transferring of the execution of the content includes transferring the execution of the content from the first computing device to the second computing device in response to determining that the second triggering condition has been met within a period of time of determining that the first triggering condition has been met.

3 . The computer-implemented method of claim 1 , wherein the first computing device includes a first display device, and the second computing device includes a second display device.

4 . The computer-implemented method of claim 3 , wherein the detecting of the first triggering condition includes detecting a movement of the handheld computing device from a stored position toward a position within a field of view of a user of the head mounted computing device corresponding to the field of view of the image sensor.

5 . The computer-implemented method of claim 4 , wherein the detecting of the second triggering condition includes detecting the second computing device within an image captured by the image sensor of the first computing device.

6 . The computer-implemented method of claim 5 , wherein the detecting of the first triggering condition includes storing the first triggering condition for a period of time.

7 . The computer-implemented method of claim 6 , wherein the transferring of the execution of the content includes:
determining that the execution of the content is to be transferred from the first computing device, and transferring the execution of the content from the first computing device, in response to the detection of the second triggering condition while the first triggering condition is stored; and determining that the execution of the content is to remain with the first computing device in response to the detection of the second triggering condition after the period of time has elapsed.

8 . The computer-implemented method of claim 1 , wherein the detecting of the first triggering condition includes:
receiving, by the processor of the second computing device, data from at least one of an accelerometer or a gyroscope of the second computing device; and detecting the movement of the second computing device based on the data received from the at least one of the accelerometer or the gyroscope.

9 . The computer-implemented method of claim 8 , further comprising updating a machine learning model of the movement of the second computing device based on the data received from the at least one of the accelerometer or the gyroscope of the second computing device associated with the first triggering condition in response to a determination that the movement of the second computing device is an intentional movement of the second computing device into the field of view of the image sensor of the first computing device.

10 . The computer-implemented method of claim 1 , wherein the transferring of the execution of the content from the first computing device to the second computing device includes:
executing the content on the second computing device, including providing access to additional information related to the content via a user interface device of the second computing device.

11 . A system, comprising:
a first computing device; and a second computing device operably coupled with the first computing device, the second computing device including at least one processor and a memory storing instructions that, when executed by the at least one processor, cause the at least one processor to:
detect that a first triggering condition has been met, including:
detect initiation of a movement of the second computing device toward the first computing device based on data provided by at least one position sensor of the second computing device; and
determine that the movement is intentional and that the first triggering condition has been met based on a machine learning model modeling movement of the second computing device relative to the first computing device,

detect that a second triggering condition has been met, the second triggering condition corresponding to a detection of the second computing device within a field of view of an image sensor of the first computing device, and
transfer execution of content from the first computing device to the second computing device in response to the first triggering condition and the second triggering condition being met,
the first computing device being a head mounted computing device and the second computing device being a handheld computing device.

12 . The system of claim 11 , wherein the instructions cause the at least one processor to transfer the execution of the content from the first computing device to the second computing device in response to determining that the second triggering condition has been met within a period of time of determining that the first triggering condition has been met.

13 . The system of claim 11 , wherein the first computing device includes a first display device, and the second computing device includes a second display device.

14 . The system of claim 13 , wherein the instructions cause the at least one processor to:
detect a movement of the handheld computing device from a stored position toward a position within a field of view of a user of the head mounted computing device corresponding to the field of view of the image sensor; and detect that the first triggering condition has been met in response to detecting the movement of the handheld computing device from the stored position.

15 . The system of claim 14 , wherein the instructions cause the at least one processor to detect the second triggering condition including detecting the second computing device within an image captured by the image sensor of the first computing device.

16 . The system of claim 15 , wherein the instructions cause the at least one processor to detect the first triggering condition including storing the first triggering condition for a period of time.

17 . The system of claim 16 , wherein the instructions cause the at least one processor to transfer the execution of the content including:
determine that the execution of the content is to be transferred from the first computing device, and transferring the execution of the content from the first computing device, in response to the detection of the second triggering condition while the first triggering condition is stored; and determi

Assignees

• Google Llc

Inventors

• Kulshrestha Achin
• Bowering Robert
• Spear Maxwell
• Palos Xavier Benavides
• Purohit Aveek

Classifications

• G06F3/1423 Primary

  controlling a plurality of local displays, e.g. CRT and flat panel display · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• H04W4/20

  Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel · CPC title

• G06F3/0304 Primary

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title