Caller preview data and call messages based on caller preview data

Patent metadata

Field	Value
Publication number	US-10567574-B2
Application number	US-201916253113-A
Country	US
Kind code	B2
Filing date	Jan 21, 2019
Priority date	May 12, 2016
Publication date	Feb 18, 2020
Grant date	Feb 18, 2020

Abstract

Implementations of the present application relate to caller preview data and call messages based on caller preview data. In some implementations, a method includes sending, by a caller device, a call request to one or more callee devices, and establishing a connection to at least one callee device prior to receipt of an acceptance of the call request by the callee device. At least a portion of caller preview data is transmitted to the callee device over the connection prior to the receipt of the call acceptance. In response to determining that the at least a portion of the caller preview data has been transmitted for a particular time period without receipt of the acceptance of the call request, information is transmitted to instruct a call message to be stored on the callee device, where the call message includes at least a part of the caller preview data.

First claim

The invention claimed is:

1. A method comprising:
sending, by a caller device, a call request to one or more callee devices;
establishing a connection to at least one callee device of the one or more callee devices prior to receipt of an acceptance of the call request from the at least one callee device;
causing a camera of the caller device to capture original data, wherein the original data includes caller preview data and additional data;
transmitting the caller preview data to the at least one callee device over the connection, wherein the caller preview data is transmitted prior to the receipt of the acceptance of the call request; and
in response to determining that the caller preview data has been transmitted over the connection for a particular time period without the receipt of the acceptance of the call request:
determining that the transmitted caller preview data is incomplete, wherein determining that the transmitted caller preview data is incomplete includes determining that the transmitted caller preview data excludes the additional data of the original data;
in response to determining that the transmitted caller preview data is incomplete, determining call message data that includes
the additional data excluded from the transmitted caller preview data; and

transmitting the call message data to the at least one callee device for storage on the at least one callee device.

2. The method of claim 1 wherein transmitting the call message data includes transmitting a command to combine the transmitted caller preview data with the additional data to create a call message stored on the at least one callee device.

3. The method of claim 1 wherein transmitting the call message data includes transmitting at least a portion of the caller preview data to the at least one callee device.

4. The method of claim 1 wherein the additional data includes one or more frames of video data that are excluded from the transmitted caller preview data.

5. The method of claim 1 wherein the additional data includes audio data that is excluded from the transmitted caller preview data.

6. The method of claim 1 further comprising transmitting a command designating a first portion of the transmitted caller preview data to be combined with the additional data to create a call message stored on the at least one callee device, wherein a second portion of the transmitted caller preview data, different from the first portion, is not included in the call message.

7. The method of claim 1 further comprising:
determining whether the transmitted caller preview data has one or more characteristics above a particular threshold; and
in response to determining that the one or more characteristics are above the particular threshold:
sending a command to the at least one callee device to store at least a portion of the transmitted caller preview data as a call message.

8. The method of claim 1 wherein, in response to determining that the transmitted caller preview data is complete:
determining second call message data that includes at least a portion of the transmitted caller preview data; and
transmitting the second call message data to the at least one callee device for storage on the at least one callee device.

9. The method of claim 1 wherein the call message data includes further data that is combined with one or more portions of the transmitted caller preview data, wherein the further data includes one or more of:
interpolated video data that includes at least one video frame obtained by interpolation from two or more video frames of the transmitted caller preview data; or
data from previous caller message data previously transmitted from the caller device.

10. The method of claim 1 further comprising:
detecting speech in audio data associated with the caller preview data;
obtaining one or more text captions corresponding to the speech, wherein each text caption of the one or more text captions corresponds to a portion of the speech; and
causing particular text captions of the one or more text captions to be inserted into respective frames of the caller preview data that are associated with the portions of the speech corresponding to the particular text captions.

11. The method of claim 1 further comprising causing display of a user interface by the caller device, the user interface including one or more controls receptive to input from a user and wherein user selection of the one or more controls causes one or more designated portions of the caller preview data to be transmitted as part of the call message data based on the input from the user.

12. A caller device comprising:
a camera;
a storage device; and
at least one processor configured to access the storage device, the at least one processor configured to perform operations comprising:
sending a call request to one or more callee devices;
establishing a connection to at least one callee device of the one or more callee devices prior to receipt of an acceptance of the call request from the at least one callee device;
causing the camera to capture original data, wherein the original data includes caller preview data and additional data;
transmitting the caller preview data to the at least one callee device over the connection, wherein the caller preview data is transmitted prior to the receipt of the acceptance of the call request; and
in response to determining that the caller preview data has been transmitted over the connection for a particular time period without the receipt of the acceptance of the call request:
determining that the transmitted caller preview data is incomplete, wherein determining that the transmitted caller preview data is incomplete includes determining that the transmitted caller preview data excludes the additional data of the original data;
in response to determining that the transmitted caller preview data is incomplete, determining call message data that includes
the additional data excluded from of the transmitted caller preview data; and

transmitting the call message data to the at least one callee device for storage on the at least one callee device.

13. The caller device of claim 12 wherein the operation of transmitting the call message data includes transmitting a command to combine the transmitted caller preview data with the additional data to create a call message stored on the at least one callee device.

14. The caller device of claim 12 wherein the at least one processor is configured to perform operations further comprising,
determining whether the transmitted caller preview data has one or more characteristics below a particular threshold; and
in response to determining the one or more characteristics are above the particular threshold:
sending a command to the at least one callee device to store at least a portion of the transmitted caller preview data as a call message.

15. The caller device of claim 12 wherein transmitting the call message data includes transmitting at least a portion of the caller preview data to the at least one callee device.

16. The caller device of claim 12 wherein the call message data includes further data that is combined with one or more portions of the transmitted caller preview data, wherein the further data includes one or more of:
interpolated video data that includes at least one video frame obtained by interpolation from two or more video frames of the transmitted caller preview data; or
data from previous caller message data previously transmitted from the caller device.

17. The caller device of claim 12 wh

Assignees

• Google Llc

Inventors

• Rogers Alan Lee
• Lo Richard Yuan-Ching
• Austin Matthew Thomas
• Uberti Justin
• Sales Heidi Rafael
• Metter Koa
• Volkov Anton

Classifications

• H04M3/42051 Primary

  where the notification is included in the ringing tone · CPC title

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• H04M2203/2038

  Call context notifications · CPC title

• H04W4/14

  Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD] · CPC title

• H04L65/80

  Responding to QoS · CPC title