Secure digital assistant integration in web pages

Patent metadata

Field	Value
Publication number	US-12475185-B2
Application number	US-202318384342-A
Country	US
Kind code	B2
Filing date	Oct 26, 2023
Priority date	May 6, 2019
Publication date	Nov 18, 2025
Grant date	Nov 18, 2025

Abstract

Secure digital assistant integration with web pages is provided. The system receives an intent manifest data structure that maps actions of a digital assistant with link templates of an electronic resource developed by a third-party developer device. The system validates the electronic resource based on the intent manifest data structure. The system receives, from a data exchange component of an iframe of the electronic resource loaded by a client computing device, an identifier of the client computing device. The system receives a foreground state of the electronic resource from an onsite state sharing API. The system selects a data value for a parameter based on the foreground state and the intent manifest data structure. The system provides the data value. An authorization component generates an authorization prompt, receives input, and transmits the data value to an onsite intent execution API of the electronic resource to execute an action.

First claim

What is claimed is:

1 . A method implemented by one or more processors, the method comprising:
providing, by a client computing device and to a data processing system, an identifier corresponding to an account associated with the client computing device; providing, by the client computing device and to the data processing system, data indicative of content being presented by the client computing device; receiving, by the client computing device and from the data processing system, a data value for a parameter, the parameter being determined based on the data indicative of the content being presented by the client computing device and the data value being selected based on the identifier corresponding to the account associated with the client computing device; generating, by the client computing device, a prompt to authorize the data value for provision to an electronic resource; in response to the prompt, the client computing device receiving input authorizing the data value for provision to the electronic resource; and in response to receiving the input authorizing the data value for provision to the electronic resource, the client computing device providing the data value to the electronic resource to cause the electronic resource to execute an action based on the data value.

2 . The method according to claim 1 , wherein the parameter is further determined based on an intent manifest data structure containing a mapping between a plurality of actions of a digital assistant and a plurality of link templates of the electronic resource.

3 . The method according to claim 1 , wherein the electronic resource is restricted from accessing the identifier corresponding to the account associated with the client computing device, and a third-party developer device that developed the electronic resource is prohibited from accessing the identifier corresponding to the account associated with the client computing device.

4 . The method according to claim 1 , further comprising:
sending, by the client computing device and to the data processing system, a request; in response to the request, the data processing system querying the client computing device for the data indicative of the content being presented by the client computing device.

5 . The method according to claim 1 , further comprising:
sending, by the client computing device and to the data processing system, data packets carrying an input audio signal detected by a sensor of the client computing device, the data packets causing the data processing system to identify a request for a candidate data value; and receiving, by the client computing device and from the data processing system, the data value as the candidate data value responsive to the request.

6 . The method according to claim 1 , further comprising:
receiving, by an application programming interface, the data value; and inputting, by the application programming interface, the data value into an input text box of the electronic resource.

7 . The method according to claim 1 , further comprising:
building a deep link with the data value; and loading the deep link in a web browser executed by the client computing device.

8 . A computer program product comprising one or more non-transitory computer-readable storage media having program instructions collectively stored on the one or more non-transitory computer-readable storage media, the program instructions executable to:
provide, by a client computing device and to a data processing system, an identifier corresponding to an account associated with the client computing device; provide, by the client computing device and to the data processing system, data indicative of content being presented by the client computing device; receive, by the client computing device and from the data processing system, a data value for a parameter, the parameter being determined based on the data indicative of the content being presented by the client computing device and the data value being selected based on the identifier corresponding to the account associated with the client computing device; generate, by the client computing device, a prompt to authorize the data value for provision to an electronic resource; in response to the prompt, receive, by the client computing device, input authorizing the data value for provision to the electronic resource; and in response to receiving the input authorizing the data value for provision to the electronic resource, provide, by the client computing device, the data value to the electronic resource to cause the electronic resource to execute an action based on the data value.

9 . The computer program product according to claim 8 , wherein the parameter is further determined based on an intent manifest data structure containing a mapping between a plurality of actions of a digital assistant and a plurality of link templates of the electronic resource.

10 . The computer program product according to claim 8 , wherein the electronic resource is restricted from accessing the identifier corresponding to the account associated with the client computing device, and a third-party developer device that developed the electronic resource is prohibited from accessing the identifier corresponding to the account associated with the client computing device.

11 . The computer program product according to claim 8 , wherein the program instructions are further executable to:
send, by the client computing device and to the data processing system, a request; in response to the request, query, by the data processing system, the client computing device for the data indicative of the content being presented by the client computing device.

12 . The computer program product according to claim 8 , wherein the program instructions are further executable to:
send, by the client computing device and to the data processing system, data packets carrying an input audio signal detected by a sensor of the client computing device, the data packets causing the data processing system to identify a request for a candidate data value; and receive, by the client computing device and from the data processing system, the data value as the candidate data value responsive to the request.

13 . The computer program product according to claim 8 , wherein the program instructions are further executable to:
receive, by an application programming interface, the data value; and input, by the application programming interface, the data value into an input text box of the electronic resource.

14 . The computer program product according to claim 8 , wherein the program instructions are further executable to:
build a deep link with the data value; and load the deep link in a web browser executed by the client computing device.

15 . A system comprising:
a processor, a computer-readable memory, one or more computer-readable storage media, and program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to: provide, by a client computing device and to a data processing system, an identifier corresponding to an account associated with the client computing device; provide, by the client computing device and to the data processing system, data indicative of content being presented by the client computing device; receive, by the client computing device and from the data processing system, a data value for a parameter, the parameter being determined based on the data indicative of the content being presented by the client computing device and the data value being se

Assignees

• Google Llc

Inventors

• Coimbra Adam
• Rao Nikhil
• Wu Hao
• Baker Ian
• Gupta Anshul
• Akkad Jay

Classifications

• G06F21/44

  Program or device authentication · CPC title

• G06F16/90335

  Query processing · CPC title

• G06F9/54

  Interprogram communication · CPC title

• G06F9/468

  Specific access rights for resources, e.g. using capability register · CPC title

• H04L63/0421

  Anonymous communication, i.e. the party's identifiers are hidden from the other party or parties, e.g. using an anonymizer · CPC title