Audio-based data structure generation

Patent metadata

Field	Value
Publication number	US-2024283841-A1
Application number	US-202418588741-A
Country	US
Kind code	A1
Filing date	Feb 27, 2024
Priority date	Dec 30, 2016
Publication date	Aug 22, 2024
Grant date	—

Abstract

Routing packetized actions in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate an action data structure. The system can transmit the action data structure to a third party provider device. The system can receive an indication from the third party provider device that a communication session was established with the device.

First claim

1 .- 20 . (canceled)

21 . A system, comprising:
a data processing system comprising memory and one or more processors to: parse an input audio signal to identify a request and a keyword; identify a third-party provider based on the keyword; select, from a database, a template associated with the third-party provider; generate, based on the keyword and the template, an action data structure for a service provided by the third-party provider; select, based on the keyword and via a real-time content selection process, a content item;
transmit, to a client device, the content item for presentation by the client device via an output signal; and
transmit the action data structure to the third-party provider to cause the third-party provider to execute the action data structure to perform the service or invoke a conversational application programming interface to establish a communication session with the client device.

22 . The system of claim 21 , comprising the data processing system to:
populate a field in the template with a value derived from the input audio signal; and generate the action data structure based on the value for the field.

23 . The system of claim 21 , comprising the data processing system to:
receive, via an interface of the data processing system, data packets comprising an input audio signal detected by a sensor of the client device that is remote from the data processing system.

24 . The system of claim 21 , comprising:
the data processing system to select the content item comprising an indication of a type of service or type of product provided by a second third-party provider.

25 . The system of claim 21 , comprising:
the data processing system to select the content item for a second service different than the service of the action data structure provided by the third-party provider.

26 . The system of claim 21 , comprising:
the data processing system to provide the content item comprising audio output to cause the client device to present the audio output of the content item via a speaker of the client device.

27 . The system of claim 21 , comprising:
the data processing system to provide the content item to the client device to cause the client device to output the content item via computer generated voice.

28 . The system of claim 21 , comprising:
the data processing system to provide the content item comprising visual output to cause the client device to output the visual output via a display device of the client device.

29 . The system of claim 21 , comprising the data processing system to:
detect an interaction with the content item; and identify a conversion of the content item responsive to the interaction.

30 . The system of claim 21 , comprising:
the data processing system to receive an indication that the third-party provider invoked the conversational application programming interface to establish the communication session with the client device.

31 . The system of claim 21 , comprising:
the data processing system to transmit the action data structure to the third-party provider to cause the third-party provider to invoke the conversational application programming interface executed by the data processing system to establish the communication session with the client device.

32 . A method, comprising:
parsing, by a data processing system comprising one or more processors and memory, an input audio signal to identify a request and a keyword; identifying a third-party provider based on the keyword; selecting, from a database, a template associated with the third-party provider; generating, based on the keyword and the template, an action data structure for a service provided by the third-party provider; selecting, based on the keyword and via a real-time content selection process, a content item;
transmit, to a client device, the content item for presentation by the client device via an output signal; and
transmitting, by the data processing system, the action data structure to the third-party provider to cause the third-party provider to execute the action data structure to perform the service or invoke a conversational application programming interface to establish a communication session with the client device.

33 . The method of claim 32 , comprising:
populating a field in the template with a value derived from the input signal; and generating the action data structure based on the value for the field.

34 . The method of claim 32 , comprising:
selecting, by the data processing system, the content item comprising an indication of a type of service or type of product provided by a second third-party provider.

35 . The method of claim 32 , comprising:
selecting, by the data processing system, the content item for a second service different than the service of the action data structure provided by the third-party provider.

36 . The method of claim 32 , comprising:
providing, by the data processing system, the content item comprising audio output to cause the client device to present the audio output of the content item via a speaker of the client device.

37 . The method of claim 32 , comprising:
providing, by the data processing system, the content item to the client device to cause the client device to output the content item via computer generated voice.

38 . The method of claim 32 , comprising:
providing, by the data processing system, the content item comprising visual output to cause the client device to output the visual output via a display device of the client device.

39 . The method of claim 32 , comprising:
detecting, by the data processing system, an interaction with the content item; and identifying, by the data processing system, a conversion of the content item responsive to the interaction.

40 . The method of claim 32 , comprising:
receiving, by the data processing system, an indication that the third-party provider invoked the conversational application programming interface to establish the communication session with the client device.

Assignees

• Google Llc

Inventors

• Bhaya Gaurav
• Stets Jr Robert James

Classifications

• H04L67/10 Primary

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title

• G06F21/30 Primary

  Authentication, i.e. establishing the identity or authorisation of security principals · CPC title

• G10L2015/088

  Word spotting · CPC title

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title