Intelligent automated assistant for media search and playback

Patent metadata

Field	Value
Publication number	US-10740384-B2
Application number	US-201514963089-A
Country	US
Kind code	B2
Filing date	Dec 8, 2015
Priority date	Sep 8, 2015
Publication date	Aug 11, 2020
Grant date	Aug 11, 2020

Abstract

Systems and processes are disclosed for operating a digital assistant in a media environment. In an example process, a primary set of media items can be displayed. An audio input containing a media-related request can be received. A primary user intent corresponding to the media-related request can be determined. In accordance with a determination that the primary user intent comprises a user intent to narrow the primary media search query, a second primary media search query corresponding to the primary user intent can be generated. The second primary media search query can be based on the media-related request and the primary media search query. The second primary media search query can be performed to obtain a second primary set of media items. Display of the primary set of media items can be replaced with display of the second primary set of media items.

First claim

What is claimed is:

1. A non-transitory computer-readable medium storing instructions for operating a digital assistant of a media system, the instructions, when executed by one or more processors of the media system, cause the one or more processors to:
while displaying, on a display, a first primary set of media items corresponding to a first primary media search query, receive audio input containing a media-related request in natural language speech form;
determine a text representation of the media-related request;
perform natural language processing on the text representation to determine a primary actionable intent for the media-related request, the primary actionable intent selected from a plurality of candidate actionable intents for the media-related request;
and
in accordance with a determination that the primary actionable intent comprises an actionable intent of narrowing the first primary media search query:
generate, based on the text representation and the first primary media search query, a second primary media search query that corresponds to the primary actionable intent;
generate, based on the second primary media search query, a first secondary media search query having fewer constraints than the second primary media search query;
perform the second primary media search query and the first secondary media search query to obtain a second primary set of media items and a first secondary set of media items, respectively; and
concurrently display, on the display, the second primary set of media items and the first secondary set of media items, wherein the display of the second primary set of media items replaces the display of the first primary set of media items, and wherein the displayed second primary set of media items is ordered before the displayed first secondary set of media items.

2. The non-transitory computer-readable medium of claim 1 , wherein the determination that the primary actionable intent comprises the actionable intent of narrowing the first primary media search query comprises:
a determination that the text representation includes a predetermined word or phrase corresponding to the actionable intent of narrowing the first primary media search query.

3. The non-transitory computer-readable medium of claim 2 , wherein the determination that the primary actionable intent comprises the actionable intent of narrowing the first primary media search query is based on
determining a position of the predetermined word or phrase in the text representation.

4. The non-transitory computer-readable medium of claim 2 , wherein the predetermined word or phrase includes one of a plurality of refinement terms.

5. The non-transitory computer-readable medium of claim 1 , wherein the second primary media search query includes one or more parameter values defined in the media-related request and one or more parameter values of the first primary media search query.

6. The non-transitory computer-readable medium of claim 1 , wherein the second primary media search query includes a set of parameter values, and wherein the instructions further cause the one or more processors to:
identify a core set of parameter values from the set of parameter values, the core set of parameter values having fewer parameter values than the set of parameter values, wherein the first secondary media search query includes the core set of parameter values.

7. The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the one or more processors to:
in accordance with a determination that the primary actionable intent comprises an actionable intent of performing a new media search query:
generate, based on the text representation, a third primary media search query that corresponds to the primary actionable intent;
generate, based on the first primary media search query and the third primary media search query, a second secondary media search query having more constraints than the third primary media search query;
perform the third primary media search query and the second secondary media search query; and
in accordance with a determination that at least one media item is obtained from performing the third primary media search query:
concurrently display, on the display, a third primary set of media items obtained from performing the third primary media search query and a second secondary set of media items obtained from performing the second secondary media search query, wherein the display of the third primary set of media items replaces the display of the first primary set of media items, and wherein the displayed third primary set of media items is ordered before the displayed second secondary set of media items.

8. The non-transitory computer-readable medium of claim 7 , wherein the determination that the primary actionable intent comprises an actionable intent of performing a new media search query further comprises:
a determination that the text representation includes a word or phrase corresponding to a parameter value of one or more media items.

9. The non-transitory computer-readable medium of claim 7 , wherein performing the third primary media search query comprises searching for a candidate media item associated with a parameter value that is included in one or more media critic reviews of the candidate media item.

10. The non-transitory computer-readable medium of claim 7 , wherein the instructions further cause the one or more processors to:
in accordance with a determination that no media items are obtained from performing the third primary media search query:
identify a least pertinent parameter value of the third primary media search query;
determine, based on the identified least pertinent parameter value, one or more alternative parameter values;
perform, using the one or more alternative parameter values, one or more alternative primary media search queries to obtain a fourth primary set of media items; and
concurrently display, on the display, the fourth primary set of media items and the second secondary set of media items, wherein the display of the fourth primary set of media items replaces the display of the first primary set of media items, and wherein the displayed fourth primary set of media items is ordered before the displayed second secondary set of media items.

11. The non-transitory computer-readable medium of claim 7 , wherein the instructions further cause the one or more processors to:
in accordance with the determination that the primary actionable intent comprises the actionable intent of performing a new media search query:
determine one or more secondary actionable intents based on the primary actionable intent and one or more previous actionable intents, the one or more previous actionable intents corresponding to one or more previous media-related requests received prior to the media related request;
generate, one or more additional secondary media search queries that correspond to the one or more secondary actionable intents;
perform the one or more additional secondary media search queries to obtain one or more additional secondary sets of media items; and
display the one or more additional secondary sets of media items on the display.

12. The non-transitory computer-readable medium of claim 11 , wherein the instructions further cause the one or more processors to:
determine one or more combinations of the primary actionable intent and the one or more previous actionable intents, wherein each of the one or more combinations is associated with at least one media item, and wherein the one or more secondary actionable intents comprise the one or more combinations.

Assignees

• Apple Inc

Inventors

• Orr Ryan M
• Sidki Raumi N
• Lister Patrick M
• Russell Jonathan H

Classifications

• H04N21/41265

  having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204) · CPC title

• H04N21/42224

  Touch pad or touch panel provided on the remote control · CPC title

• H04N21/42222

  Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device · CPC title

• H04N21/42206

  characterized by hardware details · CPC title

• G10L2015/221

  Announcement of recognition results · CPC title