System and method for creating and sharing plans through multimodal dialog

Patent metadata

Field	Value
Publication number	US-2016179908-A1
Application number	US-201414577311-A
Country	US
Kind code	A1
Filing date	Dec 19, 2014
Priority date	Dec 19, 2014
Publication date	Jun 23, 2016
Grant date	—

Abstract

Methods, systems, devices, and media for creating a plan through multimodal search inputs are provided. A multimodal virtual assistant receives a first search request which comprises a geographic area. First search results are displayed in response to the first search request being received. The first search results are based on the first search request and correspond to the geographic area. Each of the first search results is associated with a geographic location. The multimodal virtual assistant receives a selection of one of the first search results, and adds the selected one of the first search results to a plan. A second search request is received after the selection, and second search results are displayed in response to the second search request being received. The second search results are based on the second search request and correspond to the geographic location of the selected one of the first search results.

First claim

What is claimed is:

1 . A method of creating a plan through search inputs, the method comprising:
receiving a first search request by a device, the first search request comprising a geographic area; displaying first search results on a display of the device in response to receiving the first search request, the first search results being based on the first search request and corresponding to the geographic area, each of the first search results being associated with a geographic location; receiving a selection of one of the first search results by the device; adding the one of the first search results to a plan; receiving a second search request by the device after receiving the selection; and displaying second search results on the display of the device in response to receiving the second search request, the second search results being based on the second search request and corresponding to the geographic location of the one of the first search results.

2 . The method according to claim 1 , wherein
the first search request comprises a first input received by the device via a first input mode and a second input received by the device via a second input mode different than the first input mode.

3 . The method according to claim 2 , wherein
the first input comprises a spoken query received by a microphone of the device, the spoken query specifying a type of the first search results, and the second input comprises a touch query received by the display of the device, the touch query specifying the geographic area of the first search results.

4 . The method according to claim 3 , wherein
the touch query at least one of encircles the geographic area on a map displayed on the display of the device, contacts the geographic area on the map displayed on the display of the device, and specifies the geographic area as a route on the map displayed on the display of the device.

5 . The method according to claim 2 , wherein
the first input comprises a spoken query received by a microphone of the device, the spoken query specifying a type of the first search results, and the second input comprises a direction of movement of the device, the direction of movement specifying a direction to the geographic area of the first search results.

6 . The method according to claim 2 , wherein
the first input comprises a spoken query received by a microphone of the device, the spoken query specifying a type of the first search results, and the second input comprises an image received by a camera of the device, the image identifying the geographic area of the first search results.

7 . The method according to claim 1 , wherein
the first search request further comprises a type of the first search results and a time period for the first search results.

8 . The method according to claim 7 , wherein
the first search results correspond to the type and the time period, each of the first search results corresponding to a time slot within the time period, and the one of the first search results is added to the plan as an activity in association with the time slot of the one of the first search results.

9 . The method according to claim 8 , wherein
each of the second search results corresponds to a time subsequent to the time slot of the one of the first search results.

10 . The method according to claim 1 , wherein
the first search request identifies a friend list and a time period for the first search results.

11 . The method according to claim 10 , wherein
each of the first search results is selected from the friend list based on an availability during the time period, the availability being determined by referencing a schedule of each friend of the friend list, and the one of the first search results being added to the plan as a participating member during the time period.

12 . The method according to claim 11 , wherein
each of the second search results is determined based on the time period.

13 . The method according to claim 1 , wherein
the first search results are displayed on a map on the display of the device in correspondence with the geographic location of each of the first search results.

14 . The method according to claim 13 , further comprising:
receiving a request to modify the first search results displayed on the display by the device, the request including a refinement of a displayed area of the map on the display; and modifying the first search results on the display of the device based on the refinement of the displayed area.

15 . The method according to claim 14 , further comprising:
determining whether the request to modify the first search results includes one of the refinement of the displayed area and a correction of a type of the first search results, wherein the first search results are modified on the display of the device based on the refinement in response to a determination that the request to modify the first search results includes the refinement of the displayed area.

16 . The method according to claim 13 , further comprising:
receiving a request to modify the first search results displayed on the display by the device, the request including a refinement of a displayed area of the map on the display; and modifying the first search results on the display of the device based on the refinement of the displayed area.

17 . The method according to claim 1 , wherein
the second search results are displayed on a map on the display of the device in correspondence with the geographic location of the one of the first search results, and the method further comprises:
receiving a request to modify the second search results displayed on the display by the device, the request including a refinement of a displayed area of the map on the display;
determining whether the request to modify the second search results includes one of the refinement of the displayed area and a correction of a type of the second search results; and
modifying the second search results on the display of the device based on the refinement of the displayed area.

18 . The method according to claim 1 , further comprising:
receiving a selection of one of the second search results by the device; adding the one of the second search results to the plan.

19 . A device for creating a plan through search inputs, the device comprising:
a display; a processor; and a memory storing instructions that, when executed by the processor, cause the processor to perform operations including:
receiving a first search request, the first search request comprising a geographic area;
displaying first search results on the display in response to receiving the first search request, the first search results being based on the first search request and corresponding to the geographic area, each of the first search results being associated with a geographic location;
receiving a selection of one of the first search results;
adding the one of the first search results to a plan;
receiving a second search request after receiving the selection; and
displaying second search results on the display in response to receiving the second search request, the second search results being based on the second search request and corresponding to the geographic location of the one of the first search results.

20 . A tangible computer-readable medium encoded with an executable computer program for creating a plan through search inputs that, when executed by a processor, causes the processor to perf

Assignees

• At & T Ip I Lp

Inventors

• Johnston Michael J
• Ehlen Patrick
• Jung Hyuckchul
• Lieske Jr Jay H
• Selfridge Ethan
• Vasilieff Brant J
• Wilpon Jay Gordon

Classifications

• G06F17/30554 Primary

  Physics · mapped topic

• G06F3/04847 Primary

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title

• G06F17/30477

  Physics · mapped topic

• G06F17/30061

  Physics · mapped topic

• G06F16/9537 Primary

  Spatial or temporal dependent retrieval, e.g. spatiotemporal queries · CPC title