Method and apparatus for providing service by using screen mirroring

Patent metadata

Field	Value
Publication number	US-9652193-B2
Application number	US-201414473176-A
Country	US
Kind code	B2
Filing date	Aug 29, 2014
Priority date	Sep 2, 2013
Publication date	May 16, 2017
Grant date	May 16, 2017

Abstract

A method for providing a service related to a plurality of mirroring images displayed on a screen of a sink device is provided. The method includes determining a first object in a first mirroring image that is displayed on the screen of the sink device, based on a user input, as the first object is moved to a location in a second mirroring image that is displayed on the screen of the sink device, determining a second object that corresponds to the location to which the first object has been moved, determining a service related to the first object and the second object, from among services provided via the second mirroring image, and outputting a result of the determined service.

First claim

What is claimed is:

1. A method of controlling a sink device, the method comprising:
determining a first object in a first mirroring image that is displayed on a screen of the sink device, based on a user input;
linking, a second object determined in a second mirroring image that is displayed on the screen of the sink device, with the first object;
determining an application related to the first object and the second object, from among applications installed in the sink device; and
executing the determined application,
wherein the determined application is different from a first application corresponding to the first object and a second application corresponding to the second object, and
wherein the first mirroring image is mirrored by a first source device and the second mirroring image is mirrored by a second source device.

2. The method of claim 1 , wherein the determining of the first object comprises:
receiving the user input, wherein the user input is a touch input with respect to the first mirroring image;
obtaining information regarding at least one object that corresponds to coordinates of the touch input; and
determining the first object based on the obtained information regarding the at least one object.

3. The method of claim 2 , wherein the obtaining of the information regarding the at least one object comprises:
transmitting the coordinates of the touch input in a region where the first mirroring image is displayed, to the first source device that transmits the first mirroring image; and
receiving, from the first source device, the information regarding the at least one object that corresponds to the coordinates of the touch input.

4. The method of claim 1 , wherein the determining of the second object comprises:
receiving the user input, wherein the user input is a touch input with respect to the second mirroring image;
obtaining information regarding at least one object that corresponds to coordinates of the touch input; and
determining the second object based on the obtained information regarding the at least one object.

5. The method of claim 1 , wherein the second object comprises an execution window of an application that is included in the second mirroring image and installed in the second source device.

6. The method of claim 1 , further comprising:
determining a service that is providable by the application,
wherein the executing of the determined application comprises executing the determined service.

7. The method of claim 1 , wherein the executing of the determined application comprises:
transmitting a request regarding the determined application to a third device, wherein the request includes the first object and the second object;
receiving, from the third device, an execution result of the application related to the first object; and
outputting the received execution result.

8. A sink device for providing a service, the sink device comprising:
a memory configured to store at least one program; and
a processor configured to execute the at least one program so as to display an execution result,
wherein the at least one program comprises commands that when executed, control:
determining a first object in a first mirroring image that is displayed on the screen of the sink device, based on a user input;
linking, a second object determined in a second mirroring image that is displayed on the screen of the sink device, with the first object;
determining an application related to the first object and the second object, from among applications installed in the sink device; and
executing the determined application,

wherein the determined application is different from a first application corresponding to the first object and a second application corresponding to the second object, and
wherein the first mirroring image is mirrored by a first source device and the second mirroring image is mirrored by a second source device.

9. The sink device of claim 8 , wherein the determining of the first object comprises:
receiving a touch input with respect to the first mirroring image from the user;
obtaining information regarding at least one object that corresponds to coordinates of the touch input; and
determining the first object based on the obtained information regarding the at least one object.

10. The sink device of claim 9 , wherein the obtaining of the information regarding the at least one object comprises:
transmitting the coordinates of the touch input in a region where the first mirroring image is displayed, to the first source device that transmits the first mirroring image; and
receiving, from the first source device, the information regarding the at least one object which is selected based on the coordinates.

11. The sink device of claim 8 , wherein the determining of the second object comprises:
receiving a touch input with respect to the second mirroring image from the user;
obtaining information regarding at least one object that corresponds to coordinates of the touch input; and
determining the second object based on the obtained information regarding the at least one object.

12. The sink device of claim 8 , wherein the second object comprises an execution window of an application that is included in the second mirroring image and installed in the second source device.

13. The sink device of claim 8 , further comprising:
determining a service that is providable by the application,
wherein the executing of the determined application comprises executing the determined service.

14. The sink device of claim 8 , wherein the executing of the determined application comprises:
transmitting a request regarding the determined application to a third device, wherein the request includes the first object and the second object;
receiving, from the third device, an execution result of the application related to the first object; and
outputting the received execution result.

15. A method of providing a mirroring service to a sink device by a source device, the method comprising:
receiving, from the sink device:
information regarding one or more objects,
information regarding an application which is determined from among applications provided via the source device, the application being related to the one or more objects, and
a mirroring request regarding an execution result of the application, the application being executed based on the information regarding the one or more objects; and

mirroring the execution result of the application onto the sink device,
wherein the application is different from one or more applications, each of the one or more applications corresponding to each of the one or more objects.

16. The method of claim 15 , wherein the application is selected by a user input while an execution screen of the application is displayed on the sink device.

17. The method of claim 15 , further comprising:
receiving, from the sink device, coordinates that are input by a user into a mirroring image that outputs the execution result of the application;
selecting at least one object based on the coordinates; and
transmitting information regarding the selected at least one object, to the sink device.

18. A source device for providing a mirroring service, the source device comprising:
a communication unit configured to communicate with an external device;
a memory configured to store at least one program; and
a processor configured to execute the at least one program so as to display an execution result;
wherein the at least one program comprises command

Assignees

• Samsung Electronics Co Ltd

Inventors

• Seo Ji-Hwan
• Kang Pil-Seob
• Chang Soo-Ho
• Hahm Seong-Il

Classifications

• G06F2203/04803

  Split screen, i.e. subdividing the display area or the window area into separate subareas · CPC title

• H04N21/4122

  additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423) · CPC title

• H04M2250/22

  including a touch pad, a touch sensor or a touch detector · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/14 Primary

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title