Intuitive way to point, access and control appliances & other objects in building interiors

Patent metadata

Field	Value
Publication number	US-2016358459-A1
Application number	US-201514728380-A
Country	US
Kind code	A1
Filing date	Jun 2, 2015
Priority date	Jun 2, 2015
Publication date	Dec 8, 2016
Grant date	—

Abstract

A user equipment (UE) device pointed at an appliance to be controlled, or at an object that is to be accessed or about which information needs to retrieved, determines its position and orientation within an environment with respect to a fixed frame of reference. The appliance to be controlled is identified based on a determined position and orientation of the UE device and a known position of the appliance. The UE device controls the identified appliance by establishing a wireless communication link between the identified appliance and UE device based on a wireless technology that is compliant with both the appliance and the UE device. The UE device may control another appliance via a central control computer server to which the other appliance is interfaced, when the other appliance is not configured for wireless communication.

First claim

1 . A method for controlling appliances using a user equipment (UE) device, the method comprising:
determining a first position of the UE device within an environment; determining an orientation of the UE device based on at least one attitude sensor; calculating a line of sight (LoS) from the UE device based on the determined first position of the UE device and on the determined orientation of the UE device; calculating lines of association (LoA) between the determined first position of the UE device and locations of the appliances, each LoA being between the determined first position of the UE device and the location of the corresponding appliance; selecting one of the appliances based on the LoS and the calculated LoAs; and configuring the UE device to control the selected appliance.

2 . The method of claim 1 , wherein the selecting one of the appliances includes:
calculating angles between the LoS and the LoAs; determining the smallest of the calculated angles; and selecting the appliance associated with the smallest of the calculated angles.

3 . The method of claim 2 , wherein selecting the appliance associated with the smallest of the calculated angles is conditioned on the smallest of the calculated angles being less than a threshold.

4 . The method of claim 3 , wherein the threshold is based on spacings between the appliances, the first position, and a height of a user operating the UE device.

5 . The method of claim 1 , further comprising, the UE device receiving the locations of the appliances, from a server, and wherein the UE device calculates the LoS, calculates the LoAs, and selects one of the appliances.

6 . The method of claim 1 , further including transmitting instructions from the UE device to control the selected appliance.

7 . The method of claim 1 , wherein the first position of the UE device and the orientation of the UE device are based on a coordinate system that is selected from the group consisting of: (a) a Cartesian coordinate system, (b) a cylindrical coordinate system, and (c) a spherical coordinate system.

8 . (canceled)

9 . The method of claim 1 , further including updating the first position of the UE device to a second position and updating the LoS of the UE device according to the second position, wherein the updating to the second position is based on dead-reckoning or triangulation using sensors internal to the UE device, or trilateration using RF signals from RF signal sources positioned at various locations in the environment.

10 . The method of claim 5 , further including sending, by the UE device, authentication information to the server prior to the receiving of the locations of the appliances.

11 . The method of claim 1 , wherein configuring the UE device to control the selected appliance includes retrieving connectivity information of the selected appliance.

12 . The method of claim 11 , wherein configuring the UE device to control the selected appliance further includes establishing a wireless communication link between the selected appliance and the UE device using the connectivity information.

13 . The method of claim 1 , wherein configuring the UE device to control the selected appliance includes receiving information indicating a type of the selected appliance, and at least one operational instruction for the selected appliance.

14 . The method of claim 1 , wherein the selecting one of the appliances includes at least one of a) determining distances between the UE device and the appliances or b) determining an angles of arrival of signals received by the UE device from the appliances.

15 . The method of claim 1 , wherein the configuring of the UE device to control the selected appliance includes downloading an appliance control interface associated with the selected appliance.

16 . The method of claim 15 , wherein the appliance control interface includes a voice command interface to configure the UE device to receive audio menu selections and process voice commands for the selected appliance.

17 . A method for controlling an appliance using a user equipment (UE) device, the method comprising:
receiving from a server, by the user equipment (UE) device, positional information of an environment including a first reference frame that is associated with the environment; and receiving location information of a plurality of appliances positioned at respective locations within the environment; determining, by the UE device, a first position of the UE device within the environment, based on the received first reference frame and determining an orientation of the UE device; calculating, by the UE device, a line of sight (LoS) based on the determined first position and the orientation of the UE device; calculating multiple lines of association (LoA) for multiple appliances of the plurality of appliances within a predetermined range of the UE device, each LoA being between the determined first position of the UE device and the location of the corresponding appliance; determining correspondences between the LoS and each of the multiple LoAs; identifying a subset of the plurality of appliances whose associated LoAs substantially correspond to the LoS, displaying, in the UE device, respective icons corresponding to each of the appliances in the subset of appliances; receiving a selection of one of the displayed icons; configuring the UE device to control the appliance corresponding to the selected icon.

18 . The method of claim 17 , wherein determining the correspondences between the LoS and the multiple LoAs includes calculating angles between the LoS and each of the multiple LoAs.

19 . The method of claim 18 , wherein an appliance is included in the subset appliances when the calculated angle between the LoAs and the LoS associated with that appliance is less than a threshold angle.

20 . The method of claim 17 , wherein configuring the UE device to control the appliance corresponding to the selected icon includes receiving information of a type of the appliance corresponding to the selected icon.

21 . An apparatus, comprising:
a transceiver configured to:
receive positional information of an environment including a first reference frame that is associated with the environment;
receive location information for a plurality of appliances positioned within the environment;
at least one attitude sensor; and a processor coupled to the transceiver and the at least one attitude sensor and configured to:
determine a position of the apparatus within the environment, based on the received first reference frame;
determine, based on signals from the at least one attitude sensor, an orientation of the apparatus;
calculate a line of sight (LoS) based on the determined first position and the orientation of the apparatus;
calculate multiple lines of association (LoA) for multiple appliances of the plurality of appliances, each LoA being between the determined position of the apparatus and the location of the corresponding appliance;
determine correspondences between the LoS and the multiple LoAs; and
identify an appliance of the multiple appliances having the LoA that most closely corresponds to the LoS;
configure the apparatus to control the identified appliance.

22 . A method for controlling an appliance, the method comprising:
receiving, by a server, from a user equipment (UE) device within an environment, a first position of the UE device, the first position being based on a first referenc

Assignees

• Qualcomm Technologies Int Ltd

Inventors

• Singhar Anil Ranjan Roy Samanta
• Banerjea Raja

Classifications

• G08C17/02 Primary

  using a radio link · CPC title

• G08C2201/91

  Remote control based on location and proximity · CPC title

• G08C2201/93

  Remote control using other portable devices, e.g. mobile phone, PDA, laptop · CPC title

• G08C2201/92

  Universal remote control · CPC title

• H04M1/72415 Primary

  for remote control of appliances · CPC title