Location systems for electronic device interactions with environment

Patent metadata

Field	Value
Publication number	US-11930267-B2
Application number	US-202117352177-A
Country	US
Kind code	B2
Filing date	Jun 18, 2021
Priority date	Sep 16, 2016
Publication date	Mar 12, 2024
Grant date	Mar 12, 2024

Abstract

An electronic device may be provided with control circuitry, wireless transceiver circuitry, and a display. The electronic device may be used to provide information to a user in response to being pointed at a particular object. The control circuitry may determine when the electronic device is pointed at a particular object using wireless control circuitry and/or motion sensor circuitry. In response to determining that the electronic device is pointed at a particular object, the control circuitry may take suitable action. This may include, for example, displaying information about an object when the electronic device is pointed at the object, displaying control icons for electronic equipment when the electronic device is pointed at the electronic equipment, and/or displaying a virtual object when the electronic device is pointed at real world object.

First claim

What is claimed is:

1. An electronic device, comprising:
wireless communications circuitry including an ultra-wideband transceiver that exchanges ultra-wideband radio frequency signals with an external electronic device having a speaker;
control circuitry that:
determines when a distance between the electronic device and the external electronic device is within a threshold distance based on the ultra-wideband radio frequency signals;
determines whether the electronic device is pointed towards the external electronic device based on an angle of arrival of the ultra-wideband radio frequency signals; and
requests and receives information from the external electronic device in response to determining that the distance is less than the threshold distance and that the electronic device is pointed towards the external electronic device; and

a display that automatically displays the information and control icons for the speaker in response to determining that the distance is less than the threshold distance and that the electronic device is pointed towards the external electronic device.

2. The electronic device defined in claim 1 further comprising a haptic output device that provides haptic output when the electronic device is within the threshold distance of the external electronic device.

3. The electronic device defined in claim 2 wherein the control circuitry tracks a position of the external electronic device based on the ultra-wideband radio frequency signals and adjusts the haptic output from the haptic output device based on the position of the external electronic device.

4. The electronic device defined in claim 1 wherein the display is touch-sensitive and wherein the control circuitry sends control signals to the external electronic device in response to touch input on the control icons.

5. The electronic device defined in claim 1 wherein the control circuitry receives the information from the external electronic device via the ultra-wideband radio frequency signals.

6. The electronic device defined in claim 5 wherein the control circuitry determines a type of control icon to display based on the information received from the external electronic device.

7. The electronic device defined in claim 1 wherein the control circuitry determines a time-of-flight associated with the ultra-wideband radio frequency signals.

8. An electronic device, comprising:
wireless communications circuitry including an ultra-wideband transceiver that exchanges ultra-wideband radio frequency signals with an external electronic device;
control circuitry that:
determines an angle of arrival of the ultra-wideband radio frequency signals and determines a distance to the external electronic device based on the ultra-wideband radio frequency signals; and
requests and receives information from the external electronic device in response to determining that the distance is less than a first threshold and that the angle of arrival is less than a second threshold;

a display that automatically displays the information and control icons for the external electronic device in response to determining that the distance is less than a first threshold and that the angle of arrival is less than a second threshold; and
a haptic output device that provides haptic output, wherein the control circuitry adjusts the haptic output based on the distance to the external electronic device.

9. The electronic device defined in claim 8 wherein the control circuitry determines whether the electronic device is pointing towards the external electronic device based on the angle of arrival of the ultra-wideband radio frequency signals.

10. The electronic device defined in claim 8 wherein the external electronic device comprises a speaker and the control icons comprise speaker control icons.

11. The electronic device defined in claim 10 wherein the control circuitry sends control signals to the speaker in response to user input on the speaker control icons.

12. An electronic device, comprising:
wireless communications circuitry including an ultra-wideband transceiver that receives ultra-wideband radio frequency signals;
control circuitry that:
determines whether a pointing direction of the electronic device is closer to a first external electronic device or a second external electronic device based on an angle of arrival of the ultra-wideband radio frequency signals; and
requests and receives information from the first external electronic device in response to determining that the pointing direction of the electronic device is closer to the first external electronic device than the second external electronic device; and

a display that displays the information and a first control icon for controlling the first external electronic device without displaying a second control icon for controlling the second external electronic device in response to determining that the pointing direction of the electronic device is closer to the first external electronic device than the second external electronic device.

13. The electronic device defined in claim 12 wherein the control circuitry determines a distance to the first external electronic device based on the ultra-wideband radio frequency signals.

14. The electronic device defined in claim 13 further comprising a haptic output device that provides haptic output, wherein the control circuitry adjusts the haptic output based on the distance to the first external electronic device.

15. The electronic device defined in claim 12 wherein the first external electronic device comprises a speaker and wherein the first control icon comprises a speaker control icon.

16. The electronic device defined in claim 12 wherein the control circuitry sends control signals to the first external electronic device in response to receiving user input on the first control icon on the display.

Assignees

• Apple Inc

Inventors

• Meyer Adam S
• Tsoi Peter C
• Kerr Duncan Robert
• Hankey Martha Evans
• Morrell John B
• Foster James H

Classifications

• H04N23/63 Primary

  by using electronic viewfinders · CPC title

• G06F3/005

  Input arrangements through a video camera · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• H04W4/023

  using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds · CPC title