Motion tracking user interface

Patent metadata

Field	Value
Publication number	US-9715273-B2
Application number	US-201514730628-A
Country	US
Kind code	B2
Filing date	Jun 4, 2015
Priority date	Dec 13, 2007
Publication date	Jul 25, 2017
Grant date	Jul 25, 2017

Abstract

A method to transition focus of a display corresponding to an object's motion tracked by a video camera or like device is disclosed. In one implementation, the display shows one or more windows or user interfaces on the display. The object's motion can be used to select one of the windows or user interfaces on the display and manipulate content presented in the window or user interface. In another implementations, the object's motion can manipulate a three-dimensional graphical icon in a three-dimensional display environment, for example, by rotating it. In another implementation, the method further tracks motion of a second object and shifts focus of the display corresponding to the motion of the second object. In another implementation, a second display may be added to mirror the focus transition corresponding to the object's motion.

First claim

What is claimed is:

1. A method comprising:
tracking motion of an object within a space from a first position within the space to a second position within the space; and
while tracking the object's motion within the space, transitioning the visual presentation of a graphical object on a display from a first visual presentation on the display to a second visual presentation on the display that is different than the first visual presentation on the display, wherein:
the transitioning comprises moving the graphical object within a three-dimensional display environment represented on the display;
the moving at least partially corresponds to at least a portion of the object's tracked motion;
the at least a portion of the object's tracked motion comprises rotation of the object about an axis within the space; and
the moving comprises rotating the graphical object within the three-dimensional display environment represented on the display.

2. The method of claim 1 , wherein the space is outside of the display.

3. The method of claim 1 , wherein the tracking comprises visually tracking the motion of the object within the space from the first position within the space to the second position within the space.

4. The method of claim 3 , further comprising using a camera to visually track the motion of the object within the space from the first position within the space to the second position within the space.

5. The method of claim 1 , further comprising, prior to the tracking, registering a focus on the display to a first portion of the graphical object on the display according to the first position of the object within the space, wherein the first visual presentation on the display comprises the focus registered on the first portion of the graphical object.

6. The method of claim 1 , further comprising, prior to the tracking, receiving a selection of a target zone of an image of the object to be tracked, wherein the tracking comprises tracking the motion of the target zone of the object from the first position within the space to the second position within the space.

7. The method of claim 1 , wherein:
a first portion of the moving corresponds to a first portion of the object's tracked motion;
the axis within the space comprises a first axis within the space;
the first portion of the object's tracked motion comprises the rotation of the object about the first axis within the space;
a second portion of the moving corresponds to a second portion of the object's tracked motion; and
the second portion of the object's tracked motion comprises movement of the object along a second axis within the space.

8. The method of claim 7 , wherein the first axis is different than the second axis.

9. The method of claim 1 , wherein:
a first portion of the moving corresponds to a first portion of the object's tracked motion;
the axis within the space comprises a first axis within the space;
the first portion of the object's tracked motion comprises the rotation of the object about the first axis within the space;
the first portion of the moving comprises the rotating the graphical object within the three-dimensional display environment represented on the display;
a second portion of the moving corresponds to a second portion of the object's tracked motion; and
the second portion of the object's tracked motion comprises movement of the object along a second axis within the space.

10. The method of claim 9 , wherein the second portion of the moving comprises varying the size of the graphical object within the three-dimensional display environment represented on the display.

11. The method of claim 10 , wherein the second axis intersects the display.

12. The method of claim 11 , wherein the second axis is different than the first axis.

13. A method comprising:
tracking motion of an object within a space from a first position within the space to a second position within the space; and
while tracking the object's motion within the space, transitioning the visual presentation of a graphical object on a display from a first visual presentation on the display to a second visual presentation on the display that is different than the first visual presentation on the display, wherein:
the transitioning comprises moving the graphical object within a three-dimensional display environment represented on the display;
the moving at least partially corresponds to at least a portion of the object's tracked motion;
the at least a portion of the object's tracked motion comprises rotation of the object about an axis within the space; and
the method further comprising:
tracking motion of another object within the space from a third position within the space to a fourth position within the space; and
while tracking the other object's motion within the space, transitioning the visual presentation of the graphical object on the display from the second visual presentation on the display to a third visual presentation on the display that is different than the second visual presentation on the display, wherein the transitioning the visual presentation of the graphical object on the display from the second visual presentation on the display to the third visual presentation on the display corresponds to the other object's tracked motion.

14. The method of claim 13 , wherein the moving comprises rotating the graphical object within the three-dimensional display environment represented on the display.

15. A method comprising:
displaying a graphical icon on a display in a first visual presentation of the graphical icon when an object is in a first situation within a space outside the display;
detecting non-linear motion of the object from the first situation within the space to a second situation within the space; and
adjusting the graphical icon displayed on the display from the first visual presentation to a second visual presentation within a three-dimensional display environment represented on the display in real-time corresponding to the detected non-linear motion of the object, wherein the adjusting at least partially comprises rotating the graphical icon in a three-dimensional space represented in the three-dimensional display environment.

16. The method of claim 15 , wherein the detected non-linear motion of the object at least partially comprises rotation of the object about an axis within the space outside the display from the first situation to the second situation.

17. A method comprising:
displaying a graphical icon on a display in a first visual presentation of the graphical icon when an object is in a first situation within a space outside the display;
detecting non-linear motion of the object from the first situation within the space to a second situation within the space; and
adjusting the graphical icon displayed on the display from the first visual presentation to a second visual presentation in real-time corresponding to the detected non-linear motion of the object, wherein the adjusting comprises rotating the graphical icon in a three-dimensional space represented in the display from the first visual presentation to the second visual presentation when the detected non-linear motion of the object comprises rotation of the object about an axis within the space outside the display from the first situation to the second situation.

18. The method of claim 17 , wherein the adjusting further comprises moving the graphical icon along the three-dimensional space represented in the display from the first visual presentation to the second visual presentation when the

Assignees

• Apple Inc

Inventors

• Quennesson Kevin H

Classifications

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T2219/028

  Multiple view windows (top-side-front-sagittal-orthogonal) · CPC title

• G09G5/14

  Display of multiple viewports · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G06T19/00

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title