Accessing and interacting with information

Patent metadata

Field	Value
Publication number	US-10275046-B2
Application number	US-96565210-A
Country	US
Kind code	B2
Filing date	Dec 10, 2010
Priority date	Dec 10, 2010
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

In some implementations, an access device may sense movement in six degrees of freedom for interacting with information in a user interface. In some implementations, a security feature may be included for verifying an authorization of a user to use the access device. Additionally, in some implementations, the access device may establish communication with an available computing device for accessing and interacting with information that may include remotely stored information, cloud data, cloud services, and the like.

First claim

The invention claimed is:

1. A method comprising:
detecting by an access device a first rotation of the access device;
transmitting by the access device to a computing device, information about the first rotation of the access device, the information about the first rotation of the access device causing a corresponding first rotation of a point of view of a graphical user interface (GUI) about a cursor;
subsequent to the transmitting by the access device the information about the first rotation of the access device, detecting, by a strain sensor of the access device an amount of strain produced by squeezing of the access device;
determining that the amount of strain is above a first predetermined strain threshold;
detecting, by the access device, a second rotation of the access device subsequent to detecting by the strain sensor of the access device an amount of strain produced by squeezing of the access device, the access device being configured to detect movement in six degrees of freedom including forward/backward, up/down, left/right, roll, pitch, and yaw;
transmitting, by the access device, to the computing device, information that includes an instruction to cause grabbing of a virtual object in the GUI in response to the detecting by the access device, that the amount of strain is above the first predetermined strain threshold, and rotating the virtual object in the user interface in response to the detecting, by the access device, the second rotation of the access device; and
subsequent to the transmitting; by the access device; to the computing device, the information that includes the instruction to cause grabbing:
detecting by the strain sensor a second amount of strain produced by squeezing of the access device that remains above the first predetermined threshold, and in response to detecting the second amount of strain, transmitting to the computing device, information that includes an instruction to cause holding of the virtual object.

2. The method according to claim 1 , further comprising:
receiving a feedback message from the computing device, the feedback message indicating that a pointer of the user interface contacts the virtual object in the user interface; and
generating, by the access device, feedback based on the feedback message, the feedback comprising at least one of tactile feedback, a sound, or activation of a light.

3. The method according to claim 1 , further comprising:
detecting additional movement of the access device subsequent to the transmitting the information that includes an instruction to cause grabbing of the virtual object;
detecting that the amount of strain continues to exceed the first predetermined strain threshold; and
transmitting an indication of the additional movement to the computing device, wherein the transmitting includes sending an instruction to move the virtual object in the user interface corresponding to the additional movement.

4. The method according to claim 3 , wherein:
the additional movement is detected as a flinging action followed by a level of strain below the first predetermined strain threshold; and
as a result of detecting that the additional movement is the flinging action followed by the level of strain below the first predetermined strain threshold, an instruction is sent to remove the virtual object from the user interface.

5. The method according to claim 3 , wherein the transmission of the indication of the additional movement to the computing device further includes sending an instruction for moving the virtual object onto a defined zone in the user interface.

6. The method according to claim 1 , further comprising:
detecting third rotation of the access device subsequent to the transmitting the information that includes the instruction to cause grabbing of the virtual object; and
transmitting an indication of the third rotation of the access device to the computing device, the indication including sending an instruction for rotation of a point of view of the GUI with respect to the virtual object.

7. An access device comprising:
one or more sensors for sensing movement of the access device in six degrees of freedom including forward/backward, up/down, left/right, roll, pitch, and yaw;
a strain sensor;
a processor;
a memory, including instructions, that when executed by the processor, causes the processor to perform operations comprising:
detecting by the one or more sensors, a first rotation of the access device;
transmitting by the access device to a computing device, information about the first rotation of the access device, the information about the first rotation of the access device causing a corresponding first rotation of a point of view of a graphical user interface (GUI) about a cursor;
subsequent to the transmitting by the access device the information about the first rotation of the access device, detecting, by the strain sensor of the access device an amount of strain produced by squeezing of the access device;
determining that the amount of strain is above a first predetermined strain threshold;
detecting, by the one or more sensors, a second rotation of the access device subsequent to detecting by the strain sensor of the access device an amount of strain produced by squeezing of the access device;
transmitting, by the access device, to the computing device, information that includes an instruction to cause grabbing of a virtual object in the GUI in response to the detecting by the access device, that the amount of strain is above the first predetermined strain threshold, and rotating the virtual object in the user interface in response to the detecting, by the access device, the second rotation of the access device; and
subsequent to the transmitting, by the access device, to the computing device, the information that includes the instruction to cause grabbing:
detecting by the strain sensor a second amount of strain produced by squeezing of the access device that remains above the first predetermined threshold, and in response, transmitting to the computing device, information that includes an instruction to cause holding of the virtual object.

8. The access device according to claim 7 , wherein the one or more sensors include a gyroscope, an accelerometer and a magnetic field sensor to sense movement of the access device in the six degrees of freedom.

9. The access device according to claim 8 , further comprising a joystick mechanism mounted thereon.

10. The access device according to claim 7 , further comprising a biometric sensor mounted on the access device for sensing a biometric feature of a user for use in verifying an authorization of the user.

11. The access device according to claim 7 , further comprising at least one feedback component to provide feedback, based on receiving information from the computing device, and wherein the feedback comprises at least one of:
providing haptic feedback by the access device;
providing a sound by the access device; or
activating a light on the access device.

12. The access device according to claim 7 , wherein, the instructions comprise wirelessly providing information to the computing device for accessing data of a user at a remote location over a network.

13. The access device according to claim 7 , wherein the instructions further comprise establishing a secure communication over a network with remotely-located information of a user accessed through the computing device using the access device, wherein the remotely-located information includes one or more cloud services presented by the computing device in a three-dimensional user interface.

14. The access

Assignees

• Zhang Chunhui
• Wang Min
• Harper Richard
• Yuan Tong
• Zhao Chunshui
• Zhu Xiangwei
• Microsoft Technology Licensing Llc

Inventors

• Zhang Chunhui
• Wang Min
• Harper Richard
• Yuan Tong
• Zhao Chunshui
• Zhu Xiangwei

Classifications

• G06F3/0338

  with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks · CPC title

• G06F3/0346 Primary

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F21/34

  involving the use of external additional devices, e.g. dongles or smart cards · CPC title