Virtual artifacts using mobile devices

Patent metadata

Field	Value
Publication number	US-9244530-B1
Application number	US-201113017614-A
Country	US
Kind code	B1
Filing date	Jan 31, 2011
Priority date	Jan 31, 2011
Publication date	Jan 26, 2016
Grant date	Jan 26, 2016

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing virtual artifacts using mobile devices. In one aspect, methods include receiving a signal indicating user input to a touchscreen display of a mobile computing device, detecting motion of the mobile computing device, the motion mimicking motion associated with a physical artifact, identifying a function based on the user input and the motion, the function corresponding to a function that can be physically performed using the physical artifact, executing the function on the mobile device, and generating feedback to a user of the mobile device, the feedback indicating execution of the function.

First claim

What is claimed is:

1. A mobile computing device, comprising:
a touchscreen display;
a processor in communication with the touchscreen display; and
a computer-readable medium that is coupled to the processor and that has instructions stored thereon which, when executed by the processor, cause the processor to perform operations comprising:
receiving, at the mobile computing device, an indication that the touchscreen display is being contacted in a first section of the touchscreen display, the first section of the touchscreen display being one of a plurality of sections of the touchscreen display;
detecting, while the mobile computing device continues to receive the indication that the touchscreen display is being contacted in the first section of the touchscreen display, a first motion of the mobile computing device that mimics motion associated with manipulating a first physical artifact;
in response to detecting the first motion of the mobile computing device that mimics the motion associated with manipulating the first physical artifact while the mobile computing device continues to receive the indication that the touchscreen display is being contacted in the first section of the touchscreen display:
selecting, from a collection of functions that the mobile computing device is capable of performing, a first function for the mobile computing device to perform based on the first function corresponding to the first motion of the mobile computing device that mimics the motion associated with manipulating the first physical artifact, and
performing the first function with the mobile computing device;

receiving, at the mobile computing device, an indication that the touchscreen display is being contacted in a second section of the touchscreen display, the second section of the touchscreen display being one of the plurality of sections of the touchscreen display other than the first section of the touchscreen display;
detecting, while the mobile computing device continues to receive the indication that the touchscreen display is being contacted in the second section of the touchscreen display, a second motion of the mobile computing device that mimics motion associated with manipulating a second physical artifact, the second physical artifact being different than the first physical artifact; and
in response to detecting the second motion of the mobile computing device that mimics the motion associated with manipulating the second physical artifact while the mobile computing device continues to receive the indication that the touchscreen display is being contacted in the second section of the touchscreen display:
selecting, from the collection of functions that the mobile computing device is capable of performing, a second function for the mobile computing device to perform based on the second function corresponding to the second motion of the mobile computing device that mimics the motion associated with manipulating the second physical artifact, and
performing the second function with the mobile computing device, the second function being different than the first function.

2. The device of claim 1 , wherein performing the first function includes adjusting a volume of sound generated using the mobile computing device.

3. The device of claim 2 , wherein the adjusting comprises increasing the volume of sound generated using the mobile computing device in response to identifying that the first motion of the mobile computing device is (i) rotational motion in a first rotational direction or is (ii) linear motion in a first linear direction.

4. The device of claim 3 , wherein the adjusting comprises decreasing the volume of sound generated using the mobile computing device in response to identifying that the second motion of the mobile computing device is (i) rotational motion in a second rotational direction opposite the first rotational direction or is (ii) linear motion in a second linear direction opposite the first linear direction.

5. The device of claim 1 , wherein the first physical artifact is selected from a group of physical artifacts consisting of a knob, a dial, a button, a slider, and a switch.

6. The device of claim 5 , wherein:
the second physical artifact is selected from the group of physical artifacts consisting of the knob, the dial, the button, the slider, and the switch, and
the second physical artifact is another physical artifact that is from the group of physical artifacts and that is different than the first physical artifact.

7. The device of claim 5 , wherein the plurality of sections of the touchscreen display collectively span an entirety of the touchscreen display, wherein each section from the plurality of sections corresponds to a respective physical artifact such that the mobile computing device is configured to select a respective function from the collection of functions corresponding to a respective motion associated with manipulating the respective physical artifact that corresponds to the respective section of the touchscreen display.

8. The device of claim 1 , wherein the operations further comprise executing, in response to detecting the first motion of the mobile computing device that mimics the motion associated with manipulating the first physical artifact while the mobile computing device continues to receive the indication that the touchscreen display is being contacted in the first section of the touchscreen display, an application on the mobile computing device, wherein the first function is performed within the application.

9. The device of claim 8 , wherein the application comprises a media playing application and performing the first function comprises adjusting a volume of sound generated by the mobile computing device for audio played by the application.

10. The device of claim 8 , wherein the application comprises an Internet-radio application and performing the first function comprises changing a channel in the Internet-radio application.

11. The device of claim 1 , wherein the first motion of the mobile computing device comprises rotation, acceleration, linear movement, or tilting.

12. The device of claim 1 , wherein the first motion of the mobile computing device is detected using an accelerometer.

13. The device of claim 1 , wherein the operations further comprise, in response to detecting the first motion of the mobile computing device that mimics the motion associated with manipulating the first physical artifact while the mobile computing device continues to receive the indication that the touchscreen display is being contacted in the first section of the touchscreen display, generating feedback to a user of the mobile computing device, the feedback indicating performance of the first function.

14. The device of claim 13 , wherein the feedback comprises at least one of audible feedback and haptic feedback.

15. The device of claim 13 , wherein the feedback includes a cadence, and wherein a rate of the cadence is based on a speed of the first motion of the mobile computing device.

16. The device of claim 15 , wherein the rate of the cadence is configured to increase in response to detecting that the speed of the first motion of the mobile computing device has increased.

17. The device of claim 13 , wherein generating the feedback to the user of the mobile computing device comprises driving a motor of the mobile computing device to generate haptic feedback.

18. The device of claim 1 , wherein the mobile computing device is configured, in response to (i) detecting third motion of the mobile computing de

Assignees

• Raman T V
• Gharpure Chaitanya
• Chen Charles L
• Google Inc

Inventors

• Raman T V
• Gharpure Chaitanya
• Chen Charles L

Classifications

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/04812

  Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F2203/014

  Force feedback applied to GUI · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title