Motion data sharing

Patent metadata

Field	Value
Publication number	US-9854014-B2
Application number	US-201314103341-A
Country	US
Kind code	B2
Filing date	Dec 11, 2013
Priority date	Mar 14, 2013
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for sharing motion data between computer systems. In one aspect, a method includes receiving, at a first computer system that is associated with a first user, first information that defines a first physical movement that was performed by a second user; outputting, using one or more output devices, a representation of the first physical movement; detecting a second physical movement performed by the first user; providing, to a second computer system that is associated with the second user, second information that defines at least a portion of the second physical movement performed by the first user; receiving, in response to providing the second information to the second computer system, third information that defines a correction to the second physical movement; and outputting, by the first computer system, a representation of the correction to the second physical movement.

First claim

What is claimed is:

1. A computer-implemented method comprising:
displaying, on a first display device of a first computer system that is associated with a first user, a view of a first physical environment of the first user and that shows one or more first physical objects that are located in the first physical environment;
joining, by the first computer system, an interactive session with a second computer system that is separate from the first computer system, wherein the second computer system is associated with a second user and includes a second display device displaying a view of a second physical environment of the second user and that shows one or more second physical objects that are located in the second physical environment;
receiving, at the first computer system and while displaying the view of the first physical environment of the first user, information that identifies the one or more second physical objects that are located in the second physical environment and a physical movement that is performed by the second user in the second physical environment in relation to the one or more second physical objects, wherein the first and second users are concurrently participating in the interactive session and the second user is located remotely from the first user;
determining a correspondence between (i) the one or more first physical objects that are located in the first physical environment of the first user and (ii) the one or more second physical objects that are located in the second physical environment of the second user;
based on the correspondence, translating the physical movement performed by the second user in relation to the one or more second physical objects to a virtual movement performed in relation to the one or more first physical objects;
displaying, on the first display device of the first computer system and superimposed over the view of the first physical environment of the first user, a representation of the virtual movement performed in relation to the one or more first physical objects, wherein the representation of the virtual movement is an animation of at least a portion of the second user's body performing the physical movement;
providing, by the first computer system and to the second computer system, and in response to detecting a physical movement in the first physical environment performed by the first user in relation to the one or more first physical objects, information that defines at least a portion of the physical movement performed by the first user in relation to the one or more first physical objects;
receiving, at the first computer system and from the second computer system as a response to the information that defines the at least the portion of the physical movement performed by the first user in relation to the one or more first physical objects, information that identifies a suggested correction to the physical movement performed by the first user in relation to the one or more first physical objects, wherein the suggested correction is based on a corrective motion provided by the second user in which the animation of the at least the portion of the first user's body is moved to an appropriate location with regard to the one or more second physical objects in the view of the second physical environment that is in proximity of the second user; and
displaying, on the first display device of the first computer system and superimposed over the view of the first physical environment of the first user, a representation of the suggested correction.

2. The computer-implemented method of claim 1 , further comprising:
detecting a current position of at least a portion of the first user's body; and
determining one or more differences between the current position of the first user's body and the physical movement that is performed by the second user in the second physical environment in relation to the one or more second physical objects;
wherein displaying the representation of the virtual movement performed in relation to the one or more first physical objects comprises displaying a representation of the determined one or more differences between the current position of the first user's body and the physical movement that is performed by the second user in relation to the one or more second physical objects.

3. The computer-implemented method 1 , wherein:
the first user is a novice with regard to subject matter to which the physical movement performed by the first user pertains; and
the second user is an expert with regard to the subject matter to which the physical movement that is performed by the second user pertains.

4. The computer-implemented method of claim 1 , wherein determining the correspondence between (i) the one or more first physical objects that are located in the first physical environment of the first user and (ii) the one or more second physical objects that are located in the second physical environment of the second user comprises:
analyzing, by the first computer system using an object recognition technique, information about the first physical environment of the first user to identify the one or more first physical objects, and analyzing information about the second physical environment of the second user to identify the one or more second physical objects;
identifying one or more of the first physical objects that correspond to one or more of the second physical objects; and
matching each of the one or more identified first physical objects to a corresponding one of the one or more identified second physical objects.

5. The computer-implemented method of claim 1 ,
wherein the physical movement performed by the first user in relation to the one or more first physical objects is detected after initiating displaying of the representation of the virtual movement performed in relation to the one or more first physical objects.

6. The computer-implemented method of claim 1 , wherein displaying the representation of the suggested correction comprises highlighting or making bold a displayed representation of at least a portion of the first user's body that has been identified as requiring corrective physical movement.

7. The computer-implemented method of claim 1 , wherein the first computer system includes a first camera device that captures the view of the first physical environment from the point of view of the first user, and the second computer system includes a second camera device that captures the view of the second physical environment from the point of view of the second user.

8. The computer-implemented method of claim 1 , wherein the first display device comprises a first pair of glasses that includes at least one transparent screen that displays the animation of the at least the portion of the second user's body such that the animation appears superimposed over the view of the first physical environment of the first user.

9. The computer-implemented method of claim 1 , further comprising:
based on the correspondence between (i) the one or more first physical objects that are located in the first physical environment and (ii) the one or more second physical objects that are located in the second physical environment, translating the physical movement performed by the first user to a virtual movement performed in relation to the one or more second physical objects; and
displaying, on the second display of the second computer system and superimposed over the view of the second physical environment of the second user, a representation of the virtual movement performed in relation to the one or more second physical objects, wherein the representation of the virtual movement is an animation of at least a portion of the first user's body performing the phy

Assignees

• Google Inc

Inventors

• Nordstrom Paul G

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G09B19/003

  Repetitive work cycles; Sequence of movements · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• A63B24/0003

  Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title