System for receiving input in response to motion of user

Patent metadata

Field	Value
Publication number	US-10558271-B2
Application number	US-201715417291-A
Country	US
Kind code	B2
Filing date	Jan 27, 2017
Priority date	Mar 18, 2016
Publication date	Feb 11, 2020
Grant date	Feb 11, 2020

Abstract

A system includes a sensor that detects motions of a first portion and a second portion of a body of a user, a controller that sets an association relationship between a coordinate system of a real space and a coordinate system of a virtual space in response to the motion of the first portion and receives an operation for an object in the virtual space in response to a position and the motion of the second portion, and a notification device that contactlessly notifies a third portion of the body of prescribed information.

First claim

What is claimed is:

1. A system comprising:
a sensor that detects motions of a first portion and a second portion of a body of a user in a real space;
a memory that stores a map in which a position of a virtual object relative to a virtual base point is predetermined on a virtual coordinate system in a virtual space;
a controller that:
analyzes a motion of the first portion based on information from the sensor,
determines whether the motion of the first portion matches a prescribed motion,
sets a real base point at a first position where the second portion exists, when it is determined that the motion of the first portion matches the prescribed motion,
sets, by making the set real base point correspond to the virtual base point, an association relationship between a real coordinate system of the real space and the virtual coordinate system of the virtual space,
sets, based on the set association relationship and the map, a second position, which corresponds to the position of the virtual object, in the real space,
determines whether the second portion is located at the second position, and
receives an operation for the virtual object when it is determined that the second portion is located at the second position; and

a notification device that contactlessly notifies a prescribed information to a third portion of the body.

2. The system according to claim 1 ,
wherein the notification device stimulates a cutaneous sensation of the third portion to provide a notification of the prescribed information.

3. The system according to claim 2 ,
wherein the notification device includes at least one selected from a group consisting of an ultrasonic vibrator, a Peltier element, a laser, an air cannon, and an infrared source.

4. The system according to claim 2 ,
wherein the notification device includes plural ultrasonic vibrators that provide an acoustic radiation pressure to the third portion.

5. The system according to claim 1 ,
wherein the notification device contactlessly notifies the third portion that the real base point is set.

6. The system according to claim 1 ,
wherein the notification device contactlessly notifies the third portion that the second portion is located at the second position.

7. The system according to claim 1 ,
wherein the association relationship is set as a table or a function.

8. The system according to claim 1 ,
wherein the controller further changes the association relationship in response to the motion of the second portion.

9. The system according to claim 8 ,
wherein the controller changes the association relationship in response to a movement velocity of the second portion.

10. The system according to claim 1 ,
wherein in the association relationship, coordinate positions of all objects in the virtual space respectively correspond to coordinate positions in the real space that is detectable by the sensor.

11. The system according to claim 1 ,
wherein the controller further calculates a recommended position to which the second portion is to move before the association relationship is set,
the notification device further contactlessly notifies the third portion of information of the recommended position, and
the controller sets the association relationship after the second portion moves to the recommended position.

12. The system according to claim 1 ,
wherein the controller recalls the association relationship when a time in which the position of the second portion in the real space does not correspond to the second position exceeds a prescribed time.

13. The system according to claim 1 ,
wherein at least two of the first portion, the second portion, and the third portion are the same portion of the body.

14. The system according to claim 1 ,
wherein the notification device further contactlessly notifies the third portion that the operation is received.

15. The system according to claim 1 further comprising:
a display that displays the virtual object after the association relationship is set.

16. The system according to claim 1 ,
wherein the system is installed in an automobile that includes a steering wheel, and
a detection region of the sensor is a prescribed range that extends from the steering wheel.

17. The system according to claim 16 ,
wherein the controller stops at least either one of setting of the association relationship and the operation for the virtual object when a steering angle of the steering wheel is greater than a prescribed angle.

18. The system according to claim 1 ,
wherein the position of the virtual object is spaced from the position of the virtual base point in the virtual space.

19. The system according to claim 1 ,
wherein the second portion and the third portion are the same portion of the body.

20. The system according to claim 19 ,
wherein the notification device stimulates a cutaneous sensation of the third portion located at the first position.

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Wakuda Daisuke
• Ezaki Kenichi
• Matsumoto Takashi

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/04812

  Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title