Information processing device, information processing method, and program for graphical user interface

Patent metadata

Field	Value
Publication number	US-10241582-B2
Application number	US-201615200809-A
Country	US
Kind code	B2
Filing date	Jul 1, 2016
Priority date	Aug 19, 2010
Publication date	Mar 26, 2019
Grant date	Mar 26, 2019

Abstract

There is provided an information processing device including an acquisition section configured to acquire a curved movement of a body of a user as an operation, a display control section configured to display an object in a virtual three-dimensional space, and a process execution section configured to execute a process on the object based on the acquired operation. The object may be arranged on a first curved plane based on a virtual position of the user set in the virtual three-dimensional space, the first curved plane corresponding to the curved movement.

First claim

What is claimed is:

1. An information processing system comprising:
a display; and
at least one electrical circuitry configured to control the display to display first objects in a virtual three-dimensional space, wherein
a process is executed on at least one of the first objects based on a movement of at least one of a head and a hand of a user,
each of first tilted surfaces of the first objects are arranged on a curved plane in front of a virtual position associated with the head of the user in the virtual three-dimensional space,
each of the first tilted surfaces faces toward the virtual position,
the virtual position is substantially centered with respect to the curved plane,
the curved plane includes a first curved plane and a second curved plane,
the first objects are arranged on the first curved plane,
second objects are arranged on the second curved plane,
the second curved plane is arranged behind the first curved plane in a depth direction, and
an object having higher frequency of viewing by the user than that of each of the second objects is arranged as one of the first objects.

2. The information processing system according to claim 1 , wherein
the curved plane includes a first curved plane and a second curved plane,
the first curved plane is arranged above or below the second curved plane,
the first objects are arranged on the first curved plane,
each of the first curved plane and the second curved plane extends in a horizontal direction,
second objects are arranged on the second curved plane in the virtual three-dimensional space, and
the number of the first objects is larger than the number of the second objects.

3. The information processing system according to claim 2 , wherein
the second curved plane is tilted toward the first curved plane.

4. The information processing system according to claim 3 , wherein
each of the first curved plane and the second curved plane is at least a part of a spherical plane.

5. The information processing system according to claim 1 , wherein
the curved plane includes a first curved plane and a second curved plane,
the first objects are arranged on the first curved plane,
the first curved plane extends in a horizontal direction,
second objects are arranged on the second curved plane in the virtual three-dimensional space,
the second curved plane extends in a vertical direction, and
the first curved plane and the second curved plane intersect with each other in front of the virtual position.

6. The information processing system according to claim 5 , wherein
each of the second objects has a second tilted surface facing toward the virtual position.

7. The information processing system according to claim 1 , wherein
the curved plane includes a first curved plane, a second curved plane and a third curved plane,
each of the first curved plane, the second curved plane and the third curved plane extends in a horizontal direction,
the first curved plane is arranged between the second curved plane and the third curved plane in a vertical direction,
the first objects are arranged on the first curved plane,
second objects are arranged on the second curved plane, and
third objects are arranged on the third curved plane.

8. The information processing system according to claim 7 , wherein
each of the first curved plane, the second curved plane, and the third curved plane is at least a part of a cylindrical plane.

9. The information processing system according to claim 1 , wherein
each of the display and the at least one electrical circuitry is at least a part of a head mounted display.

10. The information processing system according to claim 9 , wherein
the at least one electrical circuitry is further configured to receive information of a shape of the hand of the user from a detecting unit.

11. The information processing system according to claim 10 , further comprising:
the detecting unit including at least one of an imaging unit, an infrared emitting unit, and an infrared receiving unit.

12. An information processing system comprising:
a display; and
at least one electrical circuitry configured to control the display to display first objects in a virtual three-dimensional space, wherein
a process is executed on at least one of the first objects based on a movement of at least one of a head and a hand of a user,
each of first tilted surfaces of the first objects are arranged on a curved plane in front of a virtual position associated with the head of the user in the virtual three-dimensional space,
each of the first tilted surfaces faces toward the virtual position,
the virtual position is substantially centered with respect to the curved plane,
the curved plane includes a first curved plane and a second curved plane,
the first objects are arranged on the first curved plane,
second objects are arranged on the second curved plane,
the second curved plane is arranged behind the first curved plane in a depth direction, and
the first curved plane is interchanged with the second curved plane in accordance with a hand gesture input of the user.

13. The information processing system according to claim 12 , wherein
the hand gesture input is a movement away from the user.

14. A server comprising:
at least one electrical circuitry configured to:
send display information to a display to display first objects in a virtual three-dimensional space;
receive movement information associated with a movement of at least one of a head and a hand of a user; and
send process information to execute on at least one of the first objects based on the movement information,

wherein
the first objects are arranged on a curved plane in front of a virtual position associated with the head of the user in the virtual three-dimensional space,
each of the first objects has a first tilted surface facing toward the virtual position,
the virtual position is substantially centered with respect to the curved plane,
the curved plane includes a first curved plane and a second curved plane,
the first objects are arranged on the first curved plane,
second objects are arranged on the second curved plane,
the second curved plane is arranged behind the first curved plane in a depth direction, and
the first curved plane is interchanged with the second curved plane in accordance with a hand gesture input of the user.

15. A non-transitory computer-readable medium storing instructions that, when executed by at least one electrical circuitry, cause the at least at least one electrical circuitry to execute a method, the method comprising:
controlling a display to display first objects in a virtual three-dimensional space, the display constituting at least a part of a head mounted display;
executing a process on at least one of the first objects based on a movement of at least one of a head and a hand of a user, wherein
the first objects are arranged on a curved plane in front of a virtual position associated with the head of the user in the virtual three-dimensional space,
each of the first objects has a first tilted surface facing toward the virtual position,
the virtual position is substantially centered with respect to the curved plane,
the curved plane includes a first curved plane and a second curved plane,
the first objects are arranged on the first curved plane,
second objects are arranged on the second curved plane,
the second curved plane is arranged behind the first curved plane in a depth direction, and
the first curved plane is interchanged with the second curved plane in accordance with a hand gestu

Assignees

• Sony Corp

Inventors

• Noda Takuro
• Komori Akihiro
• Satoh Nariaki
• Shigeta Osamu
• Yamamoto Kazuyuki

Classifications

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title