Information processing system, information processing apparatus, storage medium having information processing program stored therein, and image display method for controlling virtual objects based on at least body state data and/or touch position data

Patent metadata

Field	Value
Publication number	US-9370712-B2
Application number	US-201213352091-A
Country	US
Kind code	B2
Filing date	Jan 17, 2012
Priority date	Mar 8, 2011
Publication date	Jun 21, 2016
Grant date	Jun 21, 2016

Abstract

An action of a first object placed in a virtual world is controlled on the basis of body state data output from a portable display apparatus. An action of a second object placed in the virtual world is controlled on the basis of touch position data based on a touch position on a touch panel provided on a surface of a display screen of the portable display apparatus. Then, a first image including at least a part of the first object and at least a part of the second object is generated, and the first image is displayed on the portable display apparatus.

First claim

What is claimed is:

1. A non-transitory computer-readable storage medium storing an information processing program to be executed by a computer of an information processing apparatus capable of displaying an image on a portable display apparatus that outputs at least body state data based on an attitude and/or a motion of the portable display apparatus body and touch position data based on a touch position on a touch panel provided in the portable display apparatus, the information processing program, when executed, causing the computer to provide comprising:
calculating the attitude and/or the motion of the portable display apparatus on the basis of the body state data;
controlling, on the basis of the calculated attitude and/or motion of the portable display apparatus, an action of a first object without causing a second object to perform an action, the first object and the second object placed in a virtual world;
controlling, on the basis of the touch position data, an action of the second object without causing the first object to perform an action, the first object and the second object placed in the virtual world;
generating a first image including at least a part of the first object and at least a part of the second object; and
displaying the first image on the portable display apparatus,
if a motion of rotation of the portable display apparatus is calculated, the action of the first object is controlled so that the first object rotates relative to a display screen of the portable display apparatus, and the action of the second object is controlled so that the second object does not rotate relative to the display screen of the portable display apparatus.

2. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 1 , wherein
the action of the first object is controlled on the basis of the attitude and/or the motion of the portable display apparatus such that the first object rotates, and
the action of the second object is controlled on the basis of the touch position data such that the second object moves.

3. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 2 , wherein
the action of the first object is controlled such that the first object rotates relative to the second object, and
the action of the second object is controlled such that the second object moves relative to the first object.

4. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 2 , the information processing program further causing the computer to provide execution comprising:
acquiring data based on a load applied to a load detection device, wherein
the second object is controlled on the basis of the acquired data so as to move in a moving direction defined by a direction of the first object.

5. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 4 , wherein
only when the touch position data indicates that a touch operation is not being performed on the touch panel, the second object is controlled on the basis of the acquired data so as to move.

6. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 2 , the information processing program further causing the computer to provide execution comprising:
calculating, on the basis of the touch position data, a displacement of the touch position input to the touch panel, wherein
the second object is controlled on the basis of the displacement of the touch position so as to move.

7. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 6 , wherein
a moving direction in which the second object is to be caused to move is calculated on the basis of a direction of the displacement of the touch position, and the second object is controlled so as to move in the moving direction.

8. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 7 , wherein
a direction corresponding to the direction of the displacement and included in the virtual world displayed so as to overlap the displacement of the touch position is calculated as the moving direction, and the second object is controlled so as to move in the moving direction.

9. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 6 , wherein
a moving distance at which the second object is to be caused to move is calculated on the basis of an amount of the displacement of the touch position, and the second object is controlled so as to move at the moving distance.

10. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 9 , wherein
a distance corresponding to the amount of the displacement and included in the virtual world displayed so as to overlap the displacement of the touch position is calculated as the moving distance, and the second object is controlled so as to move at the moving distance.

11. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 1 , wherein
at least an attitude and/or a motion of the portable display apparatus that are obtained by rotating the portable display apparatus about a perspective direction of, and perpendicular to, a display screen of the portable display apparatus are calculated, and
the action of the first object is controlled in accordance with the attitude and/or the motion of the portable display apparatus that are obtained by rotating the portable display apparatus about the perspective direction.

12. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 11 , wherein
the action of the first object is controlled such that in accordance with a direction of rotation in which the portable display apparatus rotates about the perspective direction, the first object rotates or moves about a predetermined direction set in the virtual world and in a direction opposite to the direction of rotation.

13. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 11 , wherein
the action of the first object is controlled such that the first object rotates or moves in accordance with an angle by which a facing direction of the portable display apparatus body changes about the perspective direction.

14. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 13 , wherein
the action of the first object is controlled such that the first object rotates or moves by the same angle as the angle by which the facing direction of the portable display apparatus body changes.

15. The non-transitory computer-readable storage medium having stored thereon the information processing program according to claim 11 , wherein
the action of the first object is controlled such that in accordance with the attitude and/or the motion of the portable display apparatus that are obtained by rotating the portable display apparatus about the perspective direction, the first object rotates or moves about a predetermined direction set in the virtual world.

16. The non-tr

Assignees

• Hayashi Yugo
• Minato Keiichi
• Nintendo Co Ltd

Inventors

• Hayashi Yugo
• Minato Keiichi

Classifications

• A63F2300/105

  using inertial sensors, e.g. accelerometers, gyroscopes · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• A63F2300/8005

  Athletics · CPC title

• A63F13/06 Primary

  Human Necessities · mapped topic

• A63F13/211 Primary

  using inertial sensors, e.g. accelerometers or gyroscopes · CPC title