Storage medium storing image processing program and image processing apparatus

Patent metadata

Field	Value
Publication number	US-9720556-B2
Application number	US-201213476705-A
Country	US
Kind code	B2
Filing date	May 21, 2012
Priority date	Oct 1, 2007
Publication date	Aug 1, 2017
Grant date	Aug 1, 2017

Abstract

An image is placed, based on a predetermined designation input, on a predetermined placement position in relation to a display area, and displayed. The image is enlarged and reduced in accordance with an enlargement ratio of the image, and an area within which the placement position can be set is changed in relation to the display area in accordance with the enlargement ratio. Then, based on an obtained designation input, a position within the area, which position corresponds to the designation input, is calculated as a placement position, and the image having been enlarged and reduced is placed on the placement position. The image is then displayed on a display device.

First claim

What is claimed is:

1. A storage medium storing an image processing program to be executed by a computer of an image processing apparatus for placing a displayed image on a predetermined placement position in a display area in accordance with a designation input obtained from an input device having an image-pickup configured to take an image of an imaging target, the image processing program comprising instructions causing the computer to:
obtain the designation input from the input device;
calculate, based on a position of the imaging target in the taken image, a distance between the imaging target and the image-pickup;
based on the distance, change a rate of change of the placement position in relation to a change of the position of the imaging target in the taken image, thereby calculating the placement position;
placing the image on the placement position; and
causing a display device to display the image at the image placement position,
wherein the placement position calculation instructions cause the computer to calculate the placement position in such a manner as to increase the rate of change of the placement position in accordance with a decrease in the distance calculated by the distance calculation.

2. The storage medium storing the image processing program according to claim 1 , further causing the computer to function as an area setter for, in accordance with the distance calculated by the distance calculation, changing, in relation to the display area, an area within which the placement position is allowed to be set, wherein
the area setting sets the area so as to extend in accordance with a decrease in the distance calculated by the distance calculation.

3. The storage medium storing the image processing program according to claim 1 , wherein a plurality of imaging targets are provided, and
the distance calculation calculates a distance between the image-pickup and the imaging targets, based on a distance between the imaging targets in the taken image.

4. An image processing apparatus for placing an image on a predetermined placement position in relation to a display area of a display device in accordance with a designation input obtained from an input device having an image-pickup for taking an image of an imaging target, the image processing apparatus comprising a processor configured to:
obtain the designation input from the input device;
calculate a distance, based on a position of the imaging target in the taken image, between the imaging target and the image-pickup;
based on the calculated distance, change a rate of change of the placement position in relation to a change of the position of the imaging target in the taken image, thereby calculating the placement position;
place the image on the placement position; and
causing a display device to display the placed image, wherein the placement position calculation calculates the placement position in such a manner as to increase the rate of change of the placement position in accordance with a decrease in the distance calculated by the distance calculation.

5. The image processing apparatus according to claim 4 , wherein the processor is further configured to, in accordance with the distance calculated by the distance calculation, change, in relation to the display area, an area within which the placement position is allowed to be set, and set the area so as to extend in accordance with a decrease in the distance calculated by the distance calculation.

6. In an interactive display system for use with a display device and a handheld imaging device that images an imaging target, the display system comprising a processor that receives information from the handheld imaging device and is configured to enable a user to display and move an object on the display device in accordance with changes in where the input device is pointing, a method comprising:
(a) using the processor to automatically determine where to display the object based on information obtained by the handheld imaging device;
(b) using the processor to automatically determine, based on optical information obtained by the handheld imaging device, a change in distance of the handheld imaging device from the display device;
(c) using the processor to calculate an object image movement scaling value specifying the rate the placement position of a displayed object changes with change in the input device pointing direction so as to increase the rate of change of the placement position in accordance with a decrease in the distance of the handheld imaging device from the display device; and
(d) using the processor to automatically control how the displayed object moves on the display device in response to movement of the input device based at least in part on the calculated object image movement scaling value.

7. In an interactive display system for use with a display device and a handheld imaging device that images an imaging target, the display system comprising a processor that receives information from the handheld imaging device and is configured to enable a user to display and move an object on the display device in accordance with changes in where the input device is pointing, a method comprising:
(a) using the processor to automatically determine where to display the object based on information obtained from the handheld imaging device;
(b) using the processor to automatically determine, based on optical information, a change in distance between the handheld imaging device and the display device;
(c) using the processor to calculate an object image movement scaling value specifying the rate the placement position of a displayed object changes with change in the input device pointing direction so as to increase the rate of change of the placement position in accordance with a decrease in the distance; and
(d) using the processor to automatically control how the displayed object responds to movement of the input device based at least in part on the calculated object image movement scaling value.

8. A non-transitory computer readable storage medium having stored thereon an image processing program to be executed by a computer which displays a predetermined object image at a predetermined placement position in a display area on a display device in accordance with information obtained from an input device, the input device having an image-pickup device/sensor for taking images of an imaging target in a pointing direction of the input device, and for moving and displaying the predetermined object image at a determined placement position in the display area in accordance with changes in a position of the image of the imaging target in the image-pick up device corresponding to a movement of a pointing direction of the input device, the image processing program causing the computer to perform operations comprising:
determining a designation input based on information obtained from the input device and calculating the predetermined placement position based at least in part on the designation input;
calculating a placement position in accordance with changes in a position of the image of the imaging target in the image-pick up device, wherein the placement position is calculated using a user-settable image object scale value,
using the user-settable image object scale value to affect a rate of change of a placement position with respect to a movement in the position of the imaging target in the taken image in a manner that causes an increase in the rate of change of the placement position in accordance with a decrease in a distance between the imaging target and the image-pickup device;
displaying the image at the calculated placement position; and
causing a display device to display the object image at the calculated pl

Assignees

• Yamashita Yoshikazu
• Minato Keiichi
• Nintendo Co Ltd

Inventors

• Yamashita Yoshikazu
• Minato Keiichi

Classifications

• G06F3/0325

  using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image · CPC title

• G06F3/0481 Primary

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• A63F2300/1087

  comprising photodetecting means, e.g. a camera · CPC title

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title