Information processing apparatus, information processing method, non-transitory computer-readable storage medium, and system

Patent metadata

Field	Value
Publication number	US-2016357491-A1
Application number	US-201615166307-A
Country	US
Kind code	A1
Filing date	May 27, 2016
Priority date	Jun 2, 2015
Publication date	Dec 8, 2016
Grant date	—

Abstract

An image of a virtual object is generated in accordance with a position and orientation of a first display device. In a case where a first mode is set, the generated image of the virtual object is displayed on a first display device and second display device. In a case where a second mode different from the first mode is set, a still image of the virtual object is displayed on the second display device. A portion of the virtual object in the still image is selected based on an instruction input by a user observing the second display device during display of the still image of the virtual object. An image of the virtual object displayed on the second display device is updated based on the selected portion of the virtual object.

First claim

What is claimed is:

1 . An information processing apparatus connected to a first display device and a second display device, the information processing apparatus comprising:
a generation unit configured to generate an image of a virtual object in accordance with a position and an orientation of the first display device; a display control unit configured to in a case where a first mode is set, cause the first display device and the second display device to display the image of the virtual object generated by the generation unit, and in a case where a second mode different from the first mode is set, cause the second display device to display a still image of the virtual object; a selection unit configured to select a portion of the virtual object in the still image based on an instruction input by a user observing the second display device during display of the still image of the virtual object; and an updating unit configured to update an image of the virtual object displayed by the second display device based on the selected portion of the virtual object.

2 . The information processing apparatus according to claim 1 , wherein
the first display device is worn on a head of a user observing the first display device.

3 . The information processing apparatus according to claim 1 , wherein
the first display device includes an image sensing unit.

4 . The information processing apparatus according to claim 3 , further comprising
a compositing unit configured to generate a composite image by compositing an image captured by the image sensing unit with an image of the virtual object, wherein in a case where the first mode is set, the display control unit causes the first display device and the second display device to display the composite image.

5 . The information processing apparatus according to claim 1 , wherein
the instruction by the user is input through a manipulation involving a contact on a display screen of the second display device.

6 . The information processing apparatus according to claim 1 , wherein
in a case where the second mode is set, the display control unit causes the second display device to display a still image of the virtual object corresponding to a position and an orientation of the first display device at the time of setting of the second mode.

7 . The information processing apparatus according to claim 1 , wherein
in a case where the second mode is set, the display control unit causes the first display device to display an image of the virtual object based on a change in a position and an orientation of the first display device.

8 . The information processing apparatus according to claim 1 , further comprising
a unit configured to accept the instruction by the user observing the second display device while the second mode is set, the instruction being directed to at least one process included among magnification, reduction, rotation, and translation.

9 . The information processing apparatus according to claim 1 , wherein
the selection unit specifies, from the virtual object, using a position and an orientation of the first display device and a designated position based on the instruction by the user, a portion corresponding to the designated position.

10 . The information processing apparatus according to claim 1 , wherein
the updating unit updates the image of the virtual object so that the selected portion of the virtual object is highlighted.

11 . The information processing apparatus according to claim 1 , further comprising
a unit configured to accept, from the user observing the second display device, an update instruction for updating a position and an orientation of a viewpoint while the second mode is set, wherein the display control unit causes the second display device to display an image of the virtual object from a viewpoint resulting from the update instruction.

12 . An information processing method performed by an information processing apparatus connected to a first display device and a second display device, the information processing method comprising:
generating an image of a virtual object in accordance with a position and an orientation of the first display device; in a case where a first mode is set, causing the first display device and the second display device to display the generated image of the virtual object; in a case where a second mode different from the first mode is set, causing the second display device to display a still image of the virtual object; selecting a portion of the virtual object in the still image based on an instruction input by a user observing the second display device during display of the still image of the virtual object; and updating an image of the virtual object displayed by the second display device based on the selected portion of the virtual object.

13 . A non-transitory computer-readable storage medium storing a computer program for causing a computer connected to a first display device and a second display device to function as:
a generation unit configured to generate an image of a virtual object in accordance with a position and an orientation of the first display device; a display control unit configured to
in a case where a first mode is set, cause the first display device and the second display device to display the image of the virtual object generated by the generation unit, and in a case where a second mode different from the first mode is set, cause the second display device to display a still image of the virtual object;
a selection unit configured to select a portion of the virtual object in the still image based on an instruction input by a user observing the second display device during display of the still image of the virtual object; and an updating unit configured to update an image of the virtual object displayed by the second display device based on the selected portion of the virtual object.

14 . A system, comprising:
a first display device; a second display device; and an information processing apparatus connected to the first display device and the second display device, wherein the information processing apparatus includes: a generation unit configured to generate an image of a virtual object in accordance with a position and an orientation of the first display device; a display control unit configured to in a case where a first mode is set, cause the first display device and the second display device to display the image of the virtual object generated by the generation unit, and
in a case where a second mode different from the first mode is set, cause the second display device to display a still image of the virtual object;
a selection unit configured to select a portion of the virtual object in the still image based on an instruction input by a user observing the second display device during display of the still image of the virtual object; and
an updating unit configured to update an image of the virtual object displayed by the second display device based on the selected portion of the virtual object.

Assignees

• Canon Kk

Inventors

• Oya Takashi

Classifications

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/1423 Primary

  controlling a plurality of local displays, e.g. CRT and flat panel display · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T2219/024

  Multi-user, collaborative environment · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title