Learning support system and recording medium

Patent metadata

Field	Value
Publication number	US-2019355281-A1
Application number	US-201916407549-A
Country	US
Kind code	A1
Filing date	May 9, 2019
Priority date	May 15, 2018
Publication date	Nov 21, 2019
Grant date	—

Abstract

A learning support system of the present invention is a learning support system that supports learning of work using a real measuring machine for measuring a measurement object, including a position and attitude recognition unit that recognizes a position and/or an attitude of an object within a real three-dimensional space; a storage unit that stores learning data that defines exemplary work performed by an avatar using a virtual measuring machine within a virtual three-dimensional space; a stereoscopic video generation unit that generates a three-dimensional video of the exemplary work performed by the avatar, based on the position and/or the attitude of the object recognized by the position and attitude recognition unit, as well as the learning data stored in the storage unit; and a head-mounted display that is mounted on a learner's head, and displays the three-dimensional video so as to be superimposed on the real three-dimensional space.

First claim

What is claimed is:

1 . A learning support system that supports learning of work using a real measuring machine for measuring a measurement object, comprising:
a position and attitude recognition unit that recognizes a position and/or an attitude of an object within a real three-dimensional space; a storage unit that stores learning data that defines exemplary work performed by an avatar using a virtual measuring machine within a virtual three-dimensional space; a stereoscopic video generation unit that generates a three-dimensional video of the exemplary work performed by the avatar, based on the position and/or the attitude of the object recognized by the position and attitude recognition unit, as well as the learning data stored in the storage unit; and a head-mounted display that is mounted on a learner's head, and displays the three-dimensional video so as to be superimposed on the real three-dimensional space.

2 . The learning support system according to claim 1 , wherein
the position and attitude recognition unit recognizes the position and/or the attitude of the object within the real three-dimensional space, based on output from a three-dimensional sensor that detects three-dimensional coordinates of the object in the real three-dimensional space, and/or from a head sensor that is included in the head-mounted display and senses a position and/or an attitude of the head-mounted display.

3 . The learning support system according to claim 1 , wherein
the stereoscopic video generation unit recognizes a correspondence relationship between a coordinate system in the real three-dimensional space and a coordinate system in the virtual three-dimensional space, and generates three-dimensional video data so that a visual field moves within the virtual three-dimensional space in accordance with movement of the head-mounted display in the real three-dimensional space.

4 . The learning support system according to claim 1 , wherein the stereoscopic video generation unit performs:
placing the avatar at position coordinates within the virtual three-dimensional space corresponding to position coordinates where the head-mounted display exists in the real three-dimensional space; placing the virtual measuring machine at position coordinates within the virtual three-dimensional space corresponding to position coordinates where the real measuring machine is placed in the real three-dimensional space; grasping progress of the work performed by the learner, based on the learning data, as well as a position and an attitude of the learner and/or the real measuring machine outputted by the position and attitude recognition unit; and generating the three-dimensional video data of the exemplary work so as to precede the learner's work by a predetermined time, based on the grasped progress of the work and the learning data.

5 . The learning support system according to claim 1 , wherein
the stereoscopic video generation unit calculates a delay time of the grasped progress of the work from the exemplary work, and notifies the learner of the delay time.

6 . The learning support system according to claim 1 , wherein
the stereoscopic video generation unit generates the three-dimensional video data so that the visual field moves within the virtual three-dimensional space in response to an operation without movement of the learner within the real three-dimensional space.

7 . The learning support system according to claim 1 , wherein
the head-mounted display comprises a transmissive display.

8 . A non-transitory computer-readable recording medium storing a program, wherein the program causes a computer to function as a learning support system according to claim 1 .

Assignees

• Mitutoyo Corp

Inventors

• Abe Shinsaku

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G09B9/00

  Simulators for teaching or training purposes (for the use of weapons F41; computing aspects G06; {protocols for games, networked simulations or virtual reality H04L67/131}) · CPC title

• H04N13/344

  with head-mounted left-right displays · CPC title

• G09B5/02 Primary

  with visual presentation of the material to be studied, e.g. using film strip · CPC title

• G09B25/02 Primary

  of industrial processes; of machinery · CPC title